Google?s User Data Empire

[u-Bob]

old article, but now more relevant than ever:
http://www.slightlyshadyseo.com/inde...r-data-empire/

Google?s User Data Empire

I?ve been holding off on doing this entry for a bit, but with the introduction of SearchWiki their aims are so clear to me, I just can?t hold off anymore. Google?s problems over the past 2 years have been the result of an algorithm overly based on links. They?ve finally hit their wall. With the latest batch of link buying platforms, their options for truly detecting it are dying out. One can call Google many things, but ignorant of the marketplace and SEOs is not one of those things. So they needed a response. Their response? User data. Lots of fucking user data.
I know I?ve covered a similar topic before(how Google is essentially creating it?s own internet), but I wanted to do one specifically on user data.

The Basic Layout of the Google User Data Empire

* Google Adsense ? Google adsense has the unique ability to track without fear of repurcussion. Why? Because any data they send back can be used and archived in their eternal battle against click fraud. This means they transmit everything from screen resolution to ability/version of flash(things that arguably have nothing to do with click fraud). Either way, it?s a window they have into millions and millions of hits on the internet daily. It?s targetted towards informational sites though, and not commercial sites(Google?s true interest).
* Google Analytics ? This is Google?s window into non informational sites. It tracks an absolutely obscene amount of user data(actually, more than you can see/use in their analytics panel). Without this, they?d have no window into sale based sites that would give the competition traffic if they ran adsense. Webmasters flock to this tool, not realizing the danger of feeding Google all that information. Here?s a hint: it tracks conversion rates. Now, Google is currently taking anywhere from 2-5x the amount of adsense revenue they?re giving to the website owner, which means if you do PPC you?re more or less at their mercy for how much you?re paying per click. Them knowing how much you?re making per click via their conversion tracking could (in theory) allow them to adjust your PPC expenses up, while still remaining profitable. But once again, the real gold here is the ability to track the users.
* Google Chrome ? Google Chrome is an interesting creation. Google is a public company. That means they cannot create something like chrome without a significant financial reason. The trick is they?re already propping up firefox via $59.5-70 million a year in donations(85% of Firefox?s revenue) to keep them as the default search. $70 million is jack shit to Google, so they definitely wouldn?t create Chrome simply to save on that, and they?re already getting the ad revenue from firefox searches so that itself doesn?t make sense. So why would they create Chrome?
o Unique Identifier ? Chrome generates a unique id whether or not you agree to send your data to Google. If you agree to send it, this ID gets trasmitted. So what does that do? It makes it so they can identify you regardless of where your computer is, and regardless of cookies. It?s truly the perfect information gatherer.
o [Partially] Closed Source ? I?m no open source junkie, but let?s not kid ourselves. The one primary difference between Firefox and Chrome is that Chrome is closed source. It?s based off of Chromium, a BSD licensed piece of software. BSD license means you don?t have to open source your modification on their code(unlike the GPL). This means one has to run a sniffer to see the data Chrome is sending out; you can?t simply open the source code. While initial versions don?t send out an excessive amount of data, I?m willing to bet user adoption will change that.
o Typing Tracking ? I just sniffed a Chrome request(opted in to trasmit data). The page I was going to was complete blank except for a fake 404 error. Magically, it created 2 requests to Google. One was a ?google suggest? style query(which means yes, Google suggest is used for tracking). The other was a curious query, as it trasmitted events(used generic names so I dont know what each stood for), a unique ID, and interestingly enough a variable called ?rep?, presumably implying a user reputation level. A single type in of a domain created 3 of these ?events?. I wonder what they are.
* Google Checkout ? One of a few ways Google is moving to be able to identify real people. That is to say it?s a way to be able to tie an IP and a cookie/username to a real, 100% legit name. This is worth more than most could ever imagine. Not only is that person identified as someone with a credit card, but the billing address itself gives you a region the person is from, and a probable demographic. Also used to tie back to a real identity is the much debated Google Health, which can store medical information on an individual.
* Google Toolbar ? Fantastic for identifying webmasters, the Google toolbar is among the most powerful methods of getting user data. How long do you think it will be before they turn users into unknowing cloaking checkers(click search results, omgz this pagerank request isn?t for the right domain)? Every single webpage you access, private or not, gets sent to Google for their page rank check.
* Google Android ? The one set of data they couldn?t access properly before. Phone habits. Note how agressively they?ve pursued the cell phone market(IPhone anyone?)
* SearchWiki ? Google?s latest addition to let you reorganize the search results. They say the data is used only for the user that changes it. Fun fact? That makes no sense. Google already has bookmarks, and if you are logged in and click ?Web History?(and are opted in) it will show you the searches you?ve made and the results you?ve clicked. So their is absolutely no reason for the creation of this other than to alter search results, and more importantly gauge user?s reactions to commercial vs. informational sites.
* Other Obvious Sources ? Gmail(your contacts, your interests), the actual search results, and many more.

Google justifies all of this on the idea that a lot of other companies have been gathering this data for some time. But there?s a difference. Those companies only had data from one source at a time. For Google, it?s different. Their specialty is organizing information. They have access to more avenues for userdata than any other company in the history of the world, and the ability to connect every aspect of every person?s life. Log into gmail on android? Congrats, your phone number can now be tied to your IP home IP. Don?t search using Google? Between adsense and analytics, you?ve probably got a 35-50% chance of sending data to Google anyways with every page load. Did you buy something through an ad served by Google? With conversion tracking, they know you bought, and can tie that back to everything else.

Why I?m Scared as a User
I?m really beginning to get scared here. Even ignoring Google?s less than benevolent intentions, can anyone imagine a data breach? No company is truly secure. 4 years ago the entire member database of the largest porn network on the planet was available(including passwords) for 1 grand. over 500,000 records. There have been data breaches at pharmaceutical companies, leaking millions customer records, down to the pill they took and when the prescription was up. Government servers get compromised, credit bureaus get compromised. So why would Google be any different?

Why I?m Scared as a Webmaster
Google has an interesting issue. They have more userdata than they can allow adwords advertisers to target. This is an absolutely insane amount of information. So they?re left with 3 options.

1. Enter the CPA Market ? With their Google Affiliate Network, this seems like a likely path. Imagine a massive in house program that can get clicks for dirt cheap(remember, Google takes a HUGE cut out of adsense revenue. Surrendering that they can afford conversion rates that would make normal PPCers cringe).
2. Not Use the Data ? Google is a publically traded company. Their responsibility is to stock holders. So regardless of how warm and fuzzy they act to the internet community at large, this option is not viable. Their privacy policies contradict the filth they spew towards the consumer about how the data will and won?t be used. And guess which one is legally the reality? The privacy policy. They?re using the data folks.
3. Take Control from Advertisers ? They can?t let me target based on all the data they have, so the alternative is to make the decisions for me based on what they think is best. Well, sort of. Remember that Google automatically optimizes not for conversions, but for click through and profit on their end.

I don?t understand how prominent geeks normally so paranoid over spyware and whatnot can ignore Google. They function on a higher level than any spyware company in history, and do it all by winking at the webmaster community and acting like they?ll look out for us. ?Do No Evil? is the motto of a private company. Not a public company. It?s the antithesis of the free market economy. What is good for the consumer is not good for the company, and that is especially true with an advertising company that has access to so much data.

[Jdoughs]

Google is BIG BROTHER.

No company, government, or religion, has ever held as much user data or general consensus on purchasing, usage, and other factors as google has. NOBODY.

There is even a few great documentaries about Google and their 'true intents' with the data. Lots of conspiracy nuts are all over it.

[alias]

Interesting.

[alias]

Originally Posted by Jdoughs

Google is BIG BROTHER.

No company, government, or religion, has ever held as much user data or general consensus on purchasing, usage, and other factors as google has. NOBODY.

There is even a few great documentaries about Google and their 'true intents' with the data. Lots of conspiracy nuts are all over it.

see eye eh brah

[u-Bob]

Google results without the ads, without the tracking: http://www.scroogle.org/cgi-bin/scraper.htm

[Jdoughs]

Originally Posted by alias

see eye eh brah

I really don't think the C.I.A could compare to them, although the CIA wouldn't be focused on the same data Google would be, but you can bet that they would love to have access to that data of Googles.

[Angry Jew Cat - Banned for Life]

I read that article a long time ago, and remembered it well. I wound up reading Planet Google not long after that. When you start looking at all the property Google has online, and how they integrate into the online experience so much, it's a little bit mindblowing just how much they know about people through the entire collective of data they have. It's next to impossible to use the internet without touching them on just about every page you load. They really do want to know everything, and some of their projects and ambitions are pretty wild.

[Elli]

Now Google's been driving unmanned cars on public roads: http://www.disinfo.com/2010/10/googl...nia-roads-now/

[u-Bob]

Originally Posted by Jdoughs

I really don't think the C.I.A could compare to them, although the CIA wouldn't be focused on the same data Google would be, but you can bet that they would love to have access to that data of Googles.

on a side note: the CIA did invest in Google.

[Babaganoosh]

That's why Google doesn't get any of my important data. I won't touch analytics, webmaster tools or anything that helps Google figure out what I own, how much traffic it gets or where that traffic comes from.

[Angry Jew Cat - Banned for Life]

Originally Posted by Babaganoosh

That's why Google doesn't get any of my important data. I won't touch analytics, webmaster tools or anything that helps Google figure out what I own, how much traffic it gets or where that traffic comes from.

plenty of good opensource options for that anyways.

[Jdoughs]

Originally Posted by Babaganoosh

That's why Google doesn't get any of my important data. I won't touch analytics, webmaster tools or anything that helps Google figure out what I own, how much traffic it gets or where that traffic comes from.

I don't either, but I think we'd be a fools to think they don't know most of this stuff anyways.

[notime]

Originally Posted by u-Bob

on a side note: the CIA did invest in Google.

It would have surprised me if they didn't care about this massive giant (or others).

[Jdoughs]

Originally Posted by notime

It would have surprised me if they didn't care about this massive giant (or others).

I'd have to say they are bigger.

[Serge Litehead]

they know what you are thinking

[ThumbLord]

scary indeed but known facts

[Angry Jew Cat - Banned for Life]

I'd say there's a lot of people who Google knows better than they know themselves. At the very least, they know a lot more about you, than you do them.

[notime]

Originally Posted by Angry Jew Cat

I'd say there's a lot of people who Google knows better than they know themselves. At the very least, they know a lot more about you, than you do them.

I recall it was a car or a handbag in the original pre roll.

[Cyber Fucker]

[Agent 488]

http://www.theregister.co.uk/2006/03..._search_twice/

[moeloubani]

I'm not too worried about Google because that's a natural progression with the company. If you can get all this data and use it then why not? It's a company and they want to make money from you using their services, at least we don't have to pay for them. I'd be more concerned as to what the intentions are of governments that spy on people and want to know where people are for...what reasons exactly?

[epitome]

CIA companies have invested in both Google and Facebook.

http://www.google.com/search?aq=f&so...8&q=google+cia

They're still doing business. Public business. Imagine what we don't know about.

Google CIA and these two companies and you'll see all of the ties.

I forget the name of the company that has CIA ties that made initial investments in Facebook at least ... damn it, anyone know off the top of their heads which company it is?

[epitome]

Found it. In-Q-Tel is the investment arm of the CIA.

http://www.iqt.org/

[u-Bob]

Originally Posted by Babaganoosh

That's why Google doesn't get any of my important data. I won't touch analytics, webmaster tools or anything that helps Google figure out what I own, how much traffic it gets or where that traffic comes from.

[bolsex]

Interesting info!

[Rankings]

Google may actually buy Earth at some point