The 1000 most-visited sites on the web (by Google) (opens in new tab)

(fseek.me)

52 pointsddbb15y ago52 comments

Stackoverflow: #824 experts-exchange.com: #996

52 comments

I extracted the data, added IP, country and response headers, and dumped it into a usable format:

You can do some decently interesting analysis..like the fact that nginx is the front-end for nearly as many sites as IIS.

lazyant15y ago

Thanks for the data.

"nginx is the front-end for nearly as many sites as IIS", oh I wished that was true but according to my naive counting IIS is over 3 times more popular, am I missing something?:

$ wget http://openmymind.net/top1000data.txt

$ grep -c '"Server": "nginx"' top1000data.txt

$ grep -c '"Server": "Microsoft-IIS' top1000data.txt

149

ireadzalot15y ago

Could you share how you extracted the data? I thought it was nifty that way you have it in that txt file. Thanks.

sonnyz15y ago

Why is dropbox 'myth and folklore'???

latch15y ago

The categories of the json dump come directly from the original google source..so i don't know (and dropbox certainly isn't the only mis-categorized entry):

http://www.google.com/adplanner/static/top1000/

rmorrison15y ago

Oh god, and I've been trusting them w/ my backups!!!!!

sosuke15y ago

Over what time period is pageviews calculated on?

latch15y ago

The page views is pulled from the original google list. They have more information at: http://www.google.com/support/adplanner/bin/answer.py?hl=en&...

They don't say what time frame page view is, but they do say unique visits is over the course of 1 month - so its probably safe to assume page view is also over 1 month.

jpdbaugh15y ago

They must have filtered porn. There is no way redtube.com is not in the top 100.

sucuri215y ago

They did: " Keep in mind that the list excludes adult sites, ad networks, domains that don't have publicly visible content or don't load properly, and certain Google sites. "

jcl15y ago

A curious list of restrictions... I wonder what kind of site would be in the top 1000 that didn't have publicly visible content or load properly? Pure Flash sites, maybe?

1 more reply

jpdbaugh15y ago

Sorry! I must have missed that.

remi15y ago

Source: http://www.google.com/adplanner/static/top1000/

petercooper15y ago

Not sure why that's not the main link here instead of a useless blog article that removes half the data and adds no insight or extra information whatsoever.. :-)

portman15y ago

Amazing that Facebook has ONE THOUSAND pageviews per unique visitor compared to about 100 pageviews per unique visitor on the rest of the sites.

rayvega15y ago

# 824 stackoverflow vs # 994 expertsexchange

Perhaps another confirmation of what the SO folks have been saying about their popularity.

petercooper15y ago

Note that StackOverflow is listed as being in the "Music" category :-) Wha..?

cadr15y ago

I always go to StackOverflow to find out what the kids are listening to these days.

sucuri215y ago

#20 - ask.com #252 - digg.com #261 - justin.tv

Reddit not in the list... What I don't understand is how come sites like openoffice.org, kaspersky.com, mcafee.com are so high in the list. Do people really visit them that often?

CapitalistCartr15y ago

It's more likely that their computer does. For stuff like Auto-updates.

lftl15y ago

Ahh that probably explains counduit.com at #29 as well.

1 more reply

michaelbuckbee15y ago

Given how inaccurate the categorizations are I think it's possible that Reddit got put in the "adult" category.

pg15y ago

Anyone care to do a scatterplot of domain name length vs rank?

tewks15y ago

It looks somewhat periodic:

http://images.rdujour.com/wp-content/uploads/2010/05/domainL...

I did not include the length of the tld.

tewks15y ago

Monthly uniques versus domain name length:

http://images.rdujour.com/wp-content/uploads/2010/05/uniques...

1 more reply

icey15y ago

Depressingly, Mahalo is on the list (#946).

trun15y ago

Dropbox on the list at 985. Impressive.

darien15y ago

But reddit.com is nowhere to be seen... surprising.

drats15y ago

My question is, if reddit were on that list, would the moderation system be able to prevent it turning into Digg? I don't think it could, although maybe the subreddit system could. Places like /r/politics/ are fairly useless for intelligent debate already. Such link sharing sites don't have the same "my friends are there" grounding force that Facebook has, it's just the "vibe" and community so running away to a new site is easily mounted.

petercooper15y ago

And listed as a "Myth and Folklore" site. I wonder who came up with these "categories" - there are some crazy assignments in the list.

sucuri215y ago

Did you guys notice Wordpress.com and .org in there:

.com: 120,000,000 uniques

.org: 8,100,000 uniques

Impressive.

larryfreeman15y ago

Keep in mind that the numbers listed are estimations.

For example, HubPages, the site where I work, is listed at #270 with 11M unique visitors and 97M page views.

Our monthly absolute unique visitors (according to Google Analytics) is more than three times that. Our monthly page views are greater than 100M.

monos15y ago

"...as measured by Ad Planner."

the list is a decent guesstimate. unless every single site on the planet uses the facebook like button, google analytics, google ads, or something else that tracks globally, there is now way to correctly measure UC or PI.

jhaglund15y ago

it reassures me that foxnews.com is farther down than I would have expected.

43. http://bbc.co.uk 83. http://nytimes.com 179. http://reuters.com 257. http://foxsports.com 279. http://foxnews.com

dolinsky15y ago

Mashable - #696 Techcrunch - #850. Nice to see I'm not the only one that prefers Cashmore to Arrington.

ElbertF15y ago

Why? All Mashable does is post about Twitter trends and recycle Techcrunch posts a week later.

arst15y ago

I really doubt that usgs.gov (#978) gets anywhere near the number of visits that nfl.com gets (#993).

ojbyrne15y ago

Everytime there's an earthquake in California, half the state goes there.

1 more reply

wheaties15y ago

Wow, yahoo is up there. It's a shame they can't monetize their websites more.

ThomPete15y ago

I think their problem is that they are to big an operation. They probably could be if they trimmed the company.

zandorg15y ago

Geocities still running in Japan after being shut down in the west? Wierd!

alexyim15y ago

It's interesting how hard it is to come up with http://windows.com even though I tried explicitly searching for it

volida15y ago

where s youtube?

jcl15y ago

"Keep in mind that the list excludes adult sites, ad networks, domains that don't have publicly visible content or don't load properly, and certain Google sites."

hokkos15y ago

where is google in that list ?

bond15y ago

"Keep in mind that the list excludes adult sites, ad networks, domains that don't have publicly visible content or don't load properly, and certain Google sites." reply

retube15y ago

the daily mail at 236 aarrgghhhhh!!!!!!!

rokhayakebe15y ago

Scribd 102. Excellent. I would like to know how much financing each one of those site took to date.

ori_b15y ago

google isn't on that list?

nkassis15y ago

where is slashdot?

j / k navigate · click thread line to collapse

52 comments

latch15y ago

I extracted the data, added IP, country and response headers, and dumped it into a usable format:

http://openmymind.net/top1000data.txt

You can do some decently interesting analysis..like the fact that nginx is the front-end for nearly as many sites as IIS.

lazyant15y ago

Thanks for the data.

"nginx is the front-end for nearly as many sites as IIS", oh I wished that was true but according to my naive counting IIS is over 3 times more popular, am I missing something?:

$ wget http://openmymind.net/top1000data.txt

$ grep -c '"Server": "nginx"' top1000data.txt

$ grep -c '"Server": "Microsoft-IIS' top1000data.txt

149

ireadzalot15y ago

Could you share how you extracted the data? I thought it was nifty that way you have it in that txt file. Thanks.

sonnyz15y ago

Why is dropbox 'myth and folklore'???

latch15y ago

The categories of the json dump come directly from the original google source..so i don't know (and dropbox certainly isn't the only mis-categorized entry):

http://www.google.com/adplanner/static/top1000/

rmorrison15y ago

Oh god, and I've been trusting them w/ my backups!!!!!

sosuke15y ago

Over what time period is pageviews calculated on?

latch15y ago

The page views is pulled from the original google list. They have more information at: http://www.google.com/support/adplanner/bin/answer.py?hl=en&...

They don't say what time frame page view is, but they do say unique visits is over the course of 1 month - so its probably safe to assume page view is also over 1 month.

jpdbaugh15y ago

They must have filtered porn. There is no way redtube.com is not in the top 100.

sucuri215y ago

They did: " Keep in mind that the list excludes adult sites, ad networks, domains that don't have publicly visible content or don't load properly, and certain Google sites. "

jcl15y ago

A curious list of restrictions... I wonder what kind of site would be in the top 1000 that didn't have publicly visible content or load properly? Pure Flash sites, maybe?

1 more reply

jpdbaugh15y ago

Sorry! I must have missed that.

remi15y ago

Source: http://www.google.com/adplanner/static/top1000/

petercooper15y ago

Not sure why that's not the main link here instead of a useless blog article that removes half the data and adds no insight or extra information whatsoever.. :-)

portman15y ago

Amazing that Facebook has ONE THOUSAND pageviews per unique visitor compared to about 100 pageviews per unique visitor on the rest of the sites.

rayvega15y ago

# 824 stackoverflow vs # 994 expertsexchange

Perhaps another confirmation of what the SO folks have been saying about their popularity.

petercooper15y ago

Note that StackOverflow is listed as being in the "Music" category :-) Wha..?

cadr15y ago

I always go to StackOverflow to find out what the kids are listening to these days.

sucuri215y ago

#20 - ask.com #252 - digg.com #261 - justin.tv

Reddit not in the list... What I don't understand is how come sites like openoffice.org, kaspersky.com, mcafee.com are so high in the list. Do people really visit them that often?

CapitalistCartr15y ago

It's more likely that their computer does. For stuff like Auto-updates.

lftl15y ago

Ahh that probably explains counduit.com at #29 as well.

1 more reply

michaelbuckbee15y ago

Given how inaccurate the categorizations are I think it's possible that Reddit got put in the "adult" category.

pg15y ago

Anyone care to do a scatterplot of domain name length vs rank?

tewks15y ago

It looks somewhat periodic:

http://images.rdujour.com/wp-content/uploads/2010/05/domainL...

I did not include the length of the tld.

tewks15y ago

Monthly uniques versus domain name length:

http://images.rdujour.com/wp-content/uploads/2010/05/uniques...

1 more reply

icey15y ago

Depressingly, Mahalo is on the list (#946).

trun15y ago

Dropbox on the list at 985. Impressive.

darien15y ago

But reddit.com is nowhere to be seen... surprising.

drats15y ago

petercooper15y ago

And listed as a "Myth and Folklore" site. I wonder who came up with these "categories" - there are some crazy assignments in the list.

sucuri215y ago

Did you guys notice Wordpress.com and .org in there:

.com: 120,000,000 uniques

.org: 8,100,000 uniques

Impressive.

larryfreeman15y ago

Keep in mind that the numbers listed are estimations.

For example, HubPages, the site where I work, is listed at #270 with 11M unique visitors and 97M page views.

Our monthly absolute unique visitors (according to Google Analytics) is more than three times that. Our monthly page views are greater than 100M.

monos15y ago

"...as measured by Ad Planner."

jhaglund15y ago

it reassures me that foxnews.com is farther down than I would have expected.

43. http://bbc.co.uk 83. http://nytimes.com 179. http://reuters.com 257. http://foxsports.com 279. http://foxnews.com

dolinsky15y ago

Mashable - #696 Techcrunch - #850. Nice to see I'm not the only one that prefers Cashmore to Arrington.

ElbertF15y ago

Why? All Mashable does is post about Twitter trends and recycle Techcrunch posts a week later.

arst15y ago

I really doubt that usgs.gov (#978) gets anywhere near the number of visits that nfl.com gets (#993).

ojbyrne15y ago

Everytime there's an earthquake in California, half the state goes there.

1 more reply

wheaties15y ago

Wow, yahoo is up there. It's a shame they can't monetize their websites more.

ThomPete15y ago

I think their problem is that they are to big an operation. They probably could be if they trimmed the company.

zandorg15y ago

Geocities still running in Japan after being shut down in the west? Wierd!

alexyim15y ago

It's interesting how hard it is to come up with http://windows.com even though I tried explicitly searching for it

volida15y ago

where s youtube?

jcl15y ago

"Keep in mind that the list excludes adult sites, ad networks, domains that don't have publicly visible content or don't load properly, and certain Google sites."

hokkos15y ago

where is google in that list ?

bond15y ago

"Keep in mind that the list excludes adult sites, ad networks, domains that don't have publicly visible content or don't load properly, and certain Google sites." reply

retube15y ago

the daily mail at 236 aarrgghhhhh!!!!!!!

rokhayakebe15y ago

Scribd 102. Excellent. I would like to know how much financing each one of those site took to date.

ori_b15y ago

google isn't on that list?

nkassis15y ago

where is slashdot?

j / k navigate · click thread line to collapse