Does Google Have Trouble With Large Sites?

[Whogister]

I have a website that was getting about 50 visits per day from Google...
Once it hit 50,000 pages indexed in Google the traffic has hit a brick wall... nothing.
Google still adds pages from the site to their index but still no traffic.

Anyone else with 50,000 + pages ever experience this?

 

[snowbird]

In regards to power, google has no trouble indexing large sites. However, Google will only index the pages it can find on your site. It finds pages on your site through links. Once it has indexed all the pages it can find, it will slow down dramatically. This is because it only revisits pages that it feels might have changed content. When you update the content on a page, then google will revisit it.

Also if you have a site of a large size, I would also suggest looking into google's sitemaps program. This program was designed to help google find pages on large sites more easily and quickly.

 

[Whogister]

Yes, I know about getting pages indexed... as I said, I have over 50K indexed right now.
What I am wondering is why my traffic from Google has come to a screeching halt right after my indexed page count reached 50k?

 

[snowbird]

Like i said, google has no need to revisit pages unless all of those 50,000 pages have been modified or updated. Google indexes a page and normally wont visit it again unless you change the content on it. They are eliminating visits that are not needed. I also told you if you have more pages that need to be indexed besides that 50,000 it may be because google is having trouble finding all your pages. It will index what it can find but you may also need to help it with sitemaps. Which is why i mentioned you should check out the google sitemaps program. It will help it find pages on large sites more quickly and easily.

 

[Whogister]

ok

 

[enlytend]

What do you get when you do a site: query? i.e.: site:example.com where example.com is your site name. Does the page count match your site? Any hints that Google finds some of the pages redundant?

Also, look at your logs. Where was traffic coming from before? What has changed? Are there external links that are no longer producing traffic or is there a decrease in search engine traffic? Has the number of different search terms used to find your site dropped? If it's a drop in search traffic, you may still be indexed but not ranking as well for the pages you ranked for previously.

 

[Whogister]

There are currently 51,200 pages of my site indexed in google...
When I do the site:example.com thing, everything is normal.

Before when I had under 50,000 pages indexed I was getting traffic from Google searchers.
As soon as I went over the 50,000 pages indexed I am no longer getting visitors from people searching on google.

My pages are indexed but just not showing up in the search results anymore.

 

[hollywood]

I'm no expert but my understanding is that Google uses velocity of new backlinks and new content pages in their ranking algos, which is in addition to counting the sheer number of backlinks and pages. I have a feeling they guard their algos much like Coca Cola guards their secret soft drink recipe so who knows what other parameters are in there?

 

[enlytend]

What kind of pages are these? (products? articles? user generated content?) How similar are they? Is there any duplication of page titles?

I doubt it's the magic number of 50,000 - more likely they got hit with some kind of penalty. Are we talking pages that were page 1 for certain keyword(s) that slipped back to p3-4 or are we talking pages that are no longer anywhere to be seen (like a -950 penalty)? Without knowing the specifics, it's anyone's guess.

 

[dvduval]

I wanted to add that for large site, a large concentration of traffic is usually focused on 20% of the pages or less, and for that reason I usually don't get too concerned about how many pages are indexed on muy large sites.

 

[Whogister]

They are unique product pages... for a big shopping mall type site.
Nothing duplicate about it, I spent a lot of time making the site.

Oh well, looks like I got penalized for something or another...
Can't pi$$ the wrong way these days without Google zapping you for it!

 

[AbsoluteKC]

Maybe you wanto to check your Google webmaster account to see if there is any messages from Google..

 

[orangecopper]

Hello,

I have a website that is as huge as 20,000 plus pages and all are indexed fine. Try adding a more robust Sitemap and update it through Google webmaster tool.
Also if the contents are frequently edited then only google will reindex or take a look at it in most cases.

regards
Joshu

 

[w3bmaster]

Number of indexed pages and traffic have like no connexion

Do you have rankings ?

Regards

 

[audreysolo]

I have never heared it before that Google have trouble with large sites.Maybe your keywords of your website no very hot to addict people.In addition,do some seo to improve traffics.:music::music:

 

[enlytend]

They are unique product pages... for a big shopping mall type site.
Nothing duplicate about it, I spent a lot of time making the site.

Unfortunately, the time you spent making the site is inconsequential - the pages aren't showing up in searches any more, I'm trying to help you figure out why that might be.

How much content is on the pages -is there enough to outbalance the common header/footer/navigation code?
Are the product names/descriptions from a feed? If so, and if other sites may be using that feed, have you customized the descriptions, item names, etc.?
How's your internal navigation? Are the pages "buried" in your site or are they easily reachable?

You might want to do a search on some of the major SEO blogs/forums - you're certainly not the first person to have this kind of problem. Good luck with it - let us know how it turns out.

 

[shworth]

Only 50 visits a day from 50,000 pages makes it seem as though there is either something wrong with your site navigation or the content you are providing.

 

[72Reasons]

I have a website that was getting about 50 visits per day from Google...
Once it hit 50,000 pages indexed in Google the traffic has hit a brick wall... nothing.
Google still adds pages from the site to their index but still no traffic.

Anyone else with 50,000 + pages ever experience this?

Just adding content will not likely do much to drive traffic. Pages do not equate to traffic. You need to promote a few core pages so that you might start to rank well. Then you might begin to see some visitors.

 

[soggyindo]

i agree, why so many pages and work for only 50 uniques? it's easy to get that much traffic for sites with just one or two pages. it seems like a lot of work for little... or are you waiting for it to go 'viral'? if so i'd work in social networking to the mix, too

 

[Sitemapper]

I am assuming your pages are ranking poorly? Does your main domain have lots of backlinks? Else work on that through all means possible.

And then check if your DB generated pages? (product catalog) contains unique content compared to other pages on net. Else try see if you can generate SEO'ed titles and headers with some salt to content.