GoogleBots

[jmweb]

Alrighty! I got a problem...it seems that the googlebots are constantly on one of my sites.. with constantly 30-50 bots at a time, which is fine. My problem is they aren't going to the new pages on the main site, and are usually hanging out around the forums...any tips on how to get more exposure from the bots on the rest of the site and less on the forums?

 

[death001]

site maps, google have this wonderful thing called a sitemap, you make one, tell google about it, then the bots read it and get a better understanding of how your site is

linky: http://google.com/webmasters/sitemaps/siteoverview

 

[Amnezia]

Alrighty! I got a problem...it seems that the googlebots are constantly on one of my sites.. with constantly 30-50 bots at a time, which is fine. My problem is they aren't going to the new pages on the main site, and are usually hanging out around the forums...any tips on how to get more exposure from the bots on the rest of the site and less on the forums?

google does not send 30-50 bots at once, it will be the same bot reading multiple pages

 

[rehash]

are you sure it's google bot and not some fake bot with googlebot as user agent?

 

[bentong]

perhaps you can add a sitemap.html and linked to it from the forum..

 

[TStewartFan]

Another option is to create sticky topics in your forums discussing the content and rewards they will receive from a certain page and supply the direct link in the actual post. With relevant content in the post to that on the page it should become an attractive find for the little google bot Just a thought.....not sure it will help but in theory it should and from what I have read on seo should not hurt your pr any Correct me if I am wrong someone cause I have only been reading up on seo for about 2 weeks now

 

[gold killer]

if you are using ipb you can set meta tags in the board wrappers, one of the tags you can do is
<META NAME="ROBOTS" CONTENT="INDEX, FOLLOW">

If you change INDEX, FOLLOW to something like "HOME.html, FOLLOW" then the bots should move to home.html more

 

[Amnezia]

if you are using ipb you can set meta tags in the board wrappers, one of the tags you can do is
<META NAME="ROBOTS" CONTENT="INDEX, FOLLOW">

If you change INDEX, FOLLOW to something like "HOME.html, FOLLOW" then the bots should move to home.html more

that is not a valid robot instruction

the only options are:

INDEX, FOLLOW
NOINDEX, FOLLOW
INDEX, NOFOLLOW
NOINDEX, NOFOLLOW


I would guess the problem is that your forum has session ids in the URL and the robots are getting 'stuck'

do the smart thing and create a google sitemap. this tells google exactly where to go. I would not build a website without one.