Dynadot — .com Registration $8.99

GoogleBots

Spacemail by SpaceshipSpacemail by Spaceship
Watch

jmweb

Account Closed
Impact
16
Alrighty! I got a problem...it seems that the googlebots are constantly on one of my sites.. with constantly 30-50 bots at a time, which is fine. My problem is they aren't going to the new pages on the main site, and are usually hanging out around the forums...any tips on how to get more exposure from the bots on the rest of the site and less on the forums?
 
0
•••
The views expressed on this page by users and staff are their own, not those of NamePros.
.US domains.US domains
1
•••
jmweb said:
Alrighty! I got a problem...it seems that the googlebots are constantly on one of my sites.. with constantly 30-50 bots at a time, which is fine. My problem is they aren't going to the new pages on the main site, and are usually hanging out around the forums...any tips on how to get more exposure from the bots on the rest of the site and less on the forums?

google does not send 30-50 bots at once, it will be the same bot reading multiple pages
 
0
•••
are you sure it's google bot and not some fake bot with googlebot as user agent?
 
0
•••
perhaps you can add a sitemap.html and linked to it from the forum..
 
0
•••
Another option is to create sticky topics in your forums discussing the content and rewards they will receive from a certain page and supply the direct link in the actual post. With relevant content in the post to that on the page it should become an attractive find for the little google bot :) Just a thought.....not sure it will help but in theory it should and from what I have read on seo should not hurt your pr any :) Correct me if I am wrong someone cause I have only been reading up on seo for about 2 weeks now ;)
 
0
•••
if you are using ipb you can set meta tags in the board wrappers, one of the tags you can do is
<META NAME="ROBOTS" CONTENT="INDEX, FOLLOW">

If you change INDEX, FOLLOW to something like "HOME.html, FOLLOW" then the bots should move to home.html more
 
0
•••
gold killer said:
if you are using ipb you can set meta tags in the board wrappers, one of the tags you can do is
<META NAME="ROBOTS" CONTENT="INDEX, FOLLOW">

If you change INDEX, FOLLOW to something like "HOME.html, FOLLOW" then the bots should move to home.html more


that is not a valid robot instruction

the only options are:

INDEX, FOLLOW
NOINDEX, FOLLOW
INDEX, NOFOLLOW
NOINDEX, NOFOLLOW


I would guess the problem is that your forum has session ids in the URL and the robots are getting 'stuck'

do the smart thing and create a google sitemap. this tells google exactly where to go. I would not build a website without one.
 
0
•••
Dynadot — .com Registration $8.99Dynadot — .com Registration $8.99

We're social

Unstoppable Domains
Domain Recover
DomainEasy — Payment Flexibility
  • The sidebar remains visible by scrolling at a speed relative to the page’s height.
Back