Robots.txt

[yann]

Hi,

Anyone knows the best way to setup a robots.txt file to get more traffic?

My site (an articles site) has google adsense ads on it

But google recommends that it's better not having a robots.txt file?? Any idea why?

thanks for your help

 

[Jim_]

A robots.txt file willl is used to block search engine spiders. Not really helpful to your search engine exposure. :P

A blank robots.txt is good to have because if the robot is redirected to a 404 page when it tries to read it, it might run into problems, but it shouldn't matter.

 

[StudioWorks]

You can't use robots.txt to get more traffic... you should read more about it. Something for you to read : http://www.searchtools.com/robots/robots-txt.html

SW