Robots

[bevman]

My submission "wizard" is telling me that my site (qupe.com) doesn't have robot.txt set up. What the heck is that, and how do I do it?

 

[cybernym]

Check out http://www.robotstxt.org/ -- it'll have what you need.

 

[bevman]

thanks for the help. Great resource!

 

[webscorpion]

You can also check this

Thanks.