 | | |||||
Welcome, Guest! Ready to make a name for yourself in the domain business? We welcome both the hobbyist and professional domainer to join the discussion as part of the NamePros community.
Click here to create your profile to start earning reputation for posting, and trader ratings for buying & selling in our free e-marketplace. Build your trader rating with each successful sale. Our system has tracked over 100,000 sales and counting!
Click here to create your profile to start earning reputation for posting, and trader ratings for buying & selling in our free e-marketplace. Build your trader rating with each successful sale. Our system has tracked over 100,000 sales and counting!
| ||||||||
| Programming PHP, Perl, Ruby on Rails, AJAX, HTML, XHTML, CSS, JavaScript, MySQL and any other coding topics. |
 |
 |
| | LinkBack | Thread Tools |
05-03-2007, 08:04 AM
| THREAD STARTER #1 (permalink) |
| Senior Member Join Date: Dec 2004 Location: Burlington, Vermont
Posts: 1,048
   | Is this robots.txt not allowing bots to crawl? Found this on a site, is this preventing the bots from crawling? Code: User-Agent: OmniExplorer_Bot Disallow: / As you were. |
|
|
05-05-2007, 03:01 AM
| #2 (permalink) |
| NamePros Member  Join Date: Mar 2007 Location: Finland
Posts: 29
| Any the answer was??? Yes? It should do if the bot respects robots.txt 
__________________ Regards Jamie Let the might of your compassion arise to bring a quick end to the flowing stream of the blood and tears ..... Please hear my anguished words of truth. |
|
|
" 
