NamePros.com/robots.txt

[kubativity]

Can anybody tell me why the namepros robots.txt file excludes so many robot?

Should I use this as an example for my websites?

 

[HappyDay]

These are all known bad bots. Harvester etc. It`s much better to use instead the .htaccess to ban because bad bots ignore normally the robots.txt file.
To answer your question. You should ban the most bad bots from your site and there are unlimited lists available via Google, therefore you don `t need to use this robots.txt.
Also check your logs. Maybe you will find some new bad bots to ban.

 

[kathyNorms]

Don't use this this type of robots text in your website, They may be create a problem in search indexing.