Robots.txt not working

[Dr_Test]

Robots.txt not working for Googlebot?

This is odd. Look at my robots.txt [here]... And yet Googlebot is still visiting my site on a regular basis.

Is this to be expected? My file here is supposed to be telling ALL bots to scram (especially Google/MSN/Yahoo, which are supposed to obey robots.txt). MSN and Yahoo obey... Every time they come, they read this file, then leave. Googlebot doesn't even check this file most of the time. (and when it does, it's in the middle of a visit)

-

By the way, I will note that my logs show the Googlebot getting files slowly, with anywhere between a 3 second to 5 minute delay between most file grabs. Does this sound like bot activity?

This site says the IP's this bot uses are actually Google, but some of the IP's also say in red lettering "confirmed proxy"... and I can't understand why the Googlebot would disobey my robots.txt.

Any ideas?

 

[weblord]

use this below, make it specific to google bot
it's a persistent bot.

User-agent: Googlebot
Disallow: /

User-agent: Googlebot-Mobile
Disallow: /