Stupid search bot

[Amnezia]

i have seen some fairly stupid search bots in my time but i thought this new one today was probably the most supid yet..

all it has done so far is hit my robots.txt over an over again for a few hours, there is nothing disallowing it from spidering my site but it appears only to want to read the robots.txt again and again and again.. :hehe:

see highlighted awstats

so if you happen to be building your own search bot please make sure you test it fully before releasing it into the wild :yell:

 

[bentong]

unknown robots are just normal. you can't avoid them though you specify it on your robots.txt file, IMO..

 

[Amnezia]

unknown robots are just normal. you can't avoid them though you specify it on your robots.txt file, IMO..

half the robots that come spidering my pages dont even bother to look for robots.txt, i just thought this one was strange because all it did was read the robots.txt repeatedly.

 

[robertjr]

Some bodies knocking should I let him in,

Lord it's the Devil would you look at him...


For those of you under 30, just skip this post. For those over 30, "right click" and select all.

SOMEBODY'S KNOCKIN'
Terri Gibbs

Somebody's knockin', should I let him in
Lord, it's the Devil, would you look at him
I've heard about him, but I never dreamed
He'd have blue eyes and blue jeans

Well, somebody's talkin', he's whisperin' to me
Your place or my place, well, which will it be
I'm gettin' weaker and he's comin' on strong
But I don't wanna go wrong

He must have tapped my telephone line
He must have known I was spendin' my time alone
He says we'll have one heavenly night
My fever's burnin', so he oughta be right at home

Somebody's knockin', should I let him in
Lord, it's the Devil, would you look at him
I've heard about him, but I never dreamed
He'd have blue eyes and blue jeans

Uh-huh, he must have tapped my telephone line
He must have known I was spendin' my time alone
He says we'll have one heavenly night
My fever's burnin', so he oughta be right at home

(Somebody'd knockin')
Somebody's knockin'
Somebody's knockin'
Uh, Somebody's knockin'
Well, somebody's knockin'
Somebody's knockin'......FADE

#8 Country hit in late 1980, and a #13 Pop hit in early 1981.