Why so many Yahoo spiders?

[-fp-]

Hi NP members,

I run a forum and I wondered whether anyone can explain to me why there are at least 3 to 5 times as many Yahoo spiders on my forum on a daily basis in comparison to the Google spiders.

Is this normal? If so why?

Thanks.

Fabian

 

[sufi]

It's quite normal. The frequency is more because you must've gotten lots of incoming links from websites which are regularly crawled by Yahoo slurp. If you have problem with that (like bandwidth wastage), you can always block it using robots.txt file.

 

[Keral_Patel]

It is nothing to worry about. You are lucky you are getting more spider activity. It is only a problem when you don't have spiders.

Plus I have always seen Yahoo spiders just comes in bulk :D

 

[-fp-]

True Nick. They really are coming in massive amounts sometimes! :hehe:

Which is good of course.

Thanks for the heads up guys!

Fabian :tu:

 

[paaaaaaaaaa]

It is nothing to worry about. You are lucky you are getting more spider activity. It is only a problem when you don't have spiders....

Yep you get a fly infestation.

Seriously though, maybe we going to see some changes for the better with yahoo search.

 

[zachary0611]

Im sure yahoo is trying to update quicker and find more websites to compete with google