Who's been spidering my sites

[GILSAN]

In the last few days all my WhyPark sites have been spidered I think. Here is an example of recent visitor activity from "StatCounter". Would this be Google,Yahoo or MSN spiders? I recently submited all sites to Yahoo and MSN

As you can see it's coming from Israel. All sites have the same IP Address Does anyone know?


Returning Visits: 0
Location: Ramat Gan Tel Aviv Israel
Hostname: 64.210.196.197 [Label IP Address]
Entry Page: "www.mysite.com"
Referring URL: No referring link

Thanks GIL

 

[Varon]

Although, the backlinks and subsequent PR updates are due any day now, this doesn't seem to be the Google spider. Seems more like direct type-ins from some visitors.

 

[GILSAN]

Although, the backlinks and subsequent PR updates are due any day now, this doesn't seem to be the Google spider. Seems more like direct type-ins from some visitors.

I have 51 sites at WhyPark and all of them received this exact same visitor from Israel. That's quite a coincidence.

The month of July Google spiders where from somewhere in California which subsequently changed in August to:
Chicago Illinois United States
crawl-66-249-66-138.googlebot.com (66.249.66.138) [Label IP Address]

I'm still puzzled by this visitor! I have a sneaking suspicion that it's Google. Someone correct me if I'm wrong!

GIL

 

[lpstong]

It has been known that many ppl have a bot script. You would usually know if it is Google, Yahoo et cetera. It would say Google Bot, Yahoo Slurp, MSN Bot. Even from Yahoo China Slurp. And yes you will be immediately botted/spidered after submitting your sites to SE's. Some will do it in less than 15 minutes of submitting to SE's.

And to bad you can not control the robot.txt to your parked pages. So when the bots/spiders come through, you can tell them what parts of your site can not be scanned.

 

[domainpark]

Hi Gil

Potentially its from another SE site not google.

There are others even the smaller ones who do the scans of sites.

If I am not mistaken all of the google IP's are always from the USA

 

[nu-money]

It's Girafa.com

http://64.210.196.197/ (Girafa.com)

 

[Badger]

At 1plus we catch and ban bots everyday.. Youd be amazed how many report to be "googlebots" when clearly theyre not.. Currently we have thousands of naughty bots that choose not to obey the robots.txt file in our banned IP list.