Unstoppable Domains

Multiple Google crawls in one day?

Spaceship Spaceship
Watch

Ronald Regging

Ex-PresidentVIP Member
Impact
162
Has anyone experienced multiple Google crawls in one day or know if this is normal? I have an admin section on my site that allows me to see what pages users and guests are viewing in real time, along with IPs... So I see multiple connections to my site from the same IP, do a whois and see it's Googlebot. And I've noticed this at least 3 times today, possibly more.

My site isn't getting that much traffic that they should crawl it 3+ times a day. I'm not complaining, just wondering if this is normal.
 
0
•••
The views expressed on this page by users and staff are their own, not those of NamePros.
AfternicAfternic
Do you have any problems because of it?
 
0
•••
no, i was just wondering if it is normal behavior. Wasn't sure if maybe they do partial crawls multiple times a day to prevent server strain, or if they were just crawling it several times for some reason. After looking at my stats for yesterday, I'm not noticing much of a difference from the previous day, so I'm going to assume it was just several partial crawls.
 
0
•••
It all depends on the links that come in to your website and the traffic of those sites.

-Steve
 
1
•••
I would have to say this is quite normal. Googlebot generally crawls the web by following links on web pages. If site A and site B both have links to your site, then when googlebot crawls site A, it will see the link to your site and hit it. Then when it crawls site B, it will see your link again and follow it to your site for a 2nd time. To give you some idea of how often this type of thing occurs, my stats show that googlebot hit one of my sites 272 times so far this month. So this is nothing that you should be worried about.
 
1
•••
i have a website that gets hounded by google, thousands upon thousands of requests per month. It depends how many pages you have, links, all that jazz.
 
1
•••
Ok, thanks guys, I appreciate the response. I always thought they just crawled once a day, because when I look at the stats, thats the way it shows up. But I guess it combines all of their crawls together.
 
0
•••
Depends on links and frequency of content updates. Google 'click here' and you'll see there's a recency factor as the most recently crawled/update site jumps ahead of the others.
 
0
•••
garpiya said:
Do you have any problems because of it?
I thought that frequent bots' visit increase traffic significantly, which is not good, as the number of visitors doesn't grow.
 
0
•••
Appraise.net

We're social

Unstoppable Domains
Domain Recover
DomainEasy — Zero Commission
  • The sidebar remains visible by scrolling at a speed relative to the page’s height.
Back