Question about Google methods.

[Ronald Regging]

My site is getting crawled by Google daily, yet it doesn't appear to be indexing anything. Is this normal? Maybe it just takes time? I'm not sure. I just changed the www.domain.com redirect to domain.com to a 301 redirect, and added an empty robots.txt, because Google was reporting a 404 for it. Not sure if this will have any effects or not. Other search engines who have crawled the site have already indexed pages, so I wasn't sure if Google worked differently.

 

[-Rasmus-]

It's called URL Canonicalization. That's fancy-talk for which url becomes the official version of your site. Otherwise you might compete against yourself in the SERPs.

Is there a difference between www and non-www and if so then which one's better?

 

[Amnezia]

Is there a difference between www and non-www and if so then which one's better?

either is fine

just make sure you redirect one to the other

 

[Ronald Regging]

I started using the Google Webmaster Tools and noticed that in the Crawl rate section it's showing Number of pages crawled per day - 1. Number kilobytes downloaded per day - 18.

Is this saying they are only crawling 1 page out of my entire site? My stats show like 418+95 hits and 4.4MB of bandwidth, so they have to be crawling more than one page...

 

[Amnezia]

I have never experimented with this redirect thing. But well will test it out and start a new thread and we all will see what are the effects on the PR for the name with www and name without www

so your an seo specailist who hasn't used redirects

ok..

 

[Keral_Patel]

Yeah. I know how to use but I don't use it.

RewriteEngine on
RewriteCond %{HTTP_HOST} ^site\.com [NC]
RewriteRule ^(.*)$ http://www.site.com/$1 [L,R=301]

Thats my way of doing SEO. I will only experiment it on one site. Bcoz the last time it was experimented. The client lost the PR which he already had.

Plus it is just a matter of time before The www. and without www. version gets PR.

Q: I noticed that you don’t do a 301 redirect on your site from the non-www to the www version, Matt. Why not? Are you stupid in the head?
A: Actually, it’s on purpose. I noticed that several months ago but decided not to change it on my end or ask anyone at Google to fix it. I may add a 301 eventually, but for now it’s a helpful test case.

Link: http://www.mattcutts.com/blog/seo-advice-url-canonicalization/

 

[Amnezia]

Yeah. I know how to use but I don't use it.

Thats my way of doing SEO. I will only experiment it on one site. Bcoz the last time it was experimented. The client lost the PR which he already had.

Plus it is just a matter of time before The www. and without www. version gets PR.

yeah but if you forward one to the other then all the links count for a single domain plus you don't get all the duplicate content issues of having the spiders being able to index both the www and non-www versions.