Google Stuff

This blog is an Aggregate of the Google related blogs I read on a regular basis.




Browse by Tags

All Tags » feedback and communication » crawling and indexing (RSS)
To infinity and beyond? No!
When Googlebot crawls the web, it often finds what we call an "infinite space". These are very large numbers of links that usually provide little or no new content for Googlebot to index. If this happens on your site, crawling those URLs may...