Google posted a new blog post named Inside Googlebot: demystifying crawling, fetching, and the bytes we process alongside episode 105 of the Search Off the Record segment named Google crawlers behind the scenes.
In the article, Gary Illyes from Google explains:
(1) Googlebot isn't a single program
(2) Covers the 2MB limit.
(3) The Rendering the bytes
(4) Best practices for your bytes
Here is the podcast as well:
It is worth reviewing these, if you do SEO.
Forum discussion at LinkedIn.
Image credit Lizzi Sassman
