.Google's Gary Illyes shows Googlebot accumulates web links as opposed to "adhering to" all of them, opposing formal paperwork.Googlebot gathers web links as opposed to observing all of them in real-time.Gary Illyes shared this information in Google's 'Explore Off The Record' podcast.Google's information negates the true crawler habits.