.Google's Gary Illyes discloses Googlebot picks up web links as opposed to "complying with" them, opposing main paperwork.Googlebot picks up web links rather than following them in real-time.Gary Illyes discussed this info in Google.com's 'Explore Off The File' podcast.Google's paperwork contradicts the true spider habits.