Decoder with Nilay Patel
How the Wayback Machine is fighting linkrot
Mark Graham
It's a combination of applications that do what's referred to as crawling, which is a process of looking at a URL, looking at a webpage, and then looking at all of the other links, all of the other URLs on that page, and then going to them and then looking at them and then going on and on and on, crawling the web like a spider, metaphorically.
0
💬
0
Comments
Log in to comment.
There are no comments yet.