These crawls are part of an effort to archive pages as they are created and archive the pages that they refer to. That way, as the pages that are referenced are changed or taken from the web, a link to the version that was live when the page was written will be preserved.
Then the Internet Archive hopes that references to these archived pages will be put in place of a link that would be otherwise be broken, or a companion link to allow people to see what was originally intended by a page's authors.
This is a collection of web page captures from links added to, or changed on, Wikipedia pages. The idea is to bring a reliability to Wikipedia outlinks so that if the pages referenced by Wikipedia articles are changed, or go away, a reader can permanently find what was originally referred to.
Who wouldn’t want a memento of one of Bauhaus’s better shows from 1998’s Resurrection tour. Thankfully, they chose New York and not the piss poor Toronto outing. Gotham finds the band still infatuated with each other, the music, makeup, frilly clothes and goth attire that would wane before they reached Toronto. With their mystique completely ruined, the band have nothing left to offer but a package of songs that haven’t reached their “sell by” date yet. Some will never age, such as “Bela Legosi’s Dead,” “In the Flat Field” and “Kick in the Eye.” They will never offer anything better, even the studio cover of Dead Can Dance’s “Severance” can’t measure up to “Ziggy Stardust” or “Telegram Sam.” Hopefully, this will help fill their retirement chest so they don’t get desperate enough to actually put out a new studio album. (Metropolis)