Python is often used to crawl the internet. One of the useful application for that is finding dead links.

Theory

The basic method to check if link is dead is sending a HEAD request.

Advanced stuff requires crawling links that are alive, and skipping those that are already visited.

DeadLinks (last edited 2015-02-08 09:24:41 by techtonik)

Unable to edit the page? See the FrontPage for instructions.