This is a static archive of the Python wiki, which was retired in February 2026 due to lack of usage and the resources necessary to serve it — predominately to bots, crawlers, and LLM companies.
Pages are preserved as they were at the time of archival. For current information, please visit python.org.
If a change to this archive is absolutely needed, requests can be made via the infrastructure@python.org mailing list.

Python is often used to crawl the internet. One of the useful application for that is finding dead links.

Theory

The basic method to check if link is dead is sending a HEAD request.

Advanced stuff requires crawling links that are alive, and skipping those that are already visited.

2026-02-14 16:07