This project contains a Python script to extract all unique absolute URLs from a webpage and write them into a text file. This can be useful for indexing purposes.
cli http python3 requests web-scraping retry data-extraction html-parsing argparse beautifulsoup bs4 url-extractor link-extractor url-normalization robust-error-handling single-page-scraper
-
Updated
Aug 17, 2025 - Python