propublica/upton
A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)
Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
Appears on
Quick read
Latest capture 2026-10-06 03:14
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
0 paths
Agent instructions and tool configuration found in this repository.
No config files detected.
6 observed captures since 2026-06-09. Observed captures are shown by default.
Stars from first capture -3
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)
Turn any webpage into structured data using LLMs
A Rails engine supporting the discovery of web archives.
Wget-compatible web downloader and crawler.
Self-hosted webscraper.
Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head