Pyx-Corp/spectrawl
The unified web layer for AI agents. Search (8 engines), stealth browse, auth, and act on 24 platforms. One npm install, self-hosted.
🍨 High-fidelity, browser-based, single-page web archiving library and CLI for witnessing the web.
Appears on
Quick read
Latest capture 2026-10-16 03:20
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
0 paths
Agent instructions and tool configuration found in this repository.
No config files detected.
8 observed captures since 2026-05-23. Observed captures are shown by default.
Stars from first capture +16
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
The unified web layer for AI agents. Search (8 engines), stealth browse, auth, and act on 24 platforms. One npm install, self-hosted.
Fast Python web crawler for RAG and AI ingestion. Extracts clean Markdown from any site for LLMs and vector stores.
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
The headless browser for AI agents and web scraping
The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head