any4ai/AnyCrawl
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
Python scraper based on AI
Appears on
Quick read
Latest capture 2026-09-15 09:26
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
1 path
Agent instructions and tool configuration found in this repository.
Agent instructions
42 observed captures since 2026-06-02. Observed captures are shown by default.
Stars from first capture +4368
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
An autonomous agent that conducts deep research on any data using any LLM providers
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
📊 llm.report is an open-source logging and analytics platform for OpenAI: Log your ChatGPT API requests, analyze costs, and improve your prompts.
Use any LLMs (Large Language Models) for Deep Research. Support SSE API and MCP server.