Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome
GitHub projects from awesome lists
Search awesome repositories
Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.
- Repos indexed
- 21,464
- Awesome lists tracked
- 149
- Current results
- 14
14 repos shown
firecrawl/firecrawl
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
AI dev
GitHub topics
- Updated
- 2026-10-17
- Lists
- 2 list mentions
- First commit
- 2024-04-15
- History
- 183 history points
- License
- AGPL-3.0
- Issues
- 619 open
192,247
stars
- Forks
- 10,155
- Commits
- 6,571 commits
- Star growth, last 7 days
- +1,995 +1.0%
- Commit velocity, last 7 days
- +26 +0.4%
unclecode/crawl4ai
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
AI dev
GitHub topics
- Updated
- 2026-10-15
- Lists
- 3 list mentions
- First commit
- 2024-05-09
- History
- 174 history points
- License
- Apache-2.0
- Issues
- 261 open
85,680
stars
- Forks
- 8,905
- Commits
- 1,778 commits
- Star growth, last 7 days
- +511 +0.6%
- Commit velocity, last 7 days
- +68 +4.0%
ScrapeGraphAI/Scrapegraph-ai
Python scraper based on AI
AI dev
- Updated
- 2026-09-07
- Lists
- 1 list mention
- First commit
- 2024-01-27
- History
- 42 history points
- License
- MIT
- Issues
- 16 open
30,982
stars
- Forks
- 3,119
- Commits
- 2,955 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
AI dev
GitHub topics
- Updated
- 2026-10-16
- Lists
- 1 list mention
- First commit
- 2016-08-26
- History
- 2 history points
- License
- Apache-2.0
- Issues
- 152 open
26,174
stars
- Forks
- 1,710
- Commits
- 5,789 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
AI dev
GitHub topics
- Updated
- 2026-09-10
- Lists
- 2 list mentions
- First commit
- 2024-01-10
- History
- 43 history points
- License
- Apache-2.0
- Issues
- 96 open
9,508
stars
- Forks
- 805
- Commits
- 1,836 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
adithya-s-k/omniparse
Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks
GitHub topics
- Updated
- 2025-12-12
- Lists
- 1 list mention
- First commit
- 2024-06-04
- History
- 7 history points
- License
- GPL-3.0
- Issues
- 75 open
7,825
stars
- Forks
- 667
- Commits
- 122 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
firecrawl/firecrawl-mcp-server
🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.
Stack
- Updated
- 2026-10-17
- Lists
- 2 list mentions
- First commit
- 2024-12-06
- History
- 10 history points
- License
- MIT
- Issues
- 171 open
7,618
stars
- Forks
- 917
- Commits
- 734 commits
- Star growth, last 7 days
- +37 +0.5%
- Commit velocity, last 7 days
- +12 +1.7%
spider-rs/spider
Get web data for AI agents and LLMs - fast, efficient, and reliable with Rust
AI dev
GitHub topics
- Updated
- 2026-09-05
- Lists
- 1 list mention
- First commit
- 2018-01-07
- History
- 1 history point
- License
- MIT
- Issues
- 0 open
2,706
stars
- Forks
- 295
- Commits
- 2,293 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
0xMassi/webclaw
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
AI dev
- Updated
- 2026-10-15
- Lists
- 2 list mentions
- First commit
- 2026-03-23
- History
- 11 history points
- License
- AGPL-3.0
- Issues
- 4 open
2,380
stars
- Forks
- 239
- Commits
- 352 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
MarginaliaSearch/MarginaliaSearch
Internet search engine for text-oriented websites. Indexing the small, old and weird web.
GitHub topics
- Updated
- 2026-09-23
- Lists
- 0 list mentions
- First commit
- 2022-05-19
- History
- 44 history points
- License
- NOASSERTION
- Issues
- 30 open
- Forks
- 64
- Commits
- 4,430 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
webrecorder/browsertrix-crawler
Run a high-fidelity browser-based web archiving crawler in a single Docker container
Stack
GitHub topics
- Updated
- 2026-10-15
- Lists
- 1 list mention
- First commit
- 2020-10-31
- History
- 8 history points
- License
- AGPL-3.0
- Issues
- 146 open
1,166
stars
- Forks
- 152
- Commits
- 769 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
postmodern/spidr
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
- Updated
- 2026-01-12
- Lists
- 1 list mention
- First commit
- 2008-05-19
- History
- 6 history points
- License
- MIT
- Issues
- 16 open
836
stars
- Forks
- 105
- Commits
- 898 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
graphlit/graphlit-mcp-server
Model Context Protocol (MCP) Server for Graphlit Platform
Stack
- Updated
- 2026-01-12
- Lists
- 1 list mention
- First commit
- 2025-03-01
- History
- 8 history points
- License
- MIT
- Issues
- 6 open
- Forks
- 55
- Commits
- 261 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
s0rg/crawley
The unix-way web crawler
Stack
- Updated
- 2026-09-11
- Lists
- 2 list mentions
- First commit
- 2021-10-27
- History
- 8 history points
- License
- MIT
- Issues
- 8 open
339
stars
- Forks
- 18
- Commits
- 158 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history