Awesome

GitHub projects from awesome lists

Search awesome repositories

Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.

Continue with GitHub Browse awesome lists Request a list

Repos indexed: 21,464
Awesome lists tracked: 149
Current results: 5

Find repositories

Start broad, then narrow by ecosystem, freshness, health, and growth.

Unsure which signals matter? Read the repository shortlisting guide.

Clear 1 refinement

Search repositories

Search mode

Keyword Semantic

Tune results

The controls most people need first.

Awesome list

Language

Freshness

Sort

Direction

More filters Topics, generated tags, stack, files, age, archive status, and growth.

Ecosystem

GitHub topic

Generated tag

Framework or stack

Package manager

Files

Has file

Choose a suggestion or use commas to require multiple files.

Health

Minimum stars

Repository age

Uses known first-commit dates.

Archive status

AI development signals

Momentum

Unmaintained for

Commit velocity

Star growth

Reset filters

5 repos shown

Topic: web-data

Browse

Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

firecrawl/firecrawl

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

AI dev

Stack

TypeScript Astro Express Next.js pytest Bundler Cargo Composer

GitHub topics

#ai #ai-agents #ai-crawler #ai-scraping #ai-search #crawler

Updated: 2026-10-17
Lists: 2 list mentions
First commit: 2024-04-15
History: 183 history points
License: AGPL-3.0
Issues: 619 open

192,247

stars

Forks: 10,155
Commits: 6,571 commits
Star growth, last 7 days: +1,995 +1.0%
Commit velocity, last 7 days: +26 +0.4%

Website GitHub

ScrapeGraphAI/Scrapegraph-ai

Python scraper based on AI

AI dev

Stack

Python LangChain uv

GitHub topics

#ai-crawler #ai-scraping #ai-search #crawler #data-extraction #firecrawl-alternative

Updated: 2026-09-07
Lists: 1 list mention
First commit: 2024-01-27
History: 42 history points
License: MIT
Issues: 16 open

30,982

stars

Forks: 3,119
Commits: 2,955 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

spider-rs/spider

Get web data for AI agents and LLMs - fast, efficient, and reliable with Rust

AI dev

Stack

Rust Axum Warp Cargo

GitHub topics

#ai-agent #automation #crawler #headless-chrome #rust #scraping

Updated: 2026-09-05
Lists: 1 list mention
First commit: 2018-01-07
History: 1 history point
License: MIT
Issues: 0 open

2,706

stars

Forks: 295
Commits: 2,293 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

brightdata/brightdata-mcp

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

Stack

JavaScript Express npm

GitHub topics

#ai-agents #ai-integrations #anti-bot-detection #browser-automation #data-collection #data-extraction

Updated: 2026-10-15
Lists: 1 list mention
First commit: 2025-04-15
History: 2 history points
License: MIT
Issues: 44 open

2,678

stars

Forks: 332
Commits: 381 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

Florents-Tselai/WarcDB

WarcDB: Web crawl data as SQLite databases.

Stack

Python pytest pip Poetry

GitHub topics

#cli #crawling #database #sqlite #warc #web-archiving

Updated: 2024-07-13
Lists: 1 list mention
First commit: 2022-05-29
History: 8 history points
License: Apache-2.0
Issues: 9 open

407

stars

Forks: 10
Commits: 73 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

Search awesome repositories

Find repositories

Put your repository first

How it works

Pricing

How it works

Pricing