Awesome

GitHub projects from awesome lists

Search awesome repositories

Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.

Continue with GitHub Browse awesome lists Request a list

Repos indexed: 20,779
Awesome lists tracked: 146
Current results: 9

Find repositories

Start broad, then narrow by ecosystem, freshness, health, and growth.

Unsure which signals matter? Read the repository shortlisting guide.

Clear 1 refinement

Search repositories

Search mode

Keyword Semantic

Tune results

The controls most people need first.

Awesome list

Language

Freshness

Sort

Direction

More filters Topics, generated tags, stack, files, age, archive status, and growth.

Ecosystem

GitHub topic

Generated tag

Framework or stack

Package manager

Files

Has file

Choose a suggestion or use commas to require multiple files.

Health

Minimum stars

Repository age

Uses known first-commit dates.

Archive status

AI development signals

Momentum

Unmaintained for

Commit velocity

Star growth

Reset filters

9 repos shown

Topic: webscraping

Browse

Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

firecrawl/firecrawl

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

AI dev

Stack

TypeScript Astro Express Next.js pytest Bundler Cargo Composer

GitHub topics

#ai #ai-agents #ai-crawler #ai-scraping #ai-search #crawler

Updated: 2026-10-13
Lists: 2 list mentions
First commit: 2024-04-15
History: 179 history points
License: AGPL-3.0
Issues: 575 open

191,274

stars

Forks: 10,146
Commits: 6,558 commits
Star growth, last 7 days: +1,724 +0.9%
Commit velocity, last 7 days: +33 +0.5%

Website GitHub

D4Vinci/Scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

Stack

Python pytest Scrapy PEP 517 pip

GitHub topics

#ai #ai-scraping #automation #crawler #crawling #crawling-python

Updated: 2026-10-08
Lists: 1 list mention
First commit: 2024-10-13
History: 62 history points
License: BSD-3-Clause
Issues: 14 open

86,561

stars

Forks: 8,868
Commits: 1,632 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

huginn/huginn

Create agents that monitor and act on your behalf. Your agents are standing by!

Stack

Ruby Ruby on Rails Svelte Bundler npm

GitHub topics

#agent #automation #feed #feedgenerator #huginn #monitoring

Updated: 2026-09-26
Lists: 3 list mentions
First commit: 2013-03-10
History: 9 history points
License: MIT
Issues: 699 open

50,019

stars

Forks: 4,302
Commits: 4,208 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

GitHub

ScrapeGraphAI/Scrapegraph-ai

Python scraper based on AI

AI dev

Stack

Python LangChain uv

GitHub topics

#ai-crawler #ai-scraping #ai-search #crawler #data-extraction #firecrawl-alternative

Updated: 2026-09-07
Lists: 1 list mention
First commit: 2024-01-27
History: 42 history points
License: MIT
Issues: 16 open

30,982

stars

Forks: 3,119
Commits: 2,955 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

assafelovic/gpt-researcher

An autonomous agent that conducts deep research on any data using any LLM providers

AI dev

Stack

Python Express FastAPI LangChain Next.js npm pip Poetry

GitHub topics

#agent #ai #automation #deepresearch #llms #mcp

Updated: 2026-10-10
Lists: 6 list mentions
First commit: 2023-05-12
History: 175 history points
License: Apache-2.0
Issues: 34 open

30,080

stars

Forks: 4,107
Commits: 3,219 commits
Star growth, last 7 days: +137 +0.5%
Commit velocity, last 7 days: +8 +0.2%

Website GitHub

jaypyles/Scraperr

Self-hosted webscraper.

Archived

Stack

TypeScript FastAPI Next.js pytest React npm PDM Yarn

GitHub topics

#docker #helm #kubernetes #opensource #playwright #python

Updated: 2025-10-12
Lists: 0 list mentions
First commit: 2024-05-18
History: 62 history points
License: MIT
Issues: 4 open

4,911

stars

Forks: 251
Commits: 243 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

itsOwen/CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

Stack

Python LangChain Streamlit pip

GitHub topics

#ai-scraping #gemini-api #llm #llm-scraper #openai #scraper

Updated: 2026-08-20
Lists: 1 list mention
First commit: 2024-08-17
History: 1 history point
License: MIT
Issues: 3 open

3,252

stars

Forks: 356
Commits: 107 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

GitHub

jamesturk/scrapeghost

👻 Experimental library for scraping websites using OpenAI's GPT API.

Stack

Python pytest Poetry

GitHub topics

#gpt #openai-api #webscraping

Updated: 2026-01-14
Lists: 1 list mention
First commit: 2023-03-18
History: 40 history points
License: NOASSERTION
Issues: Disabled

1,443

stars

Forks: 86
Commits: 204 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

openzim/zimit

Make a ZIM file from any Web site and surf offline!

Stack

Python pytest PEP 517

GitHub topics

#docker #scraper #webscraping #zim

Updated: 2026-07-31
Lists: 1 list mention
First commit: 2016-01-09
History: 7 history points
License: GPL-3.0
Issues: 90 open

844

stars

Forks: 50
Commits: 518 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

GitHub

Search awesome repositories

Find repositories

Put your repository first

How it works

Pricing

How it works

Pricing