Awesome

GitHub projects from awesome lists

Search awesome repositories

Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.

Continue with GitHub Browse awesome lists Request a list

Repos indexed: 21,464
Awesome lists tracked: 149
Current results: 21

Find repositories

Start broad, then narrow by ecosystem, freshness, health, and growth.

Unsure which signals matter? Read the repository shortlisting guide.

Clear 1 refinement

Search repositories

Search mode

Keyword Semantic

Tune results

The controls most people need first.

Awesome list

Language

Freshness

Sort

Direction

More filters Topics, generated tags, stack, files, age, archive status, and growth.

Ecosystem

GitHub topic

Generated tag

Framework or stack

Package manager

Files

Has file

Choose a suggestion or use commas to require multiple files.

Health

Minimum stars

Repository age

Uses known first-commit dates.

Archive status

AI development signals

Momentum

Unmaintained for

Commit velocity

Star growth

Reset filters

21 repos shown

Topic: warc

Browse

Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

ArchiveBox/ArchiveBox

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

AI dev

Stack

Python Django pytest npm PDM pip

GitHub topics

#archivebox #backups #bookmark-archiver #browser-bookmarks #chromium #digipres

Updated: 2026-09-11
Lists: 4 list mentions
First commit: 2017-05-05
History: 46 history points
License: MIT
Issues: 159 open

28,274

stars

Forks: 1,572
Commits: 6,802 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

internetarchive/heritrix3

Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.

Stack

Java Maven pip

GitHub topics

#heritrix #java #warc #webcrawling

Updated: 2026-10-14
Lists: 1 list mention
First commit: 2009-05-11
History: 8 history points
License: NOASSERTION
Issues: 34 open

3,333

stars

Forks: 795
Commits: 3,060 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

ArchiveTeam/grab-site

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

Stack

Python pip

GitHub topics

#archiving #crawl #crawler #spider #warc

Updated: 2025-05-23
Lists: 1 list mention
First commit: 2015-02-05
History: 8 history points
License: NOASSERTION
Issues: 103 open

1,616

stars

Forks: 159
Commits: 1,174 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

webrecorder/browsertrix-crawler

Run a high-fidelity browser-based web archiving crawler in a single Docker container

Stack

TypeScript npm pip Yarn

GitHub topics

#crawler #crawling #wacz #warc #web-archiving #web-crawler

Updated: 2026-10-15
Lists: 1 list mention
First commit: 2020-10-31
History: 8 history points
License: AGPL-3.0
Issues: 146 open

1,166

stars

Forks: 152
Commits: 769 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

oduwsdl/ipwb

InterPlanetary Wayback: A distributed and persistent archive replay system using IPFS

Stack

Python Flask pytest npm pip

GitHub topics

#docker #ipfs #memento #memento-rfc #python #service-worker

Updated: 2026-07-24
Lists: 1 list mention
First commit: 2016-03-04
History: 8 history points
License: MIT
Issues: 160 open

658

stars

Forks: 41
Commits: 1,622 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

webrecorder/browsertrix

Browsertrix is the hosted, high-fidelity, browser-based crawling service from Webrecorder designed to make web archiving easier and more accessible for all!

Stack

TypeScript Express FastAPI Next.js pytest pip Pipenv uv

GitHub topics

#archiving #cloud #kubernetes #wacz #warc #web-archive

Updated: 2026-10-15
Lists: 1 list mention
First commit: 2021-06-28
History: 8 history points
License: AGPL-3.0
Issues: 331 open

484

stars

Forks: 77
Commits: 2,234 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

webrecorder/warcio

Streaming WARC/ARC library for fast web archive IO

Stack

Python Flask pytest pip

GitHub topics

#python #pywb #warc #web-archives #web-archiving

Updated: 2026-06-10
Lists: 1 list mention
First commit: 2017-03-02
History: 8 history points
License: Apache-2.0
Issues: 67 open

480

stars

Forks: 73
Commits: 161 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

Florents-Tselai/WarcDB

WarcDB: Web crawl data as SQLite databases.

Stack

Python pytest pip Poetry

GitHub topics

#cli #crawling #database #sqlite #warc #web-archiving

Updated: 2024-07-13
Lists: 1 list mention
First commit: 2022-05-29
History: 8 history points
License: Apache-2.0
Issues: 9 open

407

stars

Forks: 10
Commits: 73 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

machawk1/wail

:whale2: Web Archiving Integration Layer: One-Click User Instigated Preservation

Stack

Roff pip

GitHub topics

#gui #heritrix #openwayback #pyinstaller #python #warc

Updated: 2026-06-19
Lists: 1 list mention
First commit: 2013-03-20
History: 8 history points
License: MIT
Issues: 185 open

401

stars

Forks: 38
Commits: 871 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

helgeho/ArchiveSpark

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

Stack

Scala

GitHub topics

#archivespark #internet-archive #spark #spark-framework #warc #web-archiving

Updated: 2025-10-08
Lists: 1 list mention
First commit: 2015-08-06
History: 8 history points
License: MIT
Issues: 5 open

163

stars

Forks: 19
Commits: 154 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

chatnoir-eu/chatnoir-resiliparse

A robust web archive analytics toolkit

Stack

Rust pytest Cargo CMake .NET SDK

GitHub topics

#bigdata #extraction #htmlparser #python #rust #warc

Updated: 2026-08-18
Lists: 1 list mention
First commit: 2021-06-04
History: 8 history points
License: Apache-2.0
Issues: 2 open

152

stars

Forks: 21
Commits: 1,550 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

N0taN3rd/wail

:whale2: One-Click User Instigated Preservation

Stack

JavaScript Electron React npm Yarn

GitHub topics

#browser-based-presrevation #electron #high-fidelity-preservation #warc #web-archiving

Updated: 2019-02-03
Lists: 1 list mention
First commit: 2013-03-20
History: 7 history points
License: GPL-3.0
Issues: 34 open

128

stars

Forks: 9
Commits: 677 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

N0taN3rd/node-warc

Parse And Create Web ARChive (WARC) files with node.js

Stack

JavaScript npm Yarn

GitHub topics

#chrome-remote-interface #pupeteer #warc #warc-files #web-archives #web-archiving

Updated: 2025-01-29
Lists: 1 list mention
First commit: 2017-05-21
History: 8 history points
License: MIT
Issues: 23 open

105

stars

Forks: 22
Commits: 116 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

CGamesPlay/chronicler

Offline-first web browser

Archived

Stack

JavaScript Electron Express React npm Yarn

GitHub topics

#browser #electron #warc

Updated: 2019-01-14
Lists: 1 list mention
First commit: 2018-12-17
History: 8 history points
License: MIT
Issues: 1 open

stars

Forks: 8
Commits: 50 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

jedireza/warc

:gear: A Rust library for reading and writing WARC files

Stack

Rust Cargo

GitHub topics

#rust #rust-library #warc

Updated: 2024-11-27
Lists: 1 list mention
First commit: 2016-03-22
History: 8 history points
License: MIT
Issues: 10 open

stars

Forks: 20
Commits: 39 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

archivesunleashed/warclight

A Rails engine supporting the discovery of web archives.

Archived

Stack

Ruby Ruby on Rails Bundler npm

GitHub topics

#blacklight #discovery #rails #rails-engine #ruby #solr

Updated: 2023-06-13
Lists: 1 list mention
First commit: 2017-08-03
History: 8 history points
License: NOASSERTION
Issues: 8 open

stars

Forks: 9
Commits: 301 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

commoncrawl/whirlwind-python

A whirlwind tour of Common Crawl's data using Python

Stack

Python pip

GitHub topics

#archive #python #tutorial #warc

Updated: 2026-06-15
Lists: 1 list mention
First commit: 2024-06-23
History: 8 history points
License: Apache-2.0
Issues: 0 open

stars

Forks: 10
Commits: 41 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

PromyLOPh/crocoite

Web archiving using Google Chrome

Archived

Stack

Python pytest pip

GitHub topics

#archiving #chrome-browser #devtools #warc

Updated: 2019-12-30
Lists: 1 list mention
First commit: 2017-11-17
History: 8 history points
License: MIT
Issues: 12 open

stars

Forks: 7
Commits: 282 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

natliblux/warc-safe

A tool for detecting viruses and NSFW material in WARC files

Stack

Python Flask pip

GitHub topics

#antivirus #nsfw-classifier #warc #warc-safe #webarchiving

Updated: 2026-07-15
Lists: 1 list mention
First commit: 2024-05-03
History: 8 history points
License: GPL-3.0
Issues: 1 open

stars

Forks: 1
Commits: 35 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

helgeho/HadoopConcatGz

A Splitable Hadoop InputFormat for Concatenated GZIP Files and *.(w)arc.gz

Stack

Java Maven

GitHub topics

#hadoop #spark #warc #web-archiving #webarchive

Updated: 2018-02-07
Lists: 1 list mention
First commit: 2016-08-08
History: 8 history points
License: Unknown
Issues: 1 open

stars

Forks: 2
Commits: 55 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

helgeho/WarcPartitioner

Partition (W)ARC Files by MIME Type and Year

Stack

Java Maven

GitHub topics

#hadoop #warc #web-archiving #webarchive

Updated: 2017-02-13
Lists: 1 list mention
First commit: 2017-02-13
History: 8 history points
License: MIT
Issues: 0 open

stars

Forks: 1
Commits: 2 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

Search awesome repositories

Find repositories

Put your repository first

How it works

Pricing

How it works

Pricing