Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
Awesome Web Archiving
An Awesome List for getting started with web archiving
iipc/awesome-web-archiving
#awesome
#awesome-list
#webarchiving
- List stars
- 2,664
- README repos
- 107
- Indexed repos
- 103
- List commits
- 162
- Forks
- 215
- Open issues
- 11
Tracked list growth
GitHub stars and default-branch commits for iipc/awesome-web-archiving.
Latest scan 2026-10-17 10:50
Likes history
GitHub starsCommits history
Default branch commits
Latest repo push 2026-10-15
internetarchive/heritrix3
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
- Updated
- 2026-10-14
- Lists
- 1 list mention
- First commit
- 2009-05-11
- License
- NOASSERTION
- Issues
- 34 open
3,333
stars
- Forks
- 795
- Commits
- 3,060 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
iipc/openwayback
The OpenWayback Development
- Updated
- 2024-01-03
- Lists
- 1 list mention
- First commit
- 2005-10-18
- License
- Apache-2.0
- Issues
- 105 open
531
stars
- Forks
- 317
- Commits
- 3,401 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
archivesunleashed/aut
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
- Updated
- 2026-09-17
- Lists
- 1 list mention
- First commit
- 2013-07-13
- License
- Apache-2.0
- Issues
- 5 open
157
stars
- Forks
- 33
- Commits
- 1,032 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
chatnoir-eu/chatnoir-resiliparse
A robust web archive analytics toolkit
GitHub topics
- Updated
- 2026-08-18
- Lists
- 1 list mention
- First commit
- 2021-06-04
- License
- Apache-2.0
- Issues
- 2 open
- Forks
- 21
- Commits
- 1,550 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
netarchivesuite/solrwayback
A search interface and wayback machine for the UKWA Solr based warc-indexer framework.
- Updated
- 2026-10-13
- Lists
- 1 list mention
- First commit
- 2017-02-08
- License
- Apache-2.0
- Issues
- 62 open
- Forks
- 29
- Commits
- 3,167 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
ukwa/webarchive-discovery
Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in this repo is now only for reference. For support and issues of 'warc-indexer', please communicate with NetArchiveSuite.
- Updated
- 2025-11-21
- Lists
- 1 list mention
- First commit
- 2011-10-26
- License
- Unknown
- Issues
- 93 open
- Forks
- 26
- Commits
- 1,615 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
iipc/jwarc
Java library for reading and writing WARC files with a typed API
- Updated
- 2026-09-01
- Lists
- 1 list mention
- First commit
- 2015-09-21
- License
- Apache-2.0
- Issues
- 19 open
64
stars
- Forks
- 19
- Commits
- 526 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
iipc/warc2html
Converts WARC files to static HTML
- Updated
- 2025-09-18
- Lists
- 1 list mention
- First commit
- 2021-11-08
- License
- Apache-2.0
- Issues
- 5 open
60
stars
- Forks
- 8
- Commits
- 9 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
nla/outbackcdx
Web archive index server based on RocksDB
GitHub topics
- Updated
- 2026-10-13
- Lists
- 1 list mention
- First commit
- 2015-01-15
- License
- Apache-2.0
- Issues
- 19 open
46
stars
- Forks
- 26
- Commits
- 632 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
nla/httrack2warc
Converts HTTrack crawls to WARC files
GitHub topics
- Updated
- 2024-08-06
- Lists
- 1 list mention
- First commit
- 2017-10-23
- License
- Apache-2.0
- Issues
- 2 open
39
stars
- Forks
- 6
- Commits
- 117 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
webis-de/wasp
No description.
- Updated
- 2026-06-30
- Lists
- 1 list mention
- First commit
- 2018-03-25
- License
- MIT
- Issues
- 4 open
28
stars
- Forks
- 4
- Commits
- 57 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
arcalex/warcrefs
Web archive deduplication tools
- Updated
- 2018-10-18
- Lists
- 1 list mention
- First commit
- 2014-04-22
- License
- Unknown
- Issues
- 11 open
10
stars
- Forks
- 1
- Commits
- 39 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
archivesunleashed/twut
An open-source toolkit for analyzing line-oriented JSON Twitter archives with Apache Spark.
GitHub topics
- Updated
- 2026-03-17
- Lists
- 1 list mention
- First commit
- 2019-11-29
- License
- Apache-2.0
- Issues
- 1 open
- Forks
- 2
- Commits
- 41 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
ukwa/ukwa-heritrix
The UKWA Heritrix3 custom modules and Docker builder.
Archived
- Updated
- 2024-12-02
- Lists
- 1 list mention
- First commit
- 2013-06-06
- License
- Unknown
- Issues
- 46 open
10
stars
- Forks
- 7
- Commits
- 575 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
helgeho/HadoopConcatGz
A Splitable Hadoop InputFormat for Concatenated GZIP Files and *.(w)arc.gz
GitHub topics
- Updated
- 2018-02-07
- Lists
- 1 list mention
- First commit
- 2016-08-08
- License
- Unknown
- Issues
- 1 open
- Forks
- 2
- Commits
- 55 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
netarchivesuite/jwat-tools
JWAT Tools
- Updated
- 2023-12-13
- Lists
- 1 list mention
- First commit
- 2012-02-02
- License
- Unknown
- Issues
- 3 open
- Forks
- 2
- Commits
- 141 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
netarchivesuite/jwat
Java Web Archive Toolkit
- Updated
- 2023-12-13
- Lists
- 1 list mention
- First commit
- 2011-10-04
- License
- Unknown
- Issues
- 5 open
- Forks
- 2
- Commits
- 331 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
commoncrawl/whirlwind-java
A whirlwind tour of Common Crawl's data using Java
- Updated
- 2026-04-20
- Lists
- 1 list mention
- First commit
- 2025-10-21
- License
- Apache-2.0
- Issues
- 1 open
- Forks
- 0
- Commits
- 17 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
helgeho/WarcPartitioner
Partition (W)ARC Files by MIME Type and Year
GitHub topics
- Updated
- 2017-02-13
- Lists
- 1 list mention
- First commit
- 2017-02-13
- License
- MIT
- Issues
- 0 open
- Forks
- 1
- Commits
- 2 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%