Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
Awesome Data Engineering
A curated list of data engineering tools for software developers
igorbarinov/awesome-data-engineering
#awesome
#awesome-list
- List stars
- 9,173
- README repos
- 148
- Indexed repos
- 142
- List commits
- 438
- Forks
- 1,651
- Open issues
- 49
Tracked list growth
GitHub stars and default-branch commits for igorbarinov/awesome-data-engineering.
Latest scan 2026-10-17 10:49
Likes history
GitHub starsCommits history
Default branch commits
Latest repo push 2026-10-17
alibaba/zvec
A lightweight, lightning-fast, in-process vector database
GitHub topics
- Updated
- 2026-10-16
- Lists
- 4 list mentions
- First commit
- 2025-12-30
- License
- Apache-2.0
- Issues
- 86 open
16,115
stars
- Forks
- 1,013
- Commits
- 448 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
cocoindex-io/cocoindex
Incremental engine for long horizon agents 🌟 Star if you like it!
AI dev
- Updated
- 2026-10-16
- Lists
- 3 list mentions
- First commit
- 2025-03-03
- License
- Apache-2.0
- Issues
- 103 open
11,710
stars
- Forks
- 919
- Commits
- 2,168 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
xberg-io/xberg
Polyglot document intelligence with a Rust core: extract text, metadata, images, tables, and structured data from 106 formats across 140 file extensions, plus code intelligence for 371 languages. Fifteen bindings, with CLI, REST API, and MCP server.
AI dev
- Updated
- 2026-10-16
- Lists
- 3 list mentions
- First commit
- 2025-01-31
- License
- MIT
- Issues
- 14 open
9,422
stars
- Forks
- 594
- Commits
- 10,366 commits
- Star growth, last 7 days
- +22 +0.2%
- Commit velocity, last 7 days
- +108 +1.1%
kreuzberg-dev/kreuzberg
A polyglot document intelligence framework with a Rust core. Extract text, metadata, images, and structured information from PDFs, Office documents, images, and 97+ formats. Available for Rust, Python, Ruby, Java, Go, PHP, Elixir, C#, R, C, TypeScript (Node/Bun/Wasm/Deno)- or use via CLI, REST API, or MCP server.
- Updated
- 2026-06-23
- Lists
- 3 list mentions
- First commit
- 2025-01-31
- License
- NOASSERTION
- Issues
- 13 open
8,536
stars
- Forks
- 502
- Commits
- 6,280 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
apache/hamilton
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
GitHub topics
- Updated
- 2026-10-14
- Lists
- 3 list mentions
- First commit
- 2019-07-25
- License
- Apache-2.0
- Issues
- 178 open
2,610
stars
- Forks
- 221
- Commits
- 2,116 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
NameetP/pdfmux
PDF extraction that audits its own output — and certifies any other extractor's, catching pages they silently dropped. Verify signed manifests offline: free, MIT, no account. 0.903 on opendataloader-bench, #2 of 8 engines. 7-tool MCP server.
AI dev
GitHub topics
- Updated
- 2026-10-16
- Lists
- 2 list mentions
- First commit
- 2026-03-03
- License
- MIT
- Issues
- 3 open
83
stars
- Forks
- 14
- Commits
- 166 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
whispering3/CARQ
Pipeline de ingestão e busca semântica de documentos para RAG — com rate limiting, circuit breaker e fila resiliente.
- Updated
- 2026-06-04
- Lists
- 1 list mention
- First commit
- 2026-05-11
- License
- MIT
- Issues
- 0 open
2
stars
- Forks
- 0
- Commits
- 9 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%