Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
A curated list of data engineering tools for software developers
GitHub stars and default-branch commits for igorbarinov/awesome-data-engineering.
Open highlighted repo slot
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Intent as Code | the workflow language for AI. One file, 4 verbs, one Rust binary. Local-first, any model, AGPL-3.0. 🦋
Reverse ETL for the code-first data stack
The fast, config-driven way to move data in Rust — a native CLI and an embeddable Rust ETL library
One interface for your whole data stack, with built-in safeguards and a simpler workflow for your team. Written in Rust. Docker not needed.
A detective for your data. Zero-config data quality monitoring — works with dbt, Postgres, BigQuery, Snowflake. No YAML.
Cold storage that queries like hot storage. High-ratio JSONL compressor with block-level random access. Query cold storage in seconds — no restore, no full decompression. 5–13% ratio on JSONL logs, 25–57% smaller than gzip. 1-hour window via DuckDB in under 6s. Free for personal and open-source use.
Data ingestion engine — Singer taps to Parquet in cloud buckets
Enrich any CSV with company data (revenue, employees, credit score) from 250M+ companies. Free ZoomInfo/Clearbit alternative. Zero dependencies.