Sign in
← All awesome lists Search these repos

Awesome List

Awesome Opensource Ai

Curated list of the best truly open-source AI projects, models, tools, and infrastructure. Daily updated.

alvinreal/awesome-opensource-ai #agents #ai #artificial-intelligence #awesome #awesome-list #generative-ai #llm #machine-learning #mlops #open-source #open-source-ai #rag
Open GitHub
List stars
4,893
README repos
1,095
Indexed repos
962
List commits
654
Forks
721
Open issues
25

Tracked list growth

GitHub stars and default-branch commits for alvinreal/awesome-opensource-ai.

Latest scan 2026-10-17 10:50

Likes history

GitHub stars

Commits history

Default branch commits

Indexed repositories

9 repos matching these filters.

Topic: data-pipelines
Latest repo push 2026-10-17

Filter this list

Search within Awesome Opensource Ai or narrow by ecosystem and project health.

Clear 1 refinement
Search mode
Tune results
More filters Topics, generated tags, stack, files, age, archive status, and growth.
Ecosystem
Files

Choose a suggestion or use commas to require multiple files.

Health

Uses known first-commit dates.

Momentum
Filters by observed commit-count growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Filters by observed GitHub star growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Reset filters
Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

pathwaycom/pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Stack
Python Axum FastAPI LangChain pytest Cargo npm PEP 517
GitHub topics
#batch-processing #data-analytics #data-pipelines #data-processing #dataflow #etl
Updated
2026-10-16
Lists
5 list mentions
First commit
2023-07-21
License
NOASSERTION
Issues
37 open
Sign in to like pathwaycom/pathway
62,113
stars
Forks
1,683
Commits
2,312 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
Website GitHub
apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

AI dev
Stack
Python Celery Cobra FastAPI Flask Go modules Gradle npm
GitHub topics
#airflow #apache #apache-airflow #automation #dag #data-engineering
Updated
2026-10-17
Lists
7 list mentions
First commit
2014-10-06
License
Apache-2.0
Issues
1,932 open
Sign in to like apache/airflow
47,194
stars
Forks
18,051
Commits
42,128 commits
Star growth, last 7 days
+49 +0.1%
Commit velocity, last 7 days
+168 +0.4%
Website GitHub
dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

AI dev
Stack
Python FastAPI Flask LangChain Next.js npm PEP 517 pip
GitHub topics
#analytics #dagster #data-engineering #data-integration #data-orchestrator #data-pipelines
Updated
2026-10-12
Lists
5 list mentions
First commit
2018-04-30
License
Apache-2.0
Issues
2,590 open
Sign in to like dagster-io/dagster
16,282
stars
Forks
2,354
Commits
28,117 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
Website GitHub
Unstructured-IO/unstructured

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.

Stack
HTML pytest pip uv
GitHub topics
#data-pipelines #deep-learning #document-image-analysis #document-image-processing #document-parser #document-parsing
Updated
2026-09-10
Lists
2 list mentions
First commit
2022-06-29
License
Apache-2.0
Issues
306 open
Sign in to like Unstructured-IO/unstructured
15,412
stars
Forks
1,323
Commits
1,928 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
kedro-org/kedro

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

AI dev
Stack
Python FastAPI Jupyter pytest PEP 517 pip
GitHub topics
#agentic-ai #agentic-workflow #data-pipelines #hacktoberfest #kedro #machine-learning
Updated
2026-09-09
Lists
1 list mention
First commit
2019-05-16
License
NOASSERTION
Issues
138 open
Sign in to like kedro-org/kedro
10,989
stars
Forks
1,074
Commits
4,399 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
mage-ai/mage-ai

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Stack
Python LangChain Next.js pytest React npm PEP 517 pip
GitHub topics
#artificial-intelligence #data #data-engineering #data-integration #data-pipelines #data-science
Updated
2026-09-10
Lists
1 list mention
First commit
2022-05-16
License
Apache-2.0
Issues
624 open
Sign in to like mage-ai/mage-ai
8,821
stars
Forks
990
Commits
5,790 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
OpenDCAI/DataFlow

[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

Stack
Python FastAPI Flask Gradio pytest PEP 517 pip
GitHub topics
#data #data-agent #data-cleaning #data-pipelines #data-processing #data-science
Updated
2026-10-13
Lists
3 list mentions
First commit
2024-10-13
License
Apache-2.0
Issues
24 open
Sign in to like OpenDCAI/DataFlow
8,209
stars
Forks
1,196
Commits
1,209 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
Website GitHub