Awesome Opensource Ai

CUDA accelerated rasterization of gaussian splatting

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

Supercharge Your Model Training

Astronomy and astrophysics core library

Local-first healthcare AI: clinical NER & HIPAA PII de-identification that runs 100% on-device. 2,200+ medical models, 21 languages, Apple MLX + Python, no cloud, no patient data leaving your network. Apache-2.0

Probabilistic time series modeling in Python

cuML - RAPIDS Machine Learning Library

A Next-Generation Training Engine Built for Ultra-Large MoE Models

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

The ultimate RAG for your monorepo. Query, understand, and edit multi-language codebases with the power of AI and knowledge graphs

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

Framework for evaluating and improving agents

Ecommerce Search and Discovery - marqo.ai

A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

On-device AI across mobile, embedded and edge for PyTorch

Time series forecasting with PyTorch

Minimal CLI coding agent by Mistral

Lightning ⚡️ fast forecasting with statistical and econometric models.

Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.

High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.

Align Anything: Training All-modality Model with Feedback

Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research

No description.

A fast inference library for running LLMs locally on modern consumer-class GPUs

A repository for storing models that have been inter-converted between various frameworks. Supported frameworks are TensorFlow, PyTorch, ONNX, OpenVINO, TFJS, TFTRT, TensorFlowLite (Float32/16/INT8), EdgeTPU, CoreML.

Reliable Multi-Agent Orchestration Framework

A fast multimodal LLM for real-time voice

A light-weight, flexible, and expressive statistical data testing library

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.

LLM training code for Databricks foundation models

Pre-trained Deep Learning models and demos (high quality and extremely fast)

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

An open source extension that connects AI agents to computational notebooks in JupyterLab.

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

Set of tools to assess and improve LLM security.

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

Optimizing inference proxy for LLMs

[AAAI 2025] EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditioning

A nearly-live implementation of OpenAI's Whisper.

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

AdalFlow: The library to build & auto-optimize LLM applications.

TorchGeo: datasets, samplers, transforms, and pre-trained models for geospatial data

Official repository for the Boltz biomolecular interaction models

🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines

A system for agentic LLM-powered data processing and ETL

Harness LLMs with Multi-Agent Programming

An open-source model family for long-form speech, dialogue synthesis, voice design, sound effects, and real-time streaming TTS

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.