Awesome Opensource Ai

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

LLM inference in C/C++

Drop in a screenshot and convert it to clean code (HTML/Tailwind/React/Vue)

The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.

A natural language interface for computers

An AI Hedge Fund Team

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

LlamaIndex is the document processing platform for AI

📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG

The Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI Protocol

open-source coding agent

TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google Research for time-series forecasting.

An autonomous agent that conducts deep research on any data using any LLM providers

Search infrastructure for AI

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

No description.

The LLM Evaluation Framework

Build reliable customer-facing AI agents with Parlant: an interaction control harness optimized for controlled, consistent, and predictable LLM interactions.

FinRL®: Financial Reinforcement Learning. 🔥

Simple, unified interface to multiple Generative AI providers

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

An elegant PyTorch deep reinforcement learning library.

Official inference library for Mistral models

Open source annotation tool for machine learning practitioners.

High-speed Large Language Model Serving for Local Deployment

PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Apache Beam is a unified programming model for Batch and Streaming data processing.

Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks

Adding guardrails to large language models.

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

The Enterprise-Grade Multi-Agent Orchestration Framework. Website: https://swarms.ai

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

lakeFS - Data version control for your data lake | Git for data

Probabilistic time series modeling in Python

AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.

A blazing fast inference solution for text embeddings models

A fast multimodal LLM for real-time voice

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

AdalFlow: The library to build & auto-optimize LLM applications.

Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters

Evaluation and Tracking for LLM Experiments and AI Agents

Build production-ready AI agents in both Python and Typescript.

llama.cpp fork with additional SOTA quants and improved performance

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

DeepTeam is a framework to red team LLMs and AI agents.

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI agents, on OTEL.