confident-ai/deepeval
The LLM Evaluation Framework
Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool
Appears on
Quick read
Latest capture 2026-09-08 03:05
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
14 paths
Agent instructions and tool configuration found in this repository.
Agent instructions
Claude Code 8
Cursor 5
10 observed captures since 2026-05-22. Observed captures are shown by default.
Stars from first capture +52
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
The LLM Evaluation Framework
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI agents, on OTEL.
Config-driven engine that turns JSON into production-grade AI agents. Multi-agent orchestration, 12+ LLM providers, MCP/A2A protocols, RAG, persistent memory, and enterprise compliance (EU AI Act, GDPR, HIPAA). Built on Quarkus.
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI
Agent harness and tookit for building AI agents and agentic applications. CLI and SDKs included