Awesome Agent Harness

AIOS: AI Agent Operating System

AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

Nexent is a zero-code platform for auto-generating production-grade AI agents using Harness Engineering principles — unified tools, skills, memory, and orchestration with built-in constraints, feedback loops, and control planes.

The CLI and skills that turn any coding assistant into an expert at creating, evaluating, and deploying AI agents on Google Cloud.

Framework for evaluating and improving agents

Agenta is a workspace where you and your team build agents and automations.

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

Enterprise AI Platform with guardrails, MCP registry, gateway & orchestrator

Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop.

Open-source security automation platform for teams and AI agents

agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes and reinforcement learning (RL).

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

Agent Skills as a Memory Layer

Evaluation and Tracking for LLM Experiments and AI Agents

The platform for LLM evaluations and AI agent testing

Devon: An open-source pair programmer

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

Amazon Bedrock Agentcore accelerates AI agents into production with the scale, reliability, and security, critical to real-world deployment.

The NVIDIA NeMo Agent toolkit is an open-source library for efficiently connecting and optimizing teams of AI agents.

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.

A production-oriented multi-agent orchestration framework.

Terminal coding agent powered by Kimchi's multi-model orchestration

τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

LLM powered fuzzing via OSS-Fuzz.

1 place to call all your agents - OpenCode, Hermes, Claude Managed Agents, Cursor Agents API, DeepAgents.

OpenTelemetry Instrumentation for AI Observability

Evaluate and improve models and agents using environments

The Cloud Sandbox Built for AI Agents

The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.

Open-source benchmark for browser AI agents on daily tasks.

ClawKeeper: Comprehensive Safety Protection for OpenClaw Agents Through Skills, Plugins, and Watchers (aka The Norton for OpenClaw)

CUGA is an open-source generalist agent harness for the enterprise, supporting complex task execution on web and APIs, OpenAPI/MCP integrations, composable architecture, reasoning modes, and policy-aware features.

No description.

Security Governance for Agentic AI

A production-ready runtime framework for agent apps with secure tool sandboxing, Agent-as-a-Service APIs, scalable deployment, full-stack observability, and broad framework compatibility.

An agent benchmark with tasks in a simulated software company.

Claw-Eval is an evaluation harness for evaluating LLM as agents. All tasks verified by humans.

Measuring and evolving with the frontier of agent work

Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.

The action firewall for AI agents. Enforce policy and human approval before risky tool calls, shell commands, workflows, and production changes, with auditable evidence.

Deterministic safety solutions for probabilistic AI agents

The production-ready agent harness framework for Python

Open Python agent harness for production AI apps: tools, MCP, memory, workspace, telemetry, subagents, background tasks, and OmniServe APIs.

Evaluation harness for OpenHands V1.

No description.