Awesome Harness Engineering

The open-source agent harness - the runtime layer that turns an LLM into a working agent.

Zep | Examples, Integrations, & More

agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes and reinforcement learning (RL).

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

Amazon Bedrock Agentcore accelerates AI agents into production with the scale, reliability, and security, critical to real-world deployment.

Squad: AI agent teams for any project

Agent harness to make your slop code well-engineered and beautiful.

Skills, MCP servers, Custom Agents, Agents.md for SDKs to ground Coding Agents

Inspect: A framework for large language model evaluations

Official, AWS-supported MCP servers, skills, and plugins to help AI agents build on AWS

One brain, many harnesses. Portable .agent/ folder (memory + skills + protocols) that plugs into Claude Code, Cursor, Windsurf, OpenCode, OpenClaw, Hermes, or DIY Python — and keeps its knowledge when you switch.

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

No description.

Code and Data for Tau-Bench

Build, Evaluate, and Deploy GUI Agents — online RL training, standardized benchmarks, and real-device deployment in one framework.

The open‑source AI Agents Governance & Orchestration framework: write the rules declaratively, Bernstein enforces them and produces the verifiable, replayable record. Free, Apache-2.0. https://bernstein.run

Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.

A production-ready runtime framework for agent apps with secure tool sandboxing, Agent-as-a-Service APIs, scalable deployment, full-stack observability, and broad framework compatibility.

Claw-Eval is an evaluation harness for evaluating LLM as agents. All tasks verified by humans.

Bring your own agent and build a self-improving agentic system. Automatically mine failures, optimize the agent harness, and gate against regressions.

Browser Use Box: a 24/7 Claude Code agent for Playwright-style browser automation with Browser Use Cloud, Telegram, and a real browser on any box you own.

Demonstration of an agent harness with access to tools like Slack, GitHub, and Linear so it can act as your own complete software engineer.

Automated harness evolution for AI agents. A Claude Code plugin that iteratively optimizes system prompts, routing, retrieval, and orchestration code using full-trace counterfactual diagnosis. Based on Meta-Harness (Lee et al., 2026).

swebench repro script for running confucius-code-agent (CCA)

Open HTTP protocol for human decisions in AI agent workflows. Service-hosted reviews, structured approvals, selections and forms, with optional messenger actions.

No description.