Awesome Testing

The Big List of Naughty Strings is a list of strings which have a high probability of causing issues when used as user-input data.

open source test management system with over 2 million downloads!

Hercules is the world’s first open-source testing agent, enabling UI, API, Security, Accessibility, and Visual validations – all without code or maintenance. Automate testing effortlessly and let Hercules handle the heavy lifting! ⚡

Open-source autonomous AI penetration testing. 50 specialist agents across web, API, cloud, Active Directory, Kubernetes, CI/CD and AI/LLM (OWASP LLM Top 10). Runs on a local LLM behind a Privacy Gateway. Integrates with GitHub, GitLab, Jenkins, VS Code, JetBrains, n8n, Grafana & Splunk.

Hardware testing for the software world. Real or virtual, local or remote, human, automated or agentic.

Discover, mask, and verify sensitive data in SQL databases — an auditable scan → mask → validate workflow for safe database copies.

Model-driven synthetic test data for CI/CD and analytics - deterministic, privacy-preserving, and domain-aware. Includes Python APIs, XML pipelines, and MCP/IDE integration to orchestrate realistic datasets for finance, healthcare, and other regulated environments.

Optics Framework is a powerful, extensible no code test automation framework designed for vision powered, data-driven testing and production app synthetic monitoring.

Test harness for voice agents. Import from Retell, VAPI, Bland, LiveKit. Run autonomous simulations. Evaluate with LLM judges.

AI-Drived end-to-end test platform

Enterprise-grade platform to generate and execute Cypress, Playwright, WebdriverIO, and Appium end-to-end tests from natural language requirements. (Appium is experimental and requires external mobile infrastructure.)

Convert Postman Collection v2.1 JSON into executable pytest test suites

Turn requirements into Playwright plans, tests, runs, and repair workflows with a self-hosted AI agent.

Open-source simulation harness for testing AI agents. Simulate LLM and tool calls to test edge cases, failure paths, and agent logic without live API calls.

Assertions for non-deterministic AI text. Drop into pytest, get a Trust Score + HTML report. Free-first: rules, local embeddings, then your own LLM judge.

A CI gate for testing AI prompts and preventing regressions.

A library that records a program's external inputs — database, HTTP, clock, randomness — and replays them, so any past run can be reproduced and debugged exactly.