Sign in
← All awesome lists Search these repos

Awesome List

Awesome Testing

A curated list of testing resources

TheJambo/awesome-testing #awesome #awesome-list #list #naughty-strings #tester #testing
Open GitHub
List stars
2,391
README repos
86
Indexed repos
72
List commits
276
Forks
491
Open issues
22

Tracked list growth

GitHub stars and default-branch commits for TheJambo/awesome-testing.

Latest scan 2026-10-17 10:50

Likes history

GitHub stars

Commits history

Default branch commits

Indexed repositories

6 repos matching these filters.

Topic: llm-evaluation
Latest repo push 2026-10-15

Filter this list

Search within Awesome Testing or narrow by ecosystem and project health.

Clear 1 refinement
Search mode
Tune results
More filters Topics, generated tags, stack, files, age, archive status, and growth.
Ecosystem
Files

Choose a suggestion or use commas to require multiple files.

Health

Uses known first-commit dates.

Momentum
Filters by observed commit-count growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Filters by observed GitHub star growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Reset filters
Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

promptfoo/promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

AI dev
Stack
TypeScript Express FastAPI Gradio React Go modules npm PEP 517
GitHub topics
#ci #ci-cd #cicd #evaluation #evaluation-framework #llm
Updated
2026-10-14
Lists
9 list mentions
First commit
2023-03-31
License
MIT
Issues
713 open
Sign in to like promptfoo/promptfoo
25,991
stars
Forks
2,476
Commits
10,381 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
Website GitHub
Continuum-AI-Corp/OrcaReplay

OrcaReplay — Time travel for AI agents. Record, replay, fork, and debug any agent run with any model. Built by the OrcaRouter.ai team.

Stack
TypeScript pytest npm PEP 517
GitHub topics
#agent-debugging #agent-tracing #ai-agent #ai-agents #ai-debugger #ai-debugging
Updated
2026-10-01
Lists
5 list mentions
First commit
2026-08-29
License
Apache-2.0
Issues
2 open
Sign in to like Continuum-AI-Corp/OrcaReplay
285
stars
Forks
69
Commits
265 commits
Star growth, last 7 days
+1 +0.4%
Commit velocity, last 7 days
0 0.0%
Website GitHub
tenro-ai/tenro-python

Open-source simulation harness for testing AI agents. Simulate LLM and tool calls to test edge cases, failure paths, and agent logic without live API calls.

Stack
Python LangChain LlamaIndex PydanticAI pytest uv
GitHub topics
#ai-agents #ai-testing #llm #llm-evaluation #prompt-testing #pytest
Updated
2026-06-09
Lists
1 list mention
First commit
2026-01-18
License
Apache-2.0
Issues
1 open
Sign in to like tenro-ai/tenro-python
7
stars
Forks
0
Commits
4 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
Website GitHub
dmsehgal/aiexpect

Assertions for non-deterministic AI text. Drop into pytest, get a Trust Score + HTML report. Free-first: rules, local embeddings, then your own LLM judge.

Stack
Python pytest PEP 517
GitHub topics
#ai-testing #assertions #chatbot #hallucination #llm #llm-evaluation
Updated
2026-09-14
Lists
1 list mention
First commit
2026-09-12
License
MIT
Issues
4 open
Sign in to like dmsehgal/aiexpect
2
stars
Forks
0
Commits
17 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
Website GitHub