github Not archived

EleutherAI/lm-evaluation-harness

A framework for few-shot evaluation of language models.

Quick read

Stars
13,922
Forks
3,548
Open issues
952
Commits
4,114

Activity and growth

Latest capture 2026-09-08 03:07

Stars · last 7 days
No history
Commits · last 7 days
No history
Stars since tracking
+1238
Stored snapshots
9

Classification

Metadata

Language
Python
License
MIT
Default branch
main
Created
2020-08-28
First commit
2020-08-28
Last pushed
2026-09-01
GitHub updated
2026-09-07
Last synced
2026-09-08 03:07
Stack scanned
2026-09-08 03:07
Archived
No

Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.

AI development signals

0 paths

Agent instructions and tool configuration found in this repository.

No config files detected.

Growth history

Tracked growth

9 observed captures since 2026-05-25. Observed captures are shown by default.

Stars from first capture +1238

Chart data

Observed captures only

Time horizon

All tracked data

Custom date range

Stars history

Observed snapshots

Commits history

Observed snapshots

Similar repositories

Nearest indexed repositories by embedding similarity.

EvolvingLMMs-Lab/lmms-eval

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

4,396 stars
Python 1 awesome list

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

35,727 stars
Python 5 awesome lists

huggingface/lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

2,537 stars
Python 3 awesome lists

bobazooba/xllm

🦖 X—LLM: Cutting Edge & Easy LLM Finetuning

410 stars
Python 1 awesome list

hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

74,698 stars
Python 2 awesome lists

evalplus/evalplus

Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024

1,822 stars
Python 2 awesome lists