Sign in
← Back to search
github Not archived

open-compass/VLMEvalKit

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

2 awesome lists

Quick read

Stars
4,380
Forks
763
Open issues
309
Commits
1,797

Activity and growth

Latest capture 2026-09-09 03:09

Stars · last 7 days
No history
Commits · last 7 days
No history
Stars since tracking
+229
Stored snapshots
7

Classification

Topics

#chatgpt #claude #clip #computer-vision #evaluation #gemini #gpt #gpt-4v #gpt4 #large-language-models #llava #llm #multi-modal #openai #openai-api #pytorch #qwen #vit #vqa

Technology stack

Gradio

Metadata

Language
Python
License
Apache-2.0
Default branch
main
Created
2023-12-01
First commit
2023-11-25
Last pushed
2026-09-07
GitHub updated
2026-09-07
Last synced
2026-09-09 03:09
Stack scanned
2026-09-09 03:09
Archived
No

Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.

Sign in to like open-compass/VLMEvalKit
README Open website View on GitHub

AI development signals

0 paths

Agent instructions and tool configuration found in this repository.

No config files detected.

Growth history

Tracked growth

7 observed captures since 2026-05-25. Observed captures are shown by default.

Stars from first capture +229

Chart data

Observed captures only

Time horizon

All tracked data

Custom date range

Stars history

Observed snapshots

Commits history

Observed snapshots

Similar repositories

Nearest indexed repositories by embedding similarity.

open-compass/opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

7,402 stars
Python 3 awesome lists

EvolvingLMMs-Lab/lmms-eval

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

4,396 stars
Python 1 awesome list

huggingface/lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

2,537 stars
Python 3 awesome lists

om-ai-lab/VLM-R1

Solve Visual Understanding with Reinforced VLMs

6,018 stars
Python 1 awesome list

evalplus/evalplus

Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024

1,822 stars
Python 2 awesome lists

NVlabs/VILA

VILA is a family of state-of-the-art vision language models (VLMs) for diverse multimodal AI tasks across the edge, data center, and cloud.

3,860 stars
Python 1 awesome list