-
Open VLM Leaderboard
🌎940VLMEvalKit Evaluation Results Collection
-
Open VLM Video Leaderboard
🌎129VLMEvalKit Eval Results in video understanding benchmark
-
Open LMM Reasoning Leaderboard
🥇44A Leaderboard that demonstrates LMM reasoning capabilities
-
MMBench Leaderboard
🚀24Explore MMBench Leaderboard data
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
View all Papers
Organization Card
👋 join us on Discord and WeChat
follow us on Github
OpenCompass is a platform focused on evaluation of AGI, include Large Language Model and Multi-modality Model. We aim to:
- develop high-quality libraries to reduce the difficulties in evaluation
- provide convincing leaderboards for improving the understanding of the large models
- create powerful toolchains targeting a variety of abilities and tasks
- build solid benchmarks to support the large model research
-
Open VLM Leaderboard
🌎940VLMEvalKit Evaluation Results Collection
-
Open VLM Video Leaderboard
🌎129VLMEvalKit Eval Results in video understanding benchmark
-
Open LMM Reasoning Leaderboard
🥇44A Leaderboard that demonstrates LMM reasoning capabilities
-
MMBench Leaderboard
🚀24Explore MMBench Leaderboard data
CompassVerifier: A Unified and Robust Verifier for LLMs Evaluation and Outcome Reward
spaces
18
pinned
Running
2
ATLAS Benchmark
🧪
ATLAS for Frontier Scientific Benchmark
pinned
Running
on
CPU Upgrade
28
RISEBench Gallery
👀
A Gallery of Generation Results on RISEBench
pinned
Running
6
Open LMM Spatial Leaderboard
🥇
A Leaderboard for LMM spatial understanding capabilities
pinned
Running
26
Open LMM Subjective Leaderboard
🌎
VLMEvalKit Subjectivce Benchmark Results
pinned
Running
3
CompassAcademic Leaderboard Full Version
🦀
Compass Academic Leaderboard Full Version
pinned
Running
44
Open LMM Reasoning Leaderboard
🥇
A Leaderboard that demonstrates LMM reasoning capabilities
models
13
opencompass/CompassVerifier-32B
33B
•
Updated
•
30
•
7
opencompass/CompassVerifier-7B
8B
•
Updated
•
947
•
4
opencompass/CompassVerifier-3B
3B
•
Updated
•
730
•
5
opencompass/CompassJudger-2-7B-Instruct
Text Ranking
•
8B
•
Updated
•
32
•
3
opencompass/CompassJudger-2-32B-Instruct
Text Ranking
•
33B
•
Updated
•
326
•
2
opencompass/anah-7b
Text Classification
•
8B
•
Updated
•
9
opencompass/anah-20b
Text Classification
•
20B
•
Updated
•
8
opencompass/anah-v2
Text Classification
•
8B
•
Updated
•
66
•
4
opencompass/CompassJudger-1-14B-Instruct
Text Generation
•
15B
•
Updated
•
25
•
2
opencompass/CompassJudger-1-32B-Instruct
Text Generation
•
33B
•
Updated
•
308
•
17
datasets
16
opencompass/ATLAS
Viewer
•
Updated
•
798
•
52
opencompass/NeedleBench
Viewer
•
Updated
•
6.8k
•
18.6k
•
5
opencompass/ReasonZoo
Updated
•
90
opencompass/VerifierBench
Viewer
•
Updated
•
2.82k
•
73
•
3
opencompass/LiveMathBench
Viewer
•
Updated
•
483
•
419
•
10
opencompass/CodeForce_SAGA
Viewer
•
Updated
•
5.57k
•
441
•
1
opencompass/CodeCompass
Updated
•
94
•
1
opencompass/compass_academic_predictions
Viewer
•
Updated
•
4.42M
•
45
opencompass/Creation-MMBench
Viewer
•
Updated
•
765
•
237
•
3
opencompass/anah
Viewer
•
Updated
•
783
•
88
•
3