olmo-eval: An evaluation workbench for the model development loop
• 9
AI & ML interests
Building breatkthrough AI to solve the world's biggest problems.
Recent Activity
View all activity
Papers
EMO: Pretraining Mixture of Experts for Emergent Modularity
MolmoAct2: Action Reasoning Models for Real-world Deployment
Articles
Organization Card
Collection of the evaluation rollouts for MolmoAct2 conducted by Cortex AI
-
MolmoAct2: Action Reasoning Models for Real-world Deployment
Paper • 2605.02881 • Published • 348 -
allenai/eval_molmoact_candy_sorting_in-distribution
Viewer • Updated • 59.6k • 457 -
allenai/eval_molmoact_cup_stacking_in-distribution
Viewer • Updated • 32k • 428 -
allenai/eval_molmoact_cup_storing_in-distribution
Viewer • Updated • 45.4k • 465
Collection of the evaluation rollouts for MolmoAct2 conducted by Cortex AI
-
MolmoAct2: Action Reasoning Models for Real-world Deployment
Paper • 2605.02881 • Published • 348 -
allenai/eval_molmoact_candy_sorting_in-distribution
Viewer • Updated • 59.6k • 457 -
allenai/eval_molmoact_cup_stacking_in-distribution
Viewer • Updated • 32k • 428 -
allenai/eval_molmoact_cup_storing_in-distribution
Viewer • Updated • 45.4k • 465
Collection of the embodied reasoning datasets for MolmoAct2
spaces 19
pinned
Running
27
AstaBench Leaderboard
🥇
Explore benchmark leaderboards and submit your results
pinned
Running on Zero
MCP
Featured
30
Molmo-Point Demo
🎯
MolmoPoint - Image & Video Pointing & Tracking
pinned
Running on Zero
MCP
5
MolmoPoint-GUI Demo
🖥
MolmoPoint - GUI Image Pointing
pinned
Running
Agents
432
Reward Bench Leaderboard
📐
Explore and compare model scores on RewardBench benchmarks
pinned
Runtime error
Agents
3
HREF Leaderboard
📐
Browse and search HREF leaderboard data
pinned
Running
Agents
94
Zebra Logic Bench
🦓
Display model leaderboard and explore sample puzzles
models 949
allenai/ACE2S-SHiELD-plus
Updated • 8 • 1
allenai/WildDet3D
Object Detection • Updated • 47 • 41
allenai/Olmo-Hybrid-Instruct-SFT-7B
Text Generation • 7B • Updated • 2.82k • 17
allenai/Olmo-Hybrid-7B
Text Generation • 7B • Updated • 38.1k • 64
allenai/MolmoAct2-LIBERO-LeRobot
Robotics • 5B • Updated • 442 • 3
allenai/MolmoAct2-DROID
Robotics • 5B • Updated • 718 • 4
allenai/MolmoAct2-Pretrain
Robotics • 5B • Updated • 930 • 5
allenai/MolmoAct2-Think
Robotics • 5B • Updated • 247 • 3
allenai/MolmoAct2
Robotics • 5B • Updated • 3.94k • 18
allenai/MolmoAct2-Think-LIBERO
Robotics • 5B • Updated • 250 • 4
datasets 1,258
allenai/asta-summary-citation-counts
Viewer • Updated • 81.8M • 1.35k • 9
allenai/asta-bench-results
Viewer • Updated • 87 • 152
allenai/asta-bench-submissions
Updated • 63 • 1
allenai/olmoearth-paper-embeddings
Updated • 17.3k • 6
allenai/MolmoAct2-BimanualYAM-Dataset
Viewer • Updated • 76M • 7.69k • 1
allenai/molmospaces
Viewer • Updated • 1M • 20.4k • 47
allenai/eval_pi05_pipette_ood
Viewer • Updated • 9.27k • 436
allenai/eval_pi05_cup_stacking_ood
Viewer • Updated • 14k • 503
allenai/eval_cosmos_cup_stacking_ood
Viewer • Updated • 16.8k • 501
allenai/eval_pi05_test_tube_ood
Viewer • Updated • 13.7k • 427