Challenge Leaderboard

Provisional 2025 Challenge Leaderboard

The entries below are submissions to the 2025 BEHAVIOR challenge. We will migrate the leaderboard to HuggingFace in the future with more details, including task-specific statistics.

About Q-score

We rank policies by Q-score. Q-score measures how much of a task's goal condition a policy satisfies by computing the fraction of completed sub-goals and choosing the best-matched goal clause. It awards partial credit, so policies that make meaningful progress score higher even without full completion. This makes Q-score a smoother, more reliable way to compare policies across BEHAVIOR tasks than a binary success rate.

Submission tracks & test sets

This page lists submissions to the 2025 BEHAVIOR challenge across all tracks and test sets. Standard-track submissions remain eligible for privileged-track consideration where applicable.

'Public Validation' entries are self-reported on the public validation set. 'Held-out Test' entries are from the hidden test set and are verified by the BEHAVIOR team.

Rank	Team	Affiliation	Date	Track	Full Task Success Rate		★ Q Score
Rank	Team	Affiliation	Date	Track	Public Validation	Held-out Test	Public Validation	Held-out Test
1	Robot Learning Collective	Independent	20251114	Standard	0.1120	0.1240	0.2605	0.2599
2	Comet	NVIDIA Research	20251117	Standard	0.1440	0.1140	0.1830	0.2514
3	SimpleAI Robot	Beijing Simple AI Technology Co Ltd	20251117	Standard	0.1400	0.1080	0.1943	0.1591
4	The North Star	Huawei CRI EAI Team	20251116	Standard	0.1280	0.0760	0.1702	0.1204
5	Embodied Intelligence	Independent	20251117	Privileged	0.0620	0.0520	0.1110	0.0947
6	RAPPER	GIST	20251117	Privileged	0.0520		0.0750
7	tobi	Alzonova	20251117	Standard	0.0360		0.0717
8	MR	MR	20251115	Privileged	0.0340		0.0512
9	RACΞL	CMU	20251116	Standard	0.0140		0.0140
10	Ahri+EFFL+MLV	Postech	20251117	Standard	0.0100		0.0100
11	Merlin Labs	Independent	20251117	Standard	0.0060		0.0090
12	LYQRobotics	Independent	20251117	Standard	0.0080		0.0080
13	ACT	Xiamen University	20251116	Standard	0.0020		0.0037
14	StarVLA	Independent	20251117	Standard	0.0000		0.0019
15	Cloud-Data	Cloud Data Technology Co Ltd	20251116	Standard	0.0000		0.0000
16	RobotSimArk	1	20251116	Standard	0.0000		0.0000
17	EntropyMaximum	Independent	20251116	Standard	0.0000		0.0000
18	Magikid	Magikid	20251116	Standard	0.0000		0.0000