Skip to content

BEHAVIOR Challenge Updates

On this page, we provide updates regarding the 2026 BEHAVIOR Challenge, including important bug fixes, new feature announcements, and clarifications about challenge rules.

07/27/2026

Challenge rule clarifications:

  1. Please use the v3.9.1 tag of the BEHAVIOR-1K repository for evaluation and replay workflows, rather than the older v3.9.0 tag. Since v3.9.0, v3.9.1 includes important challenge updates, including LeRobot v3 / Hugging Face demo download instructions, evaluator Torch thread configuration, sponsor-page content, synchronized BDDL generated data, and synchronized asset synset metadata.

Bug fixes:

  1. Updated the released demonstration dataset so observation.state[0:3] now records the R1Pro base velocity in the robot-local frame. Previously, these dimensions were populated from raw holonomic base joint velocities; the corrected values rotate the base x/y joint velocities by the base yaw and keep the yaw velocity as the third component. This matches the action convention used by the R1Pro base controller.
  2. Fixed the released depth videos for the 2026 demonstration dataset. See the Hugging Face discussion for details: behavior-1k/2026-challenge-demos discussion #2.

New features:

  1. Added meta/tasks.jsonl with natural-language task descriptions for all 100 challenge tasks. The first 50 tasks follow the 2025 challenge descriptions with spelling/grammar fixes where needed; the remaining 50 were derived from the 2026 annotations and task definitions.
  2. Uploaded per-episode language annotations for all 20,000 demonstrations.