WorldArena 2.0
Extending Embodied World Model Benchmarking on Modality, Functionality and Platform
Track 1 Final Evaluation and Submission Update
The final Track 1 evaluation protocol and submission requirements are being finalized. The update covers the evaluation settings, submission format, manual review, pre-submission testing, and final submission arrangements.
Motion Quality Evaluation Update
The scoring protocol for Dynamic Degree, Flow Score, and Motion Smoothness has been updated. Track 1 results have been recalculated under the revised protocol.
Track 1: Simulator video-quality evaluation using the WorldArena perceptual metrics, including the benchmark's difficulty and out-of-distribution corrections.
Loading results...
Track 2: Success rates of policies trained inside each world-model environment on Click Bell and Adjust Bottle. The paper's proxy-based reward results are used.
Loading results...
Track 3: Overall real-world manipulation results. By the August 15 checkpoint, multiple teams had completed preliminary testing; the table below shows results that had been completed and verified at that stage.
Loading results...
Track 3.1: WAM + VT-WAM visuo-tactile evaluation for tactile and vision-tactile manipulation submissions.
Loading results...
Track 3.2: Real Action Planner success rates across the available vision-based manipulation tasks.
Loading results...