← Back to Benchmarks
simmediummobile-manipulationmetric · varies
ActiveUMI: Robotic Manipulation with Active Perception from Robot-Free Human Demonstrations
Description
We present ActiveUMI, a framework for a data collection system that transfers in-the-wild human demonstrations to robots capable of complex bimanual manipulation. ActiveUMI couples a portable VR teleoperation kit with sensorized controllers that mirror the robot's end-effectors, bridging human-robot kinematics via precise pose alignment. To ensure mobility and data quality, we introduce several key techniques, including immersive 3D model rendering, a self-contained wearable computer, and effici