← Back to Benchmarks
simmediummobile-manipulationmetric · varies
HRT1: One-Shot Human-to-Robot Trajectory Transfer for Mobile Manipulation
Description
We introduce a novel system for human-to-robot trajectory transfer that enables robots to manipulate objects by learning from human demonstration videos. The system consists of four modules. The first module is a data collection module that is designed to collect human demonstration videos from the point of view of a robot using an AR headset. The second module is a video understanding module that detects objects and extracts 3D human-hand trajectories from demonstration videos. The third module