← Back to Benchmarks
simmediumgraspingmetric · varies

iTeach: Interactive Teaching for Robot Perception using Mixed Reality

Description

Robots deployed in the wild often encounter objects and scenes that break pre-trained perception models, yet adapting these models typically requires slow offline data collection, labeling, and retraining. We introduce iTeach, a human-in-the-loop system that enables robots to improve perception continuously as they explore new environments. A human sees the robot's predictions from its own viewpoint, corrects failures in real time, and the informed data drives iterative fine-tuning until perform

Source

http://arxiv.org/abs/2410.09072v3