Helping robots learn from each other
We did this by training a Transformer model on data collected from 130,000 demonstrations – when a person operates the robot to execute a task – of over 700 types of tasks, completed by 13 helper robots from Everyday Robots. The tasks include skills like picking and placing items, opening and closing drawers, getting items in and out drawers, placing elongated items up-right, knocking objects over, pulling napkins and opening jars. The result is a state-of-the-art Robotics Transformer model, or RT-1, that can perform over 700 tasks at a 97% success rate, and even generalize its learnings to new tasks, objects and environments.