Nvidia released GR00T 2, an open world-action model that runs arms, robot hands and humanoids.

Robots normally learn from recordings that pair each camera frame with exact motor commands, and those only come from a person steering a real robot.

Ordinary human video is far cheaper and more plentiful, but it has no motor commands, so earlier models could barely use it.

GR00T 2 eases that by pretraining on 402,730 hours of human head-camera video plus 10,184 hours of handheld-gripper demos, but only 23,500 teleoperated robot hours.