Robots are teleoperated all the time but getting them to handle delicate objects dexterously is not always easy. Dexterity Gen (DexGen) is a controller that brings unprecedented dexterous manipulation capabilities to robots. Thanks to this, it is now possible for humans to remote control robots to use a pen, screwdriver or syringe.
We introduce Dexterity Gen (DexGen), a foundation controller that enables unprecedented dexterous manipulation capabilities. For the first time, it allows human teleoperation of tasks such as using a pen, screwdriver, and syringe. Developed by @berkeley_AI and @MetaAI. A Thread. pic.twitter.com/MkLKTEaOUK
— Zhao-Heng Yin (@zhaohengyin) February 7, 2025
This generative model refines high-risk motion prompts into safe actions. It combines the benefits of learning from human demonstration and sim-to-real reinforcement learning. As the researchers explain:
With large-scale pretraining, Dexterity Gen provides reliable guidance across a wide range of objects—whether it’s rough object edges, tiny items, or the effects of gravity. We can handle them all.
[HT]
