Here is a self-improving AI agent for robotic manipulation that can perform a variety of tasks and self-generates new training data to improve. Google DeepMind’s RoboCat can perform many tasks with multiple robot types. You simply have to show it the desired configuration of objects that serves as the agent’s goal.
RoboCat then tries to perform the task it was shown by bringing objects into a similar configuration. Thanks to this approach, different robot arms can be used to perform similar tasks.
[HT]