A team of researchers from UC Berkeley and ETH Zurich has managed, on a budget of just $240, to develop a duo of robotic arms with spill-cleaning capabilities, through training powered by OpenAI’s GPT-4o.
They created the “cleaning robot” in just 4 days
The project is led by Jannik Grothusen and Kaspar Janssen, in the creation of a visual language model that improves human-robot interaction ( HRI ). This development was applied to robotic arms, designed by The Robot Studio , which were trained with approximately 100 demonstrations, allowing robots to perform tasks with greater precision by simulating human movements.
The secret behind the success of the SO-100, a 3D printed robotic arm , is the sophisticated multimodal agent coordinated by LangChain AI . This technology enables robots to efficiently interpret and respond to their environment in an active manner, facilitating more intuitive interaction.
The SO-100 is available for less than $100 in mass production, and its design allows for easy assembly. It was made from carbon fiber printed parts for durability, using six servos connected in a chain, via an adapter board. The prototype is optimized to allow for modifications and upgrades, offering a do-it-yourself approach for robotics enthusiasts.
The assembly process is simple yet meticulous . Each servo is programmed with a unique ID number, ensuring coordinated operation. With precise adjustments and magnetic tools, the robot can be assembled in about 30 minutes, ready to perform tasks with fluid, precise movements.
We built a GPT-4o-powered cleaning robot.
— Jannik Grothusen (@JannikGrothusen) November 2, 2024
– $250 for the robot arms
– 4 days to build
Open source is truly democratizing the field of robotics. @KasparJanssen pic.twitter.com/DEJECQML0k
The use of GPT-40 and reinforcement learning technologies enables these robots to be adaptable and effective. Motion policies, perfected with ACT ( Actor-Critic Training ), enable robots to continuously learn and improve.
Follow us on social media and don’t miss any of our posts!
YouTube LinkedIn Facebook Instagram X TikTok
Source and photo: X via @JannikGrothusen