homehome Home chatchat Notifications


Researchers build ChatGPT-powered robot arm that costs $120

ChatGPT is leaking into the physical world.

Mihai Andrei
November 12, 2024 @ 8:30 pm

share Share

“Explain what you do and clean up the table,” the researcher instructs.

“I’ll use the robot arm to clean the table surface,” the robot replies. “First, I’ll check for available motion skills to pick up the sponge and wipe the table, then I’ll execute the sequence to clean the spill.”

The robot arm grabs the cleaning sponge and cleans the surface. It doesn’t do a fantastic job, but it does work on the task. The most surprising part is that this whole system was built in only a few days, for less than the cost of a Taylor Swift ticket.

Imagine a robot arm that can clean up a spill, understand instructions, and explain its actions — all for around $120. In a groundbreaking project, researchers at UC Berkeley and ETH Zurich accomplished just that. Using OpenAI’s GPT-4o and a pair of budget-friendly robot arms, Jannik Grothusen and Kaspar Janssen successfully trained their robots to handle tasks like spill cleanup in only four days.

The researchers started with cheap, open-source robot arms (open-source refers to software or hardware whose design is publicly accessible, allowing anyone to view, modify, and distribute the source code or design).

By feeding the robot arms around 100 demonstrations, they developed motion policies using an already existing framework called the ACT (Actor-Critic Training) framework. This approach teaches the robots to mimic human movements, improving their efficiency in handling tasks. The result? A robot that can recognize a spill, pick up a sponge and clean it up — all while explaining its actions.

Robotics becomes more open-source

One of the most exciting aspects of this project is its accessibility. The SO-100 robot arms used in the experiment are affordable and fully open-source. Detailed assembly instructions and all necessary files are shared on YouTube and GitHub. This makes it possible for anyone with basic 3D printing skills to replicate the project at home.

Robotic arms folded on a table. Standard Open Arm 100
Standard Open Arm 100 – Version 1.3. Image credits: The Robot Studio / GitHub.

This “proof-of-concept for a robot control architecture” demonstrates how open-source is beginning to democratize the field of robotics, notes Grothusen in a LinkedIn post. The entire project took four days to complete and can even be replicated by inexperienced people.

This democratization of robotics is a significant shift in the field. Finally, with 3D printing and AI, we have a recipe to make cheap, customizable robots. By combining open-source hardware with AI-powered software, even small teams or individual enthusiasts can now develop robots capable of performing complex tasks. Grothusen and Janssen’s work exemplifies how collaboration, open-source platforms, and cutting-edge AI can transform the future of robotics.

The 3D-printed components are optimized for durability, using carbon fiber materials to ensure longevity. Adjustable tolerances and refined joint designs allow for precise movements, making the robot both robust and agile. Assembly is straightforward, requiring only common tools like screwdrivers. The entire process can be completed in about 30 minutes, even by those with minimal technical expertise.

GPT is an important tool

Moments before the robot starts cleaning up. Image credits: Grothusen and Janssen / X.

GPT-4o might seem like an unusual tool for training robots, and it’s definitely not a perfect one. Yet, its ability to process language and context proves invaluable. By using a visual language model (VLM), the researchers could guide the robot through tasks that require both reasoning and physical interaction. The robot didn’t just follow rigid pre-programmed instructions; it adapted to changes in its environment and responded intelligently to commands.

It’s also a tool that’s now widely available to anyone.

As open-source platforms and affordable hardware continue to evolve, the barriers to entry for robotics are lowering. This means that innovative solutions like these might not be confined to research labs for long. Soon, we could see affordable, AI-powered robots assisting in everyday life, transforming our homes and workplaces.

With the help of AI models like GPT-4o, what was once considered science fiction is becoming reality. These robots, powered by language models, are breaking into the physical world, demonstrating how AI can extend its capabilities beyond text-based tasks.

So, the next time you spill a drink, don’t be surprised if a robot arm swoops in to clean it up — courtesy of cutting-edge AI and a few 3D-printed parts.

share Share

This Moth’s Wings Create a Mind-Bending 3D Optical Illusion to Avoid Being Eaten

A moth's flat wings fool predators into seeing an inedible 3D leaf.

Scientists Just Linked Two Quantum Computers With "Quantum Teleportation" for the First Time and It Changes Everything

The future of computing might not be one giant quantum machine but many linked together.

Human-like Teeth Grown in Pigs Could Make Dental Implants a Thing of the Past

It's a glimpse into the future of tooth replacement.

Paleolithic culture cannibalized their enemies — and maybe their friends as well

In the 19th century, archaeologists in Poland unearthed a stunning cave filled with prehistoric secrets. The Maszycka Cave, as it’s called, once sheltered Magdalenian people 18,000 years ago. Now, a new study offers compelling evidence that the cave was the site of a grisly ritual — or perhaps something even darker. Did these ancient people […]

AI Is Supposed to Make You More Productive — It's Making You Dumber and Overconfident

Generative AI is supposed to make life easier. It drafts emails, summarizes documents, and even generates creative content, helping you offload some of that dreaded cognitive effort. But according to a new study from Carnegie Mellon University and Microsoft Research, it may also be making you dumber in the process. The study, based on a […]

Beavers Built a $1.2M Dam for Free — And Saved a Czech River

A Czech project that was stalled for years is now completed — by beavers.

A Single High Dose of Creatine Might Help the Brain to Power Through Sleep Deprivation

From the gym to your brain: the surprising new use of creatine.

A Spoonful of Peanut Butter Might Be the Key to Overcoming Peanut Allergies

A new study suggests that children with peanut allergies may be able to safely build tolerance through a simple, cost-effective treatment.

Inside China's 600 MPH Floating Train Faster Than a Boeing 737

It's basically a Hyperloop design on steroids.

Do the International Space Station Windows Need Cleaning? Here's how astronauts do it

Every now and then, space windows also have to be cleaned. When that happens, it's not an easy task.