homehome Home chatchat Notifications


Novel system allows robots to learn new skills just by looking at you do it

Can it teach them how to love, though?

Alexandru Micu
July 4, 2018 @ 6:14 pm

share Share

It may soon be possible to teach a robot any task just by showing it how it’s done — a single time.

Robot.

Image credits John Greenaway / Flickr.

Researchers at UC Berkeley have developed a way to speed up the education of our silicone-brained friends. In a recently published paper, they report on a new learning algorithm that allows robots to mimic an activity it observed just once on video.

Copy, paste

Training robots today is hard work. Even really simple actions like picking up a cup require paragraphs upon paragraphs of code expressly telling the bot what to do each and every step of the way — a process that is hard, complicated, and probably frustrating for us humans.

There’s work to do even after the code is fully laid out. For example, take assembly line workers. After all the instructions are copy-pasted into their circuits, these bots must undergo a long training process during which they must execute every procedure multiple times. They do so until they can perform the task without making any mistake along the way.

More recently, programmers have created software that allows robots to be programmed just by observing certain tasks. While this is more similar to how we or an animal would learn, it’s still clunky to use — currently, we need to show our robotic friends such training videos thousands of times until they get the hang of it.

The team from UC Berkeley, however, describes a new technique they developed that allows robots to learn a certain action just by observing a human do it a single time.

This technique combines imitation learning with a meta-learning algorithm, the team reports. They christened the resulting system ‘model-agnostic meta-learning’ (MAML). Meta-learning basically means ‘learning to learn’. MAML is a process by which a robot builds on prior experience in order to learn something new. If a robot is shown footage of a human picking up an apple and putting it into a cup, for example, it can gauge what its objective is — putting the apple in the cup. As it learns how to handle these objects, it can expand that knowledge to other similar behaviors. So, for example, if you then go on to show it a video of somebody putting an orange down on a plate, it can recognize the overarching behavior and quickly translates that into the motions it needs to do to carry out the task.

Best of all for all those assembly-line robot trainers out there, the bot doesn’t need to know what an orange or a plate is — it will still perform the required task.

In short, MAML provides a platform that allows a neural network (or a robot) to learn a wide variety of tasks starting with relatively little data. It’s almost the polar opposite of how neural networks work today — which master a single task while drawing on a huge dataset.

The team tested MAML on several robots. After a “single video demonstration from a human”, they note, the robots could successfully perform the shown task. “After meta-learning, the robot can learn to place, push, and pick-and-place new objects using just one video of a human performing the manipulation,” they conclude.

The paper “One-Shot Imitation from Observing Humans via Domain-Adaptive Meta-Learning” has been published in the pre-print journal arXiv.

share Share

Archaeologists Found A Rare 30,000-Year-Old Toolkit That Once Belonged To A Stone Age Hunter

An ancient pouch of stone tools brings us face-to-face with one Gravettian hunter.

Scientists Crack the Secret Behind Jackson Pollock’s Vivid Blue in His Most Famous Drip Painting

Chemistry reveals the true origins of a color that electrified modern art.

China Now Uses 80% Artificial Sand. Here's Why That's A Bigger Deal Than It Sounds

No need to disturb water bodies for sand. We can manufacture it using rocks or mining waste — China is already doing it.

Over 2,250 Environmental Defenders Have Been Killed or Disappeared in the Last 12 Years

The latest tally from Global Witness is a grim ledger. In 2024, at least 146 people were killed or disappeared while defending land, water and forests. That brings the total to at least 2,253 deaths and disappearances since 2012, a steady toll that turns local acts of stewardship into mortal hazards. The organization’s report reads less like […]

After Charlie Kirk’s Murder, Americans Are Asking If Civil Discourse Is Even Possible Anymore

Trying to change someone’s mind can seem futile. But there are approaches to political discourse that still matter, even if they don’t instantly win someone over.

Climate Change May Have Killed More Than 16,000 People in Europe This Summer

Researchers warn that preventable heat-related deaths will continue to rise with continued fossil fuel emissions.

New research shows how Trump uses "strategic victimhood" to justify his politics

How victimhood rhetoric helped Donald Trump justify a sweeping global trade war

Biggest Modern Excavation in Tower of London Unearths the Stories of the Forgotten Inhabitants

As the dig deeper under the Tower of London they are unearthing as much history as stone.

Millions Of Users Are Turning To AI Jesus For Guidance And Experts Warn It Could Be Dangerous

AI chatbots posing as Jesus raise questions about profit, theology, and manipulation.

Can Giant Airbags Make Plane Crashes Survivable? Two Engineers Think So

Two young inventors designed an AI-powered system to cocoon planes before impact.