ZME Science
  • News
  • Environment
  • Health
  • Future
  • Space
  • Features
    • Natural Sciences
    • Physics
      • Matter and Energy
      • Quantum Mechanics
      • Thermodynamics
    • Chemistry
      • Periodic Table
      • Applied Chemistry
      • Materials
      • Physical Chemistry
    • Biology
      • Anatomy
      • Biochemistry
      • Ecology
      • Genetics
      • Microbiology
      • Plants and Fungi
    • Geology and Paleontology
      • Planet Earth
      • Earth Dynamics
      • Rocks and Minerals
      • Volcanoes
      • Dinosaurs
      • Fossils
    • Animals
      • Mammals
      • Birds
      • Fish
      • Amphibians
      • Reptiles
      • Invertebrates
      • Pets
      • Conservation
      • Animal facts
    • Climate and Weather
      • Climate change
      • Weather and atmosphere
    • Health
      • Drugs
      • Diseases and Conditions
      • Human Body
      • Mind and Brain
      • Food and Nutrition
      • Wellness
    • History and Humanities
      • Anthropology
      • Archaeology
      • History
      • Economics
      • People
      • Sociology
    • Space & Astronomy
      • The Solar System
      • Sun
      • The Moon
      • Planets
      • Asteroids, meteors & comets
      • Astronomy
      • Astrophysics
      • Cosmology
      • Exoplanets & Alien Life
      • Spaceflight and Exploration
    • Technology
      • Computer Science & IT
      • Engineering
      • Inventions
      • Sustainability
      • Renewable Energy
      • Green Living
    • Culture
      • Culture & Society
      • Bizarre Stories
      • Lifestyle
      • Art and Music
      • Gaming
      • Books
      • Movies and Shows
    • Resources
      • How To
      • Science Careers
      • Metascience
      • Fringe Science
      • Science Experiments
      • School and Study
  • Reviews
  • More
    • Agriculture
    • Anthropology
    • Biology
    • Chemistry
    • Electronics
    • Geology
    • History
    • Mathematics
    • Nanotechnology
    • Economics
    • Paleontology
    • Physics
    • Psychology
    • Robotics
  • About Us
    • About
    • The Team
    • Advertise
    • Contribute
    • Privacy Policy
    • Contact
No Result
View All Result
ZME Science

No Result
View All Result
ZME Science

Home → Science → News

This new robot chef can recreate recipes just from watching food videos

It’s a big step towards automation of cooking.

Fermin Koop by Fermin Koop
June 5, 2023
in Future, News, Robotics
Edited and reviewed by Tibi Puiu

Robotic chefs have made headlines many times in recent years. Hype aside, cooking is a highly challenging task for a robot. Many companies have built prototype robot chefs but none are commercially available and they lag behind humans in terms of skill.

However, a newly created robot chef could be a game-changer for robot cooking.

The new robot chef
The robot watches and learns from cooking videos. Image credit: University of Cambridge.

A team of researchers at Cambridge University have trained a robot to watch and learn from cooking videos and then recreate the dish. They trained their robot with a cookbook of eight simple salad recipes. After watching a video of a human cooking one of the salad dishes, the robot could identify which recipe was being prepared and then make it itself.

The videos also helped the robot to expand its cookbook. At the end of the experiment, the robot had come up with a ninth salad recipe on its own. The results, the researchers argue, show how video content can be a valuable source of data for automated food production, and could accelerate the deployment of robot chefs.

“We wanted to see whether we could train a robot chef to learn in the same incremental way that humans can – by identifying the ingredients and how they go together in the dish,” Grzegorz Sochacki, a researcher at Cambridge University’s Department of Engineering and the paper’s first author, said in a media statement.

Time to cook

For their study, Sochacki and his team devised eight salad recipes and documented the process of preparing them on film. They then employed a readily accessible neural network to train their robot chef. This network had previously been configured to recognize various objects, including the fruits and vegetables incorporated in the salad recipes.

The robot analyzed each frame of the video and identified the different objects and features, such as a knife and the ingredients, as well as the human demonstrator’s arms, hands, and face.

The recipes and videos were then converted to vectors, which the robot used to perform mathematical operations.

YouTube video

By analyzing the ingredients and observing the actions of the human chef, the robot deduced the recipes being prepared. Out of the 16 videos it observed, the robot identified the correct recipe in 93% of the cases, even though it detected only 83% of the chef's actions. Moreover, the robot exhibited the ability to discern minor variations within a recipe, recognizing them as variations rather than distinct recipes.

“It’s amazing how much nuance the robot was able to detect,” said Sochacki. “These recipes aren’t complex – they’re essentially chopped fruits and vegetables, but it was really effective at recognising, for example, that two chopped apples and two chopped carrots is the same recipe as three chopped apples and three chopped carrots.”

This is a pretty big deal. But, like other demonstrations before it, this robochef has many limitations.

The videos used to train the robot aren’t like the videos made by social media influencers, with fast cuts and visual effects. The robot would struggle to identify a carrot if the human demonstrator had their hand wrapped around it, the researchers explained. Instead, to identify a carrot, the human demonstrator had to hold it so the robot could fully see it.

However, as robot chefs get better and faster at identifying ingredients in food videos, the researchers said they might one day be able to use websites such as YouTube to learn a whole range of recipes. In the meantime, it looks like we’ll have to continue cooking our own food without the help of a robot cook in our kitchen.

The study was published in the journal IEEE.

Tags: robot

ADVERTISEMENT
  • About
  • Advertise
  • Editorial Policy
  • Privacy Policy and Terms of Use
  • How we review products
  • Contact

© 2007-2023 ZME Science - Not exactly rocket science. All Rights Reserved.

No Result
View All Result
  • News
  • Environment
  • Health
  • Future
  • Space
  • Features
    • Natural Sciences
    • Physics
      • Matter and Energy
      • Quantum Mechanics
      • Thermodynamics
    • Chemistry
      • Periodic Table
      • Applied Chemistry
      • Materials
      • Physical Chemistry
    • Biology
      • Anatomy
      • Biochemistry
      • Ecology
      • Genetics
      • Microbiology
      • Plants and Fungi
    • Geology and Paleontology
      • Planet Earth
      • Earth Dynamics
      • Rocks and Minerals
      • Volcanoes
      • Dinosaurs
      • Fossils
    • Animals
      • Mammals
      • Birds
      • Fish
      • Amphibians
      • Reptiles
      • Invertebrates
      • Pets
      • Conservation
      • Animal facts
    • Climate and Weather
      • Climate change
      • Weather and atmosphere
    • Health
      • Drugs
      • Diseases and Conditions
      • Human Body
      • Mind and Brain
      • Food and Nutrition
      • Wellness
    • History and Humanities
      • Anthropology
      • Archaeology
      • History
      • Economics
      • People
      • Sociology
    • Space & Astronomy
      • The Solar System
      • Sun
      • The Moon
      • Planets
      • Asteroids, meteors & comets
      • Astronomy
      • Astrophysics
      • Cosmology
      • Exoplanets & Alien Life
      • Spaceflight and Exploration
    • Technology
      • Computer Science & IT
      • Engineering
      • Inventions
      • Sustainability
      • Renewable Energy
      • Green Living
    • Culture
      • Culture & Society
      • Bizarre Stories
      • Lifestyle
      • Art and Music
      • Gaming
      • Books
      • Movies and Shows
    • Resources
      • How To
      • Science Careers
      • Metascience
      • Fringe Science
      • Science Experiments
      • School and Study
  • Reviews
  • More
    • Agriculture
    • Anthropology
    • Biology
    • Chemistry
    • Electronics
    • Geology
    • History
    • Mathematics
    • Nanotechnology
    • Economics
    • Paleontology
    • Physics
    • Psychology
    • Robotics
  • About Us
    • About
    • The Team
    • Advertise
    • Contribute
    • Privacy Policy
    • Contact

© 2007-2023 ZME Science - Not exactly rocket science. All Rights Reserved.

Don't you want to get smarter every day?

YES, sign me up!

Over 35,000 subscribers can't be wrong. Don't worry, we never spam. By signing up you agree to our privacy policy.

✕
ZME Science News

FREE
VIEW