ZME Science
No Result
View All Result
ZME Science
No Result
View All Result
ZME Science

Home → Science → News

Dynamic augmented reality could make Pokemon interact with the real world

It's simply amazing.

Mihai AndreibyMihai Andrei
August 3, 2016
in News, Technology
A A
Share on FacebookShare on TwitterSubmit to Reddit

Instinctively, we know a lot about the surrounding world by touching it, poking it and getting a feel for it. But that kind of information is extremely difficult to convey to computers, which is why augmented reality is still in its infancy. But a team of researchers from MIT believe they have a solution for that, and this means – among many other applications – that everyone’s favorite game could get a beautiful revamp.

It’s hard to believe that Pokemon Go came about only a few weeks ago, it seems that everyone has been chasing Pokemon for ages. Of course, nostalgia and our love for the franchise was a decisive factor in the game’s success, but players were delighted by the augmented reality. Augmented reality (AR) is a live direct or indirect view of a physical environment which includes computer-generated elements – such as Pokemon.

Image via NPR.

However, the Pokemon don’t interact with the environment around them – and this is where the new technology kicks in. Researchers from MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) have recently done just that, developing an imaging technique called Interactive Dynamic Video (IDV) that lets you reach in and “touch” objects in videos.

“This technique lets us capture the physical behavior of objects, which gives us a way to play with them in virtual space,” says CSAIL PhD student Abe Davis, who will be publishing the work this month for his final dissertation. “By making videos interactive, we can predict how objects will respond to unknown forces and explore new ways to engage with videos.”

Of course, IDV has many more, and far less trivial practical applications. For instance, it could produce visual cues to help architects and engineer assess the structural stability and condition of a building, and it might even help with practice for invasive surgeries.

“The ability to put real-world objects into virtual models is valuable for not just the obvious entertainment applications, but also for being able to test the stress in a safe virtual environment, in a way that doesn’t harm the real-world counterpart,” says Davis.

Or of course, we could use it for games.

RelatedPosts

The Difference between Virtual and Augmented Reality
Pokémon Go Players Were Duped Into Training a Powerful AI Map of the Real World
Ge-Force powered Augmented Reality Sandbox
Augmented Reality could soon help surgeons ‘see’ through the skin

How it works

 

Typically, if you want to model something in the real world you must first build a 3D model for it. That’s time and resource consuming, and can be borderline impossible for many objects. With Davis’ work, even five seconds of video can have enough information to create realistic simulations, at least in simple environments.

In order to create simulations, he analyzed video clips to find “vibration modes” at different frequencies. These vibration modes represent the way in which an object can move, and by understanding these modes, researchers can predict how the object will move in a new environment.

“Computer graphics allows us to use 3-D models to build interactive simulations, but the techniques can be complicated,” says Doug James, a professor of computer science at Stanford University who was not involved in the research. “Davis and his colleagues have provided a simple and clever way to extract a useful dynamics model from very tiny vibrations in video, and shown how to use it to animate an image.”

In order to test the technology, Davis used IDV on things such as a bridge, a jungle gym, and a ukelele. With just a few mouse clicks, he was able to make the image bend and stretch in different directions, as well as making his own hand telekinetically control the leaves of a bush.

“If you want to model how an object behaves and responds to different forces, we show that you can observe the object respond to existing forces and assume that it will respond in a consistent way to new ones,” says Davis, who also found that the technique even works on some existing videos on YouTube.

Before this technology starts affecting a Pokemon near us, we can just feast on these videos. I for one, am looking forward to seeing the technology live.

 

Tags: Augmented realityinteractive dynamic videoPokemon

ShareTweetShare
Mihai Andrei

Mihai Andrei

Dr. Andrei Mihai is a geophysicist and founder of ZME Science. He has a Ph.D. in geophysics and archaeology and has completed courses from prestigious universities (with programs ranging from climate and astronomy to chemistry and geology). He is passionate about making research more accessible to everyone and communicating news and features to a broad audience.

Related Posts

Future

Pokémon Go Players Were Duped Into Training a Powerful AI Map of the Real World

byMihai Andrei
2 months ago
Health

Augmented Reality could soon help surgeons ‘see’ through the skin

byMihai Andrei
7 years ago
virtual reality oculus rift
Computer Science & IT

The Difference between Virtual and Augmented Reality

byTibi Puiu
8 years ago
News

Ge-Force powered Augmented Reality Sandbox

byAlexandru Micu
10 years ago

Recent news

This Startup Is Using Ancient DNA to Recreate Perfumes from Extinct Flowers

May 21, 2025

Jupiter Was Twice Its Size and Had a Magnetic Field 50 Times Stronger After the Solar System Formed

May 21, 2025

How One Man and a Legendary Canoe Rescued the Dying Art of Polynesian Navigation

May 21, 2025 - Updated on May 22, 2025
  • About
  • Advertise
  • Editorial Policy
  • Privacy Policy and Terms of Use
  • How we review products
  • Contact

© 2007-2025 ZME Science - Not exactly rocket science. All Rights Reserved.

No Result
View All Result
  • Science News
  • Environment
  • Health
  • Space
  • Future
  • Features
    • Natural Sciences
    • Physics
      • Matter and Energy
      • Quantum Mechanics
      • Thermodynamics
    • Chemistry
      • Periodic Table
      • Applied Chemistry
      • Materials
      • Physical Chemistry
    • Biology
      • Anatomy
      • Biochemistry
      • Ecology
      • Genetics
      • Microbiology
      • Plants and Fungi
    • Geology and Paleontology
      • Planet Earth
      • Earth Dynamics
      • Rocks and Minerals
      • Volcanoes
      • Dinosaurs
      • Fossils
    • Animals
      • Mammals
      • Birds
      • Fish
      • Amphibians
      • Reptiles
      • Invertebrates
      • Pets
      • Conservation
      • Animal facts
    • Climate and Weather
      • Climate change
      • Weather and atmosphere
    • Health
      • Drugs
      • Diseases and Conditions
      • Human Body
      • Mind and Brain
      • Food and Nutrition
      • Wellness
    • History and Humanities
      • Anthropology
      • Archaeology
      • History
      • Economics
      • People
      • Sociology
    • Space & Astronomy
      • The Solar System
      • Sun
      • The Moon
      • Planets
      • Asteroids, meteors & comets
      • Astronomy
      • Astrophysics
      • Cosmology
      • Exoplanets & Alien Life
      • Spaceflight and Exploration
    • Technology
      • Computer Science & IT
      • Engineering
      • Inventions
      • Sustainability
      • Renewable Energy
      • Green Living
    • Culture
    • Resources
  • Videos
  • Reviews
  • About Us
    • About
    • The Team
    • Advertise
    • Contribute
    • Editorial policy
    • Privacy Policy
    • Contact

© 2007-2025 ZME Science - Not exactly rocket science. All Rights Reserved.