Quantcast
ZME Science
  • CoronavirusNEW
  • News
  • Environment
    • Climate
    • Animals
    • Renewable Energy
    • Eco tips
    • Environmental Issues
    • Green Living
  • Health
    • Alternative Medicine
    • Anatomy
    • Diseases
    • Genetics
    • Mind & Brain
    • Nutrition
  • Future
  • Space
  • Feature
    • Feature Post
    • Art
    • Great Pics
    • Design
    • Fossil Friday
    • AstroPicture
    • GeoPicture
    • Did you know?
    • Offbeat
  • More
    • About
    • The Team
    • Advertise
    • Contribute
    • Our stance on climate change
    • Privacy Policy
    • Contact
No Result
View All Result
ZME Science

No Result
View All Result
ZME Science
No Result
View All Result
Home Health & Medicine Mind & Brain

This algorithm reconstructs the faces of people you see by reading your mind

Just from thoughts alone, researchers were able to reconstruct the faces of people portrayed in pictures.

Tibi Puiu by Tibi Puiu
June 14, 2016
in Mind & Brain, Neurology, News

Two neuroscientists demonstrated a powerful technology which starting from neural activity alone can reconstruct people’s faces.

reconstructed faces
Credit: Journal of Neuroscience

Hongmi Lee and Brice A. Kuhl used a fMRI scanner image the brains of participants as they were presented with photos one after another from a set comprising 1,000 portraits. Meanwhile, each photo was stripped into its basic constituents, namely 300 eigenfaces. These eigenfaces act like statistical patterns that can be used as anchors to match a request. Finally, using machine learning the researchers trained a computer to associate a neural response for each.

This exact process, only in reverse, was used for the decoding or “mind-reading” part. Participants were shown test face or portraits which they never saw before. The neural responses were analyzed to generate eigenfaces, then these were stitched to form a final digital portrait. Sort of like how the mind’s eye sees a person’s face.

ADVERTISEMENT

Though far from perfect, you can see the kind of accuracy this system has in the before and after below.

reconstructed faces
Credit: The Journal of Neuroscience

A second, maybe even more interesting experiment was made in which participants were asked to remember the face of a person. It turns out that the recalled faces could also be reconstructed, based on information glean from a memory-centered area of the brain called the angular gyrus.

Get more science news like this...

Join the ZME newsletter for amazing science news, features, and exclusive scoops. More than 40,000 subscribers can't be wrong.

   

The reconstructions were objectively worse than those made using neural patterns fired by the brains of people looking at a picture of the original face, but still pretty powerful. The scatter-plot charts show a correlation between the properties of the original and reconstructed faces.

ADVERTISEMENT
reconstructed faces
Credit: The Journal of Neuroscience

There are some similarities, but overall the stitched images are still lacking as you can clearly see. Now, these reconstructions might not look impressive, but researchers are still working in rough, uncharted terrain. By analyzing more neural patterns, say from thousands of participants, and fine tweaking their reconstruction algorithms, it’s foreseeable that these reconstructions could become a lot better.

Before you imagine someone will read your mind soon, take comfort in the fact that your brain, as any other, is unique. Our experiences and genetics have shaped unique neural patterns, and a machine would require a sort of brain map for each of our brains before it can start reading it. That’s if it can ever filter the constant rattle and noise that goes inside our heads. Oh, and if you though this is creepy, wait until you see its motion picture version (made by another team).

Tibi Puiu

Tibi Puiu

Tibi is a science journalist and co-founder of ZME Science. He writes mainly about emerging tech, physics, climate, and space. In his spare time, Tibi likes to make weird music on his computer and groom felines.

Follow ZME on social media

ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT
  • Coronavirus
  • News
  • Environment
  • Health
  • Future
  • Space
  • Feature
  • More

© 2007-2019 ZME Science - Not exactly rocket science. All Rights Reserved.

No Result
View All Result
  • Coronavirus
  • News
  • Environment
    • Climate
    • Animals
    • Renewable Energy
    • Eco tips
    • Environmental Issues
    • Green Living
  • Health
    • Alternative Medicine
    • Anatomy
    • Diseases
    • Genetics
    • Mind & Brain
    • Nutrition
  • Future
  • Space
  • Feature
    • Feature Post
    • Art
    • Great Pics
    • Design
    • Fossil Friday
    • AstroPicture
    • GeoPicture
    • Did you know?
    • Offbeat
  • More
    • About
    • The Team
    • Advertise
    • Contribute
    • Our stance on climate change
    • Privacy Policy
    • Contact

© 2007-2019 ZME Science - Not exactly rocket science. All Rights Reserved.