Quantcast
ZME Science
  • News
  • Environment
  • Health
  • Future
  • Space
  • Features
  • More
    • About
    • The Team
    • Advertise
    • Contribute
    • Our stance on climate change
    • Privacy Policy
    • Contact
No Result
View All Result
ZME Science

No Result
View All Result
ZME Science
No Result
View All Result
Home Research

New AI algorithm can transform blurry faces into sharp portraits

The algorithm can produce sharp images from blurred images, but there's a catch: the faces aren't real.

Mihai Andrei by Mihai Andrei
June 28, 2020
in Research, Science, Technology
Reading Time: 3 mins read
A A
Share on FacebookShare on TwitterSubmit to Reddit

A novel algorithm can turn blurry, unrecognizable pictures of people’s faces into eerily convincing portraits. The AI creates realistic-looking faces with up to 64 times the resolution of the blurred images.

While the AI does not produce an exact replica of the initial portrait and it sometimes reimagines features that weren’t there in the first place, the end result is remarkably close to reality.

“Never have super-resolution images been created at this resolution before with this much detail,” said Duke computer scientist Cynthia Rudin, who led the team.

It’s not the first time researchers have worked to recreate the faces behind blurred images. Traditional algorithms, however, are ‘trained’. They take a low-resolution image and try to add extra pixels by guessing what would fit. The end result is a plausible average, but relatively low-quality. The pixels filled in by the algorithm tend to be a decent, but not perfect fit, typically producing fuzzy and indistinct images.

ADVERTISEMENT

But this novel AI opts for a different approach.

Instead of adding detail to a low-resolution image, the system scours a database of artificial, AI-generated faces, looking for the ones that look the most like the blurred image. The AI is then confronted by another AI, in what is called a “generative adversarial network” (or GAN).

This second AI confronts the first one, trying to find errors in the produced face. The first network gets better and better, and when the second one can’t tell the difference between the blurred image and the produced face. Even given pixelated photos where the eyes and mouth are barely recognizable, “our algorithm still manages to do something with it, which is something that traditional approaches can’t do,” said co-author Alex Damian ’20, a Duke math major.

ADVERTISEMENT
Image credits: Duke University.

Remarkably, the resulting faces aren’t actually real — which, researchers say, means that it can’t be used to identify people. It can’t turn an out-of-focus security camera photo into an image of a real person. Instead, what it does is generate a new face that doesn’t exist, but looks like the image.

Sorry to interrupt, but you should really...

...Join the ZME newsletter for amazing science news, features, and exclusive scoops. More than 40,000 subscribers can't be wrong.

   

Meet the authors: Sachit Menon, Alex Damian, McCourt Hu, Nikhil Ravi and Cynthia Rudin. Here’s what they looked like, and how the AI reconstructed their face from a single blurred image. The similarities are clear, but the end result is a different image (look at the last image to see just how different they can be). Image Credits: Duke University

Instead, researchers say the same technique could be used on something other than faces, creating sharp, realistic images from a number of images, including (but not limited to) satellite imagery, microscopy, astronomy, and medical imaging.

See the results and upload images for yourself at http://pulse.cs.duke.edu/. Journal Reference: PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models, arXiv:2003.03808 [cs.CV] arxiv.org/abs/2003.03808

ShareTweetShare
Mihai Andrei

Mihai Andrei

Andrei's background is in geophysics, and he's been fascinated by it ever since he was a child. Feeling that there is a gap between scientists and the general audience, he started ZME Science -- and the results are what you see today.

ADVERTISEMENT
ADVERTISEMENT
  • News
  • Environment
  • Health
  • Future
  • Space
  • Features
  • More

© 2007-2019 ZME Science - Not exactly rocket science. All Rights Reserved.

No Result
View All Result
  • News
  • Environment
  • Health
  • Future
  • Space
  • Features
  • More
    • About
    • The Team
    • Advertise
    • Contribute
    • Our stance on climate change
    • Privacy Policy
    • Contact

© 2007-2019 ZME Science - Not exactly rocket science. All Rights Reserved.