Quantcast
ZME Science
  • CoronavirusNEW
  • News
  • Environment
    • Climate
    • Animals
    • Renewable Energy
    • Eco tips
    • Environmental Issues
    • Green Living
  • Health
    • Alternative Medicine
    • Anatomy
    • Diseases
    • Genetics
    • Mind & Brain
    • Nutrition
  • Future
  • Space
  • Feature
    • Feature Post
    • Art
    • Great Pics
    • Design
    • Fossil Friday
    • AstroPicture
    • GeoPicture
    • Did you know?
    • Offbeat
  • More
    • About
    • The Team
    • Advertise
    • Contribute
    • Our stance on climate change
    • Privacy Policy
    • Contact
No Result
View All Result
ZME Science

No Result
View All Result
ZME Science
No Result
View All Result
Home Research Technology

New AI turns simple doodles into photorealistic landscapes — within seconds

The future is here, and it looks absolutely amazing.

Mihai Andrei by Mihai Andrei
March 20, 2019
in Technology, Videos

Nvidia has released a new Artificial Intelligence (AI) algorithm capable of producing stunning photos from only a few lines and shapes. Not only are the results strikingly realistic and quick to produce, but the AI also exhibits impressive adaptive capabilities, generating realistic reflections on water or modifying the sky if snow is present.

Image credits: Nvidia / Youtube.

Called GauGAN, the software is just a demonstration of what’s Nvidia’s neural network platforms have to offer. Its essential purpose is to produce an image as if it were painted by a human, and it seems to work as intended.

The AI uses generative adversarial networks (GAN) — a system in which two neural networks contest with each other, most often to produce different types of images. It’s an unsupervised learning technique: you feed a database into it and “teach” the AI how to progress. Of course, there’s much more to it in the actual process. Nvidia used 1 million images, mostly from Flickr’s Creative Commons.

ADVERTISEMENT

“It’s like a coloring book picture that describes where a tree is, where the sun is, where the sky is,” said Bryan Catanzaro, vice president of applied deep learning research at NVIDIA. “And then the neural network is able to fill in all of the detail and texture, and the reflections, shadows and colors, based on what it has learned about real images.”

It has a simplistic user interface and only three tools: a paint bucket, pen, and pencil. But even with these limited means, the algorithm shows impressive performance. You simply select a tool, and then you click on the type of object you want to produce. Want to draw a tree? Just draw a few lines or a rough shape. Rocks or mountains? A rough shape will do. Waterfall? Yeah, that’s just a line.

Get more science news like this...

Join the ZME newsletter for amazing science news, features, and exclusive scoops. More than 40,000 subscribers can't be wrong.

   

To make things even more stunning, it does all this in a matter of seconds — of course, while running on highly performant hardware. But Nvidia developers say that with small tweaks, the algorithm can run on any platform.

ADVERTISEMENT

The AI can generate thousands of different objects, learning from the real world. It also has a randomness figure embedded into it, so if you draw the same shape several times, the result will come out different each time.

It’s easy to see how this could be used for nefarious purposes like producing fake videos — and we’ve already seen how realistic fake videos can be —  but Nvidia says it wants to use this AI to make the world a better place, enabling anyone to become an artist and improving the workflow of people working in fields like architecture and urban planning; only time will tell.

If only this was around in the Paint days of yore, eh?

Here’s a quick demo of the AI’s capabilities:

Tags: nvidiatechvideo
Mihai Andrei

Mihai Andrei

Andrei's background is in geophysics, and he's been fascinated by it ever since he was a child. Feeling that there is a gap between scientists and the general audience, he started ZME Science -- and the results are what you see today.

Follow ZME on social media

ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT
  • Coronavirus
  • News
  • Environment
  • Health
  • Future
  • Space
  • Feature
  • More

© 2007-2019 ZME Science - Not exactly rocket science. All Rights Reserved.

No Result
View All Result
  • Coronavirus
  • News
  • Environment
    • Climate
    • Animals
    • Renewable Energy
    • Eco tips
    • Environmental Issues
    • Green Living
  • Health
    • Alternative Medicine
    • Anatomy
    • Diseases
    • Genetics
    • Mind & Brain
    • Nutrition
  • Future
  • Space
  • Feature
    • Feature Post
    • Art
    • Great Pics
    • Design
    • Fossil Friday
    • AstroPicture
    • GeoPicture
    • Did you know?
    • Offbeat
  • More
    • About
    • The Team
    • Advertise
    • Contribute
    • Our stance on climate change
    • Privacy Policy
    • Contact

© 2007-2019 ZME Science - Not exactly rocket science. All Rights Reserved.