homehome Home chatchat Notifications


This AI can do a 3D facial reconstruction from a single picture

It's seriously cool.

Mihai Andrei
January 4, 2019 @ 8:20 pm

share Share

It’s not only really cool, but also free and publicly available, thanks to the researchers who developed it.

Demonstration obtained with an example face.

3D reconstructions have long been a painstaking task. You generally need several pictures from different angles, and for something as complex as the human face, results have typically been lackluster. But a recent paper from UK scientists demonstrated impressive capabilities using a single, forward-facing image.

The researchers from the University of Nottingham and Kingston University developed a so-called convolutional neural network (CNN). This type of network allows algorithms to learn a bit like humans do, using interconnected neuron-like nodes.

[panel style=”panel-default” title=”Convolutional neural networks” footer=””]

Convolutional networks were inspired by biological processes in that the connectivity pattern between neurons resembles the organization of the animal visual cortex. As a result, they are especially used in analyzing visual imagery.

Given enough time and resources, these networks can find patterns in all sorts of data, though the relevancy and usefulness of those patterns remains a human challenge. Still, some networks have proven surprisingly capable of mimicking creativity.[/panel]

An example of how the algorithm “sees” the faces. Credits: Jackson et al.

Using this network, the team was able to produce remarkably accurate 3D facial reconstructions from a single photo. You can try it here, either using 8 example faces provided on the website, or by uploading your own images.

If you want to dig a little deeper, researchers also uploaded the paper and the code they are using — both of which can be accessed for free.

So far, almost a million faces have been uploaded and over 2 million models have been generated (presumably most models are done with the example faces, which include Barack Obama, Alan Turing, and Marie Curie).

For now, the technology is limited to human faces — as was dramatically highlighted by my failed first attempt, which was to upload a picture of my cat.

The most important use for this technology is in video monitoring and facial recognition. It could also be implemented in computer games or augmented reality where you could generate a character that looks just like you.

However, there are also some concerns: as smartphone producers are replacing fingerprint sensors with facial recognition, there are concerns that this type of algorithm could trick the security software. Aaron Jackson, the study’s first author thinks that’s unlikely. He does concede, however, that the technology could be used by authoritarian governments for population monitoring.

For now, we can enjoy the simple pleasure of viewing our faces in 3D. Ah, the joys of the internet!

share Share

The Real Singularity: AI Memes Are Now Funnier, On Average, Than Human Ones

People still make the funniest memes but AI is catching up fast.

This 200-year-old-condom in "mint condition" features erotic art and a striking message

This museum exhibit is a reflection of a turbulent part of European history.

A Swedish Library Forgot to Close Its Doors and Something Beautiful Happened

They say a reader does not steal and a thief does not read. In the city of Gothenburg, Sweden, that's definitely true.

Barbie’s Feet Have Something to Say About Modern Womanhood

Barbie's feet are changing from heels to flats, and it says a lot about our society.

A pet dog was found alive and kicking 529 days after going missing on a deadly island full of snakes

Meet Valerie, a superdog that survived the Kangaroo island and its deadly snakes. It even gained weight in the wild.

This Rat Found 109 Landmines and Just Broke a World Record

Ronin and other HeroRats have been training to smell landmines since they were six weeks old.

Chinese Student Got Rescued from Mount Fuji—Then Went Back for His Phone and Needed Saving Again

A student was saved two times in four days after ignoring warnings to stay off Mount Fuji.

Meet the Indian Teen Who Can Add 100 Numbers in 30 Second and Broke 6 Guinness World Records for Mental Math

The Indian teenager is officially the world's fastest "human calculator".

AI Is Changing Education — But Are We Keeping Up?

Ever since tools like ChatGPT and DeepSeek hit the mainstream, they’ve shaken up everything from office tasks to art generation. Unsurprisingly, students quickly saw the potential — and began using AI to cheat on essays and exams. At first, it felt like a shortcut. But if AI can ace your test, what does that say […]

Trump science director says American tech can 'manipulate time and space'

Uhm, did we all jump to Star Trek or something?