homehome Home chatchat Notifications


This AI can tell which Instagram photos are edited

The future is here: it's AI versus the Gram.

Mihai Andrei
October 16, 2020 @ 8:48 pm

share Share

Image credits: Wang et al.

While the world is legitimately worried about deepfakes and other clever manipulations, one form of manipulation has been around for ages: Photoshop.

We all know that magazine photos are often cleverly edited, either with Photoshop or other image manipulation software. Most malicious manipulations, in general, use simple image editing tools. In a study published in e-print archive arXiv, a team of researchers has presented an AI algorithm capable of detecting image warping in human faces — probably the most common Instagram manipulation. The algorithm is also capable of predicting the location of edits and undoing the effect.

“Face warping is an interesting problem as it is a domain that is surprisingly hard for people to detect, but it is commonly used and has wide reaching implications,” researchers write in the study.

The topic is indeed popular — and not just among magazine stars. A search for “Image manipulation Instagram” on Google returns over 20 million results, and the hashtag #photomanipulation has over 1 million posts. Researchers also showed that humans are surprisingly bad at detecting this type of manipulation: in a case study presented in the paper, humans were correct in just 53.5% of the cases — just marginally better 50% than the flip of a coin.

This is where the new algorithm comes in. Not only can it detect when an image has been doctored, but it can also try to predict where exactly is it’s been edited.

Qualitative results on artist-created and auto-generated data, on two columns. (Input) Input manipulated image. (GT flow) The ”ground truth” optical flow from original to manipulated image. (Our prediction) The predicted flow of editing. (Flow overlay) Magnitude of
predicted flow overlaid.

So far, the algorithm only works with one type of warping manipulation, but researchers say it could be adapted to multiple types of manipulation — as it’s always the case with these machine learning algorithms, it’s all about how the algorithm is trained.

The application of the algorithm extends far beyond Instagram trickery. Image forensics, or forgery detection, is an increasingly important area of forensic research. But for now, you can use it to see which Instagram stars doctor their images.

A video depicting the detection technique.

The study has been published in arXiv.

share Share

This mRNA HIV Vaccine Produces the Virus-Fighting Antibodies That Have Eluded Researchers for 40 Years

New mRNA-based HIV vaccines spark hope with potent immune responses in first human trial

Ancient Siberian mummy was covered in intricate tattoos even modern artists would struggle to replicate

Hidden tattoos show the artistry and skill of the Pazyryk people 2,000 years ago

Anthropic says it's "vaccinating" its AI with evil data to make it less evil

The Black Mirror episodes are writing themselves now.

This AI Therapy App Told a Suicidal User How to Die While Trying to Mimic Empathy

You really shouldn't use a chatbot for therapy.

The 400-Year-Old, Million-Dollar Map That Put China at the Center of the World

In 1602, the Wanli Emperor of the Ming dynasty had a big task for his scholars: a map that would depict the entire world. The results was a monumental map that would forever change China’s understanding of its place in the world. Known as the Kunyu Wanguo Quantu (坤輿萬國全圖), or A Map of the Myriad […]

A New AI Can Spot You by How Your Body Bends a Wi-Fi Signal

You don’t need a phone or camera to be tracked anymore: just wi-fi.

7,000 Steps a Day Keep the Doctor Away

Just 7,000 steps a day may lower your risk of death, dementia, and depression.

Researchers tore down a Tesla and BYD battery to see which one's better

The two companies have different approaches, but is one better?

Scientists transform flossing into needle-free vaccine

In the not-too-distant future, your dentist might do more than remind you to floss—they might vaccinate you, too.

How Netscape lit the web on fire—and then watched the house burn down

Navigator, We Hardly Knew Ye.