homehome Home chatchat Notifications


This AI can tell which Instagram photos are edited

The future is here: it's AI versus the Gram.

Mihai Andrei
October 16, 2020 @ 8:48 pm

share Share

Image credits: Wang et al.

While the world is legitimately worried about deepfakes and other clever manipulations, one form of manipulation has been around for ages: Photoshop.

We all know that magazine photos are often cleverly edited, either with Photoshop or other image manipulation software. Most malicious manipulations, in general, use simple image editing tools. In a study published in e-print archive arXiv, a team of researchers has presented an AI algorithm capable of detecting image warping in human faces — probably the most common Instagram manipulation. The algorithm is also capable of predicting the location of edits and undoing the effect.

“Face warping is an interesting problem as it is a domain that is surprisingly hard for people to detect, but it is commonly used and has wide reaching implications,” researchers write in the study.

The topic is indeed popular — and not just among magazine stars. A search for “Image manipulation Instagram” on Google returns over 20 million results, and the hashtag #photomanipulation has over 1 million posts. Researchers also showed that humans are surprisingly bad at detecting this type of manipulation: in a case study presented in the paper, humans were correct in just 53.5% of the cases — just marginally better 50% than the flip of a coin.

This is where the new algorithm comes in. Not only can it detect when an image has been doctored, but it can also try to predict where exactly is it’s been edited.

Qualitative results on artist-created and auto-generated data, on two columns. (Input) Input manipulated image. (GT flow) The ”ground truth” optical flow from original to manipulated image. (Our prediction) The predicted flow of editing. (Flow overlay) Magnitude of
predicted flow overlaid.

So far, the algorithm only works with one type of warping manipulation, but researchers say it could be adapted to multiple types of manipulation — as it’s always the case with these machine learning algorithms, it’s all about how the algorithm is trained.

The application of the algorithm extends far beyond Instagram trickery. Image forensics, or forgery detection, is an increasingly important area of forensic research. But for now, you can use it to see which Instagram stars doctor their images.

A video depicting the detection technique.

The study has been published in arXiv.

share Share

MIT Engineers Unveil AI-Designed Underwater Gliders That Redefine Ocean Exploration

An MIT-designed system lets AI evolve new shapes for ocean-exploring robots.

This Strange Material Flips Between Conductor and Insulator and This Could Supercharge Computers by 1,000 Times

New material phase could lead to computers that run 1,000 times faster

These Wild Tomatoes Are Reversing Millions of Years of Evolution

Galápagos tomatoes resurrect ancient defenses, challenging assumptions about evolution's one-way path.

Doctors Restored Hearing in Children and Adults With a Single Shot

A one-time injection helped some patients hear for the first time in their lives

Newborns Feel Pain Long Before They Can Understand It

Tiny brains register pain early, but lack the networks to interpret or respond to it

Scientists Just Proved Ancient Humans Were in North America 10,000 Years Earlier Than We Thought

Ancient mud tells a story critics can no longer ignore

Elon Musk says he wants to "fix" Grok after the AI disagrees with him

Grok exposed inconvenient facts. Now Musk says he’s “fixing” his AI to obey him.

Stanford's New Rice-Sized Device Destroys Clots Where Other Treatments Fail

Forget brute force—Stanford engineers are using finesse to tackle deadly clots.

A Man Lost His Voice to ALS. A Brain Implant Helped Him Sing Again

It's a stunning breakthrough for neuroprosthetics

Big Tech Said It Was Impossible to Create an AI Based on Ethically Sourced Data. These Researchers Proved Them Wrong

A massive AI breakthrough built entirely on public domain and open-licensed data