homehome Home chatchat Notifications


This AI can tell which Instagram photos are edited

The future is here: it's AI versus the Gram.

Mihai Andrei
October 16, 2020 @ 8:48 pm

share Share

Image credits: Wang et al.

While the world is legitimately worried about deepfakes and other clever manipulations, one form of manipulation has been around for ages: Photoshop.

We all know that magazine photos are often cleverly edited, either with Photoshop or other image manipulation software. Most malicious manipulations, in general, use simple image editing tools. In a study published in e-print archive arXiv, a team of researchers has presented an AI algorithm capable of detecting image warping in human faces — probably the most common Instagram manipulation. The algorithm is also capable of predicting the location of edits and undoing the effect.

“Face warping is an interesting problem as it is a domain that is surprisingly hard for people to detect, but it is commonly used and has wide reaching implications,” researchers write in the study.

The topic is indeed popular — and not just among magazine stars. A search for “Image manipulation Instagram” on Google returns over 20 million results, and the hashtag #photomanipulation has over 1 million posts. Researchers also showed that humans are surprisingly bad at detecting this type of manipulation: in a case study presented in the paper, humans were correct in just 53.5% of the cases — just marginally better 50% than the flip of a coin.

This is where the new algorithm comes in. Not only can it detect when an image has been doctored, but it can also try to predict where exactly is it’s been edited.

Qualitative results on artist-created and auto-generated data, on two columns. (Input) Input manipulated image. (GT flow) The ”ground truth” optical flow from original to manipulated image. (Our prediction) The predicted flow of editing. (Flow overlay) Magnitude of
predicted flow overlaid.

So far, the algorithm only works with one type of warping manipulation, but researchers say it could be adapted to multiple types of manipulation — as it’s always the case with these machine learning algorithms, it’s all about how the algorithm is trained.

The application of the algorithm extends far beyond Instagram trickery. Image forensics, or forgery detection, is an increasingly important area of forensic research. But for now, you can use it to see which Instagram stars doctor their images.

A video depicting the detection technique.

The study has been published in arXiv.

share Share

A Man Lost His Voice to ALS. A Brain Implant Helped Him Sing Again

It's a stunning breakthrough for neuroprosthetics

Big Tech Said It Was Impossible to Create an AI Based on Ethically Sourced Data. These Researchers Proved Them Wrong

A massive AI breakthrough built entirely on public domain and open-licensed data

Lawyers are already citing fake, AI-generated cases and it's becoming a problem

Just in case you're wondering how society is dealing with AI.

Leading AI models sometimes refuse to shut down when ordered

Models trained to solve problems are now learning to survive—even if we tell them not to.

Scientists Built a Cockroach Cyborg Guided by Light

A gentle light guides these insect cyborgs—no wires, no surgery, no shocks.

AI slop is way more common than you think. Here's what we know

The odds are you've seen it too.

Scientists Invented a Way to Store Data in Plastic Molecules and It Could Someday Replace Hard Drives

What if your next hard drive wasn’t a box, but a string of molecules? Synthetic polymers promises to revolutionize data storage.

Meet Cavorite X7: An aircraft that can hover like a helicopter and fly like a plane

This unusual hybrid aircraft has sliding panels on its wings that cover hidden electric fans.

AI is quietly changing how we design our work

AI reshapes engineering, from sketches to skyscrapers, promising speed, smarts, and new creations.

Inside the Great Firewall: China’s Relentless Battle to Control the Internet

On the Chinese internet, a river crab isn’t just a crustacean. It’s code. River crab are Internet slang terms created by Chinese netizens in reference to the Internet censorship, or other kinds of censorship in mainland China. They need to do this because the Great Firewall of China censors and regulates everything that is posted […]