homehome Home chatchat Notifications


How math can tell you if a picture is doctored

This is a picture of a cat, obviously, but do you notice something strange about it? Sure looks like a cat, but let's have a closer look - zoom in!

Tibi Puiu
February 16, 2015 @ 5:26 pm

share Share

cat1

This is a picture of a cat, obviously, but do you notice something strange about it? Sure looks like a cat, but let’s have a closer look – zoom in!

cat eye

I mean, really zooooom in.

doctored image

Once you zoom enough any picture, you’ll end up with a regular rectangular mesh of cells called pixels, each pixel containing a colour value. The image below shows how each pixel looks like when encoded by colour.

code bitmap

Now we’re talking business! Ann Dooms’ business that is. Dooms is a mathematician, but also a forensic specialist. She uses her mathematical skills to spot doctored photographs and videos by analyzing the mathematical patterns each of these digital mediums share or, on the contrary, lack. Algorithms can be used to find “patterns, irregularities, additions, and changes,” she says. Let’s take these two side-by-side photos below, can you spot the difference? (hint: don’t try too hard).

trees

 

Again, in colour code.

matrices

As you can see, some numbers are off which means the two photos are distinct.

matrix images

Using this sort of simple method, one can easily determine whether a photo or video was doctored, greatly aiding in criminal investigations such as cases of fraud. Fake paintings are also spotted this way. And that’s not all – feel welcome to Dooms’ TED Talk below to find out much more about her inspiring work.

share Share

AI has a hidden water cost − here’s how to calculate yours

Artificial intelligence systems are thirsty, consuming as much as 500 milliliters of water – a single-serving water bottle – for each short conversation a user has with the GPT-3 version of OpenAI’s ChatGPT system. They use roughly the same amount of water to draft a 100-word email message. That figure includes the water used to […]

Smart Locks Have Become the Modern Frontier of Home Security

What happens when humanity’s oldest symbol of security—the lock—meets the Internet of Things?

A Global Study Shows Women Are Just as Aggressive as Men with Siblings

Girls are just as aggressive as boys — when it comes to their brothers and sisters.

Birds Are Singing Nearly An Hour Longer Every Day Because Of City Lights

Light pollution is making birds sing nearly an hour longer each day

U.S. Mine Waste Contains Enough Critical Minerals and Rare Earths to Easily End Imports. But Tapping into These Resources Is Anything but Easy

The rocks we discard hold the clean energy minerals we need most.

Scientists Master the Process For Better Chocolate and It’s Not in the Beans

Researchers finally control the fermentation process that can make or break chocolate.

Most Countries in the World Were Ready for a Historic Plastic Agreement. Oil Giants Killed It

Diplomats from 184 nations packed their bags with no deal and no clear path forward.

Are you really allergic to penicillin? A pharmacist explains why there’s a good chance you’re not − and how you can find out for sure

We could have some good news.

Archaeologists Find 2,000-Year-Old Roman ‘Drug Stash’ Hidden Inside a Bone

Archaeologists have finally proven that Romans used black henbane. But how did they use it?

Astronomers Capture the 'Eye of Sauron' Billions of Light Years Away and It Might Be the Most Powerful Particle Accelerator Ever Found

A distant galaxy’s jet could be the universe’s most extreme particle accelerator.