homehome Home chatchat Notifications


This algorithm lets you delete water from underwater photos

Underwater photography is spectacular enough. But what if we could make it even more amazing?

Mihai Andrei
December 19, 2019 @ 9:19 pm

share Share

Image credits: Derya Akkaynak.

Underwater photography is not just for Instagram feeds — they are very important for biologists who monitor underwater ecosystem such as coral reefs. Coral reefs are some of the most colorful and vibrant environments on Earth, but like all underwater photos, photos of coral reefs tend to come out tainted by hues of blue and green. This makes it more difficult for researchers to identify species and traits of species from images, and makes monitoring considerably more difficult.

Now, there’s a solution for that: it’s called Sea-Thru.

Engineer and oceanographer Derya Akkaynak and her postdoctoral adviser, engineer Tali Treibitz, spent four years working to develop and improve an algorithm that would essentially “remove” the water from underwater photography.

The way the light is absorbed and scattered in water causes photos to be dim and overtaken by blue tones. Sea-thru removes the color cast and backscatter, leaving behind a crisp and clear image.

Image credits: Derya Akkaynak.

The method relies on taking multiple images of the same thing, from slightly different angles factoring in the physics of light absorption. Then, the algorithm produces a model of the photo, reversing the effects caused by the scattering and absorption.

“The Sea-thru method estimates backscatter using the dark pixels and their known range information,” the researchers describe the method in a working paper. “Then, it uses an estimate of the spatially varying illuminant to obtain the range-dependent attenuation coefficient. Using more than 1,100 images from two optically different water bodies, which we make available, we show that our method with the revised model outperforms those using the atmospheric model. “

The downside of this is that it requires quite a lot of images, and therefore, large datasets. Thankfully, many scientists are already capturing images this way using a process called photogrammetry (a technique that uses photographs to make certain measurements). Sea-Thru will readily work with photogrammetry images, Akkaynak says, which already raises intriguing prospects.

Results on different processing methods. Image credits: Derya Akkaynak.

This method is not akin to image manipulation — it’s not photoshopping or image manipulation. The colors are not enhanced or modified, it’s a physical correction rather than a visually pleasing modification, says Akkaynak.

Although the algorithm was only recently announced, it’s already causing quite a stir due to its potential. Any tool that can help scientists better understand the oceans, particularly at this extremely delicate time, can’t come sooner enough.

“Sea-thru is a significant step towards opening up large underwater datasets to powerful computer vision and machine learning algorithms, and will help boost underwater research at a time when our oceans are increasing stress from pollution, overfishing, and climate change,” the researchers conclude.

share Share

Explorers Find a Vintage Car Aboard a WWII Shipwreck—and No One Knows How It Got There

NOAA researchers—and the internet—are on the hunt to solve the mystery of how it got there.

Plastics that melt in the ocean offer new hope for cleaner seas

One day we can say goodbye to microplastics.

These Male Octopuses Paralyze Mates During Sex to Avoid Being Eaten Alive

Male blue-lined octopuses paralyze their mates to survive the perils of reproduction.

The UAE Wants AI to Write Its Laws — What Could Possibly Go Wrong?

But can machines really grasp justice, fairness, and human rights?

AI Made Up a Science Term — Now It’s in 22 Papers

A mistranslated term and a scanning glitch birthed the bizarre phrase “vegetative electron microscopy”

This Sensor Box Can Detect Deadly Bird Flu in 5 Minutes. But It Won't Stop the Current Outbreak

The biosensor can detect viral airborne particles.

The Earth's oceans were once green. Then, cyanobacteria and iron came in

A pale green dot?

These Robot Dogs Kept Going Viral on Social Media — Turns Out, They Have a Spying Backdoor

It looks like a futuristic pet, but the Unitree Go1 robot dog came with a silent stowaway.

If you use ChatGPT a lot, this study has some concerning findings for you

So, umm, AI is not your friend — literally.

Miyazaki Hates Your Ghibli-fied Photos and They're Probably a Copyright Breach Too

“I strongly feel that this is an insult to life itself,” he said.