homehome Home chatchat Notifications


Take yourself out (of any video stream) with this new app

So far, the app is more entertainment than a practical tool, but it is a very nice proof of concept.

Alexandru Micu
February 27, 2020 @ 5:31 pm

share Share

Ever felt like you’d just want to disappear? Jason Mayes, a senior developer advocate at Google, made it so you can — on video, at least.

Image via Youtube / Jason Mayes.

Mayes has developed an app he calls ‘Disappearing People,’ which can remove individuals from video streams in real-time. While it’s not perfect yet, with one example Mayes posted online still showing some pixelation and other flaws, it’s definitely workable. The app was built using Javascript and TensorFlow, a comprehensive library of free tools and resources for machine learning, and Mayes made the code freely available.

Camblock

The app works by first recording a series of images through a user’s webcam, which it uses to establish a baseline of their empty room. Once someone enters the room, the app recognizes them as being a human and erases their pixels out of the video. The gaps are then filled in with pixels from the baseline images of the room to create a seamless video.

In the sample video Mayes uploaded to Youtube, you can see him moving around the room (raw footage on the top part of the video) but not registering on the stream (bottom part of the video). There are a few seconds when his lower arms become visible, the app doesn’t remove his shadow on the wall to the left of the shot, and there are a few other glitches as well, but overall, it was a very fine performance.

You can also try the app for yourself here, and the code can be accessed here.

So far, the app is more entertainment than a practical tool, but it is a very nice proof of concept. If you don’t like taping over your laptop’s camera lens but are nonetheless concerned about privacy, it might just be the app for you, though.

share Share

The world’s largest wildlife crossing is under construction in LA, and it’s no less than a miracle

But we need more of these massive wildlife crossings.

Your gold could come from some of the most violent stars in the universe

That gold in your phone could have originated from a magnetar.

Ronan the Sea Lion Can Keep a Beat Better Than You Can — and She Might Just Change What We Know About Music and the Brain

A rescued sea lion is shaking up what scientists thought they knew about rhythm and the brain

Did the Ancient Egyptians Paint the Milky Way on Their Coffins?

Tomb art suggests the sky goddess Nut from ancient Egypt might reveal the oldest depiction of our galaxy.

Dinosaurs Were Doing Just Fine Before the Asteroid Hit

New research overturns the idea that dinosaurs were already dying out before the asteroid hit.

Denmark could become the first country to ban deepfakes

Denmark hopes to pass a law prohibiting publishing deepfakes without the subject's consent.

Archaeologists find 2,000-year-old Roman military sandals in Germany with nails for traction

To march legionaries across the vast Roman Empire, solid footwear was required.

Mexico Will Give U.S. More Water to Avert More Tariffs

Droughts due to climate change are making Mexico increasingly water indebted to the USA.

Chinese Student Got Rescued from Mount Fuji—Then Went Back for His Phone and Needed Saving Again

A student was saved two times in four days after ignoring warnings to stay off Mount Fuji.

The perfect pub crawl: mathematicians solve most efficient way to visit all 81,998 bars in South Korea

This is the longest pub crawl ever solved by scientists.