homehome Home chatchat Notifications


Probabilistic computing is a game changer

With the development of the internet and technology, data availability is rarely a problem - it's what you do with the data that actually matters. As a matter of fact, analyzing huge data sets and looking for patterns is a big part of what programmers do today. In what promises to be a huge change, computer scientists have developed so-called probabilistic programming languages, which let researchers mix and match different machine-learning techniques.

Henry Conrad
April 13, 2015 @ 4:44 pm

share Share

With the development of the internet, data availability is often times not a problem – it’s what you do with the data that actually matters. As a matter of fact, analyzing huge data sets and looking for patterns is a big part of what programmers do today. In what promises to be a huge game changer, computer scientists have developed so-called probabilistic programming languages, which let researchers mix and match different machine-learning techniques.

Image via Extreme Tech.

Using this newly developed technique of probabilistic computing, MIT researchers have demonstrated short programs (about 50 lines of code) which are competitive with conventional systems with thousands of lines of code. The development might be hugely important for facial recognition and reconstruction software, among many others.

“This is the first time that we’re introducing probabilistic programming in the vision area,” says Tejas Kulkarni, an MIT graduate student in brain and cognitive sciences and first author on the new paper. “The whole hope is to write very flexible models, both generative and discriminative models, as short probabilistic code, and then not do anything else. General-purpose inference schemes solve the problems.”

For many programmers, the probabilistic approach might seem like blasphemy – it’s so vague that it goes against some of the very cores of traditional programming. It’s basically straying away from mathematical thinking, and moving onto a more intuitive approach.

“When you think about probabilistic programs, you think very intuitively when you’re modeling,” Kulkarni says. “You don’t think mathematically. It’s a very different style of modeling.”

[Also Read: MIT Creates Beautiful LED Origami Robot Garden]

Just like the name says, probabilistic programming is… probabilistic; well, sort of. The difference maker is something called the inference algorithm – an algorithm that continuously readjusts probabilities on the basis of new pieces of data. It constantly changes, but it’s probabilistic, not deterministic – hence the not-so-mathematical thinking.

Among the tasks they tackled was reconstructing a 3D image of a face using only 2D images. This new work is basically a new take on inverse graphics, which is one of the oldest issues associated with machine learning. For their experiments, they created a probabilistic programming language they call Picture, which is an extension of Julia, another language developed at MIT.

“Picture provides a general framework that aims to solve nearly all tasks in computer vision,” says Jianxiong Xiao, an assistant professor of computer science at Princeton University, who was not involved in the work. “It goes beyond image classification—the most popular task in computer vision—and tries to answer one of the most fundamental questions in computer vision: What is the right representation of visual scenes? It is the beginning of modern revisit for inverse-graphics reasoning.”

Kulkarni says, Picture is designed so that its inference algorithms can themselves benefit from machine learning, modifying themselves as they go to emphasize strategies that seem to lead to good results.

“Using learning to improve inference will be task-specific, but probabilistic programming may alleviate re-writing code across different problems,” he says. “The code can be generic if the learning machinery is powerful enough to learn different strategies for different tasks.”

 

share Share

New Liquid Uranium Rocket Could Halve Trip to Mars

Liquid uranium rockets could make the Red Planet a six-month commute.

Scientists think they found evidence of a hidden planet beyond Neptune and they are calling it Planet Y

A planet more massive than Mercury could be lurking beyond the orbit of Pluto.

People Who Keep Score in Relationships Are More Likely to End Up Unhappy

A 13-year study shows that keeping score in love quietly chips away at happiness.

NASA invented wheels that never get punctured — and you can now buy them

Would you use this type of tire?

Does My Red Look Like Your Red? The Age-Old Question Just Got A Scientific Answer and It Changes How We Think About Color

Scientists found that our brains process colors in surprisingly similar ways.

Why Blue Eyes Aren’t Really Blue: The Surprising Reason Blue Eyes Are Actually an Optical Illusion

What if the piercing blue of someone’s eyes isn’t color at all, but a trick of light?

Meet the Bumpy Snailfish: An Adorable, Newly Discovered Deep Sea Species That Looks Like It Is Smiling

Bumpy, dark, and sleek—three newly described snailfish species reveal a world still unknown.

Scientists Just Found Arctic Algae That Can Move in Ice at –15°C

The algae at the bottom of the world are alive, mobile, and rewriting biology’s rulebook.

A 2,300-Year-Old Helmet from the Punic Wars Pulled From the Sea Tells the Story of the Battle That Made Rome an Empire

An underwater discovery sheds light on the bloody end of the First Punic War.

Scientists Hacked the Glue Gun Design to Print Bone Scaffolds Directly into Broken Legs (And It Works)

Researchers designed a printer to extrude special bone grafts directly into fractures during surgery.