homehome Home chatchat Notifications


Probabilistic computing is a game changer

With the development of the internet and technology, data availability is rarely a problem - it's what you do with the data that actually matters. As a matter of fact, analyzing huge data sets and looking for patterns is a big part of what programmers do today. In what promises to be a huge change, computer scientists have developed so-called probabilistic programming languages, which let researchers mix and match different machine-learning techniques.

Henry Conrad
April 13, 2015 @ 4:44 pm

share Share

With the development of the internet, data availability is often times not a problem – it’s what you do with the data that actually matters. As a matter of fact, analyzing huge data sets and looking for patterns is a big part of what programmers do today. In what promises to be a huge game changer, computer scientists have developed so-called probabilistic programming languages, which let researchers mix and match different machine-learning techniques.

Image via Extreme Tech.

Using this newly developed technique of probabilistic computing, MIT researchers have demonstrated short programs (about 50 lines of code) which are competitive with conventional systems with thousands of lines of code. The development might be hugely important for facial recognition and reconstruction software, among many others.

“This is the first time that we’re introducing probabilistic programming in the vision area,” says Tejas Kulkarni, an MIT graduate student in brain and cognitive sciences and first author on the new paper. “The whole hope is to write very flexible models, both generative and discriminative models, as short probabilistic code, and then not do anything else. General-purpose inference schemes solve the problems.”

For many programmers, the probabilistic approach might seem like blasphemy – it’s so vague that it goes against some of the very cores of traditional programming. It’s basically straying away from mathematical thinking, and moving onto a more intuitive approach.

“When you think about probabilistic programs, you think very intuitively when you’re modeling,” Kulkarni says. “You don’t think mathematically. It’s a very different style of modeling.”

[Also Read: MIT Creates Beautiful LED Origami Robot Garden]

Just like the name says, probabilistic programming is… probabilistic; well, sort of. The difference maker is something called the inference algorithm – an algorithm that continuously readjusts probabilities on the basis of new pieces of data. It constantly changes, but it’s probabilistic, not deterministic – hence the not-so-mathematical thinking.

Among the tasks they tackled was reconstructing a 3D image of a face using only 2D images. This new work is basically a new take on inverse graphics, which is one of the oldest issues associated with machine learning. For their experiments, they created a probabilistic programming language they call Picture, which is an extension of Julia, another language developed at MIT.

“Picture provides a general framework that aims to solve nearly all tasks in computer vision,” says Jianxiong Xiao, an assistant professor of computer science at Princeton University, who was not involved in the work. “It goes beyond image classification—the most popular task in computer vision—and tries to answer one of the most fundamental questions in computer vision: What is the right representation of visual scenes? It is the beginning of modern revisit for inverse-graphics reasoning.”

Kulkarni says, Picture is designed so that its inference algorithms can themselves benefit from machine learning, modifying themselves as they go to emphasize strategies that seem to lead to good results.

“Using learning to improve inference will be task-specific, but probabilistic programming may alleviate re-writing code across different problems,” he says. “The code can be generic if the learning machinery is powerful enough to learn different strategies for different tasks.”

 

share Share

CERN Creates Gold from Lead and There's No Magic, Just Physics

Researchers at CERN have managed to knock enough protons off lead atoms to make gold.

A New AI Tool Can Recreate Your Face Using Nothing But Your DNA

New AI built by Chinese scientists can create 3D faces from DNA with alarming accuracy.

How Some Flowers Evolved the Grossest Stench — and Why Flies Love It

Flowers keep making the same mutation time and time again.

People Living Near Golf Courses Face Double the Risk of Parkinson’s

The strong pesticides sprayed on golf courses leech into the groundwater and scientists suspect this could increase the risk of Parkinson's.

He Let Snakes Bite Him Over 200 Times and Now Scientists Want His Blood for an Universal Antivenom

A universal snakebite treatment may be within reach, thanks to an unlikely human experiment.

These companies want to make hand bags out of T-rex leather. But scientists aren't buying it

A lab-grown leather inspired by dinosaur skin sparks excitement—and scientific skepticism

This car-sized "millipede" was built like a tank — and had the face to go with it

A Carboniferous beast is showing its face.

9 Environmental Stories That Don't Get as Much Coverage as They Should

From whales to soil microbes, our planet’s living systems are fraying in silence.

Scientists Find CBD in a Common Brazilian Shrub That's Not Cannabis

This wild plant grows across South America and contains CBD.

Spruce Trees Are Like Real-Life Ents That Anticipate Solar Eclipse Hours in Advance and Sync Up

Trees sync their bioelectric signals like they're talking to each other.