homehome Home chatchat Notifications


Probabilistic computing is a game changer

With the development of the internet and technology, data availability is rarely a problem - it's what you do with the data that actually matters. As a matter of fact, analyzing huge data sets and looking for patterns is a big part of what programmers do today. In what promises to be a huge change, computer scientists have developed so-called probabilistic programming languages, which let researchers mix and match different machine-learning techniques.

Henry Conrad
April 13, 2015 @ 4:44 pm

share Share

With the development of the internet, data availability is often times not a problem – it’s what you do with the data that actually matters. As a matter of fact, analyzing huge data sets and looking for patterns is a big part of what programmers do today. In what promises to be a huge game changer, computer scientists have developed so-called probabilistic programming languages, which let researchers mix and match different machine-learning techniques.

Image via Extreme Tech.

Using this newly developed technique of probabilistic computing, MIT researchers have demonstrated short programs (about 50 lines of code) which are competitive with conventional systems with thousands of lines of code. The development might be hugely important for facial recognition and reconstruction software, among many others.

“This is the first time that we’re introducing probabilistic programming in the vision area,” says Tejas Kulkarni, an MIT graduate student in brain and cognitive sciences and first author on the new paper. “The whole hope is to write very flexible models, both generative and discriminative models, as short probabilistic code, and then not do anything else. General-purpose inference schemes solve the problems.”

For many programmers, the probabilistic approach might seem like blasphemy – it’s so vague that it goes against some of the very cores of traditional programming. It’s basically straying away from mathematical thinking, and moving onto a more intuitive approach.

“When you think about probabilistic programs, you think very intuitively when you’re modeling,” Kulkarni says. “You don’t think mathematically. It’s a very different style of modeling.”

[Also Read: MIT Creates Beautiful LED Origami Robot Garden]

Just like the name says, probabilistic programming is… probabilistic; well, sort of. The difference maker is something called the inference algorithm – an algorithm that continuously readjusts probabilities on the basis of new pieces of data. It constantly changes, but it’s probabilistic, not deterministic – hence the not-so-mathematical thinking.

Among the tasks they tackled was reconstructing a 3D image of a face using only 2D images. This new work is basically a new take on inverse graphics, which is one of the oldest issues associated with machine learning. For their experiments, they created a probabilistic programming language they call Picture, which is an extension of Julia, another language developed at MIT.

“Picture provides a general framework that aims to solve nearly all tasks in computer vision,” says Jianxiong Xiao, an assistant professor of computer science at Princeton University, who was not involved in the work. “It goes beyond image classification—the most popular task in computer vision—and tries to answer one of the most fundamental questions in computer vision: What is the right representation of visual scenes? It is the beginning of modern revisit for inverse-graphics reasoning.”

Kulkarni says, Picture is designed so that its inference algorithms can themselves benefit from machine learning, modifying themselves as they go to emphasize strategies that seem to lead to good results.

“Using learning to improve inference will be task-specific, but probabilistic programming may alleviate re-writing code across different problems,” he says. “The code can be generic if the learning machinery is powerful enough to learn different strategies for different tasks.”

 

share Share

Tennis May Add Nearly 10 Years to Your Life and Most People Are Ignoring It

Could a weekly match on the court be the secret to a longer, healthier life?

Humans Have Been Reshaping Earth with Fire for at Least 50,000 Years

Fossil charcoal reveals early humans’ growing impact on the carbon cycle before the Ice Age.

The Strangest Microbe Ever Found Straddles The Line Between Life and Non-Life

A newly discovered archaeon blurs the boundary between cells and viruses.

This $8750 Watch Was Designed for Space and Could Finally Replace Apollo-era Omega Watches

An audacious new timepiece dares to outshine Omega’s legacy in space

The Brain May Make New Neurons in Adulthood and Even Old Age

Researchers identify the birthplace of new brain cells well into late adulthood.

Your gut has a secret weapon against 'forever chemicals': microbes

Our bodies have some surprising allies sometimes.

High IQ People Are Strikingly Better at Forecasting the Future

New study shows intelligence shapes our ability to forecast life events accurately.

Cheese Before Bed Might Actually Be Giving You Nightmares

Eating dairy or sweets late at night may fuel disturbing dreams, new study finds.

Scientists Ranked the Most Hydrating Drinks and Water Didn't Win

Milk is more hydrating than water. Here's why.

Methane Leaks from Fossil Fuels Hit Record Highs. And We're Still Looking the Other Way

Powerful leaks, patchy action, and untapped fixes keep methane near record highs in 2024.