homehome Home chatchat Notifications


OpenAI will use Reddit and a new supercomputer to teach artificial intelligence how to speak

There's no "forum" in "AI" but Musk thinks there should be.

Alexandru Micu
August 19, 2016 @ 4:31 pm

share Share

OpenAI, Elon Musk’s artificial intelligence research company, just became the proud owner of the first ever DGX-1 supercomputer. Made by NVIDIA, the rig boasts a whopping 170 teraflops of computing power, equivalent to 250 usual servers — and OpenAI is gonna use it all to read Reddit comments.

OpenAI’s researchers gather around the first AI supercomputer in a box, NVIDIA DGX-1.
Image credits NVIDIA.

OpenAI is a non-profit AI research company whose purpose is to “advance digital intelligence in the way that is most likely to benefit humanity as a whole, unconstrained by a need to generate financial return.” And now, NVIDIA CEO CEO Jen-Hsun Huang just delivered the most powerful tool the company has ever had at its disposal, a US$ 2 billion supercomputer.

This “AI supercomputer in a box” isn’t much bigger than a large-ish desktop PC, but it packs a huge punch. It’s 170 teraflops of computing power makes is roughly equivalent to 250 conventional servers working together, and all that oopmh is being put to good use for a worthy cause.

“The world’s leading non-profit artificial intelligence research team needs the world’s fastest AI system,” NVIDIA said in a statement.

“I thought it was incredibly appropriate that the world’s first supercomputer dedicated to artificial intelligence would go to the laboratory that was dedicated to open artificial intelligence,” Huang added.

But an OpenAI needs to do more than just process things very fast. It needs to learn and Musk, unlike my parents, believes that the best place to do so is on the Internet — specifically, on Reddit. The forum’s huge size makes for an ideal training ground for DGX-1, which will be spending the next few months processing nearly two billion comments to learn how to better chat with human beings.

“Deep learning is a very special class of models because as you scale up, they always work better,” says OpenAI researcher Andrej Karpathy.

The $129,000 super-computer relies on eight NVIDIA Tesla P100 GPUs (graphic processing units), 7 terabytes of SSD storage, and two Xeon processors (apart from the aforementioned 170 teraflops of performance) to go through this data and make sense of it all.

“You can take a large amount of data that would help people talk to each other on the internet, and you can train, basically, a chatbot, but you can do it in a way that the computer learns how language works and how people interact,” Karpathy added.

Even better, the new supercomputer is designed to function with OpenAI’s existing software. All that’s needed is to scale it up.

“We won’t need to write any new code, we’ll take our existing code and we’ll just increase the size of the model,” says OpenAI scientist Ilya Sutskever. “And we’ll get much better results than we have right now.”

NVIDIA CEO Jen-Hsun Huang slides open the DGX-1’s GPU tray at OpenAI’s headquarters in San Francisco.
Image credits NVIDIA

share Share

This Moth’s Wings Create a Mind-Bending 3D Optical Illusion to Avoid Being Eaten

A moth's flat wings fool predators into seeing an inedible 3D leaf.

Scientists Just Linked Two Quantum Computers With "Quantum Teleportation" for the First Time and It Changes Everything

The future of computing might not be one giant quantum machine but many linked together.

Human-like Teeth Grown in Pigs Could Make Dental Implants a Thing of the Past

It's a glimpse into the future of tooth replacement.

Paleolithic culture cannibalized their enemies — and maybe their friends as well

In the 19th century, archaeologists in Poland unearthed a stunning cave filled with prehistoric secrets. The Maszycka Cave, as it’s called, once sheltered Magdalenian people 18,000 years ago. Now, a new study offers compelling evidence that the cave was the site of a grisly ritual — or perhaps something even darker. Did these ancient people […]

Did astronomers find the most volcanic planet in the universe?

Sulfur dioxide might explain the planet's fiery surface.

AI Is Supposed to Make You More Productive — It's Making You Dumber and Overconfident

Generative AI is supposed to make life easier. It drafts emails, summarizes documents, and even generates creative content, helping you offload some of that dreaded cognitive effort. But according to a new study from Carnegie Mellon University and Microsoft Research, it may also be making you dumber in the process. The study, based on a […]

Beavers Built a $1.2M Dam for Free — And Saved a Czech River

A Czech project that was stalled for years is now completed — by beavers.

A Single High Dose of Creatine Might Help the Brain to Power Through Sleep Deprivation

From the gym to your brain: the surprising new use of creatine.

A Spoonful of Peanut Butter Might Be the Key to Overcoming Peanut Allergies

A new study suggests that children with peanut allergies may be able to safely build tolerance through a simple, cost-effective treatment.

Inside China's 600 MPH Floating Train Faster Than a Boeing 737

It's basically a Hyperloop design on steroids.