homehome Home chatchat Notifications


Scientists connect brain to a basic tablet - paralyzed patient googles with ease

We're living in the future.

Mihai Andrei
October 29, 2015 @ 7:30 am

share Share

It’s things like this that make you feel like we’re living in the future. For patient T6, 2014, it was an amazing year; she got the chance to move from 1980s DOS to modern day Android – literally. She learned how to use a tablet with her brain.

This new technology allows paralyzed users to use an Android tablet just like a regular user does. Photo by Timothy Muza.

This new technology allows paralyzed users to operate an Android tablet just like a regular user does. Photo by Timothy Muza.

Like millions of other people in the world, T6 suffers from severe paralysis. Some people have it from accidents, some have it from strokes or diseases. She has it from amyotrophic lateral sclerosis (also known as Lou Gehrig’s disease). She retains her wit and love for red lipstick, but her body has mostly stopped listening to her. Communicating with the outside world was extremely complicated.

Technology has advanced to a point where there is hope for people like her; however, while a limited variety of techniques exist, actually enabling paralyzed people to efficiently communicate with the outside world is very complicated and difficult

“We really wanted to move these assisted technologies towards clinical feasibility,” said Dr. Paul Nuyujukian, a neuroengineer and physician from Stanford University, in a talk at the 2015 Society for Neuroscience annual conference that took place this week in Chicago.

With this in mind, they invented what they call a neural prosthetic: it acts like a bridge, allowing her brain to communicate with a device such as a tablet. They installed a tiny chip inside her brain; this chip decodes signals from her brain into sophisticated algorithms that allow her to control a mouse for example. But even this turned out to be very expensive – and Nuyujukian set out to fix that.

Their breakthrough came when they realized that controlling a cursor, from a mental point of view, is very similar to pointing a finger on a screen and moving it around – something that many people do every day, and that is well documented from a mental activity perspective.

“We were going to design our own touchscreen hardware, but then realized the best ones were already on the market, laughed Nuyujukian, so we went on Amazon instead and bought a Nexus 9 tablet.”

They rewired the tablet so that brain waves could control where the touchscreen clicks – the change was surprisingly easy.

“Basically the tablet recognized the prosthetic as a wireless Bluetooth mouse,” explained Nuyujukian. We pointed her to a web browser app and told her to have fun.

The patient found it surprisingly easy to google and browse around – she looked for some information on gardening, taking full advantage of the autocomplete feature. It’s not just a pretty interface – she now has access to the entire Android interface. She is now connected to the web.

According to previous studies, this relatively cheap connection can last at least two years without requiring repair or fixing, and researchers are now working on ways to expand its lifespan. But even for two waves, the achievement is spectacular.

“We set out to utilize what’s already been perfected in terms of the hardware to make the experience more pleasant,” said Nuyujukian. “We’ve now showed that we can expand the scope of our system to a standard tablet.”

They are also working on increasing the capabilities of the user, implementing click-and-drag and multi-touch maneuvers. They also want to expand to other operating systems.

“Our goal is to unlock the full user interface common to general-purpose computers and mobile devices,” said Nuyujukian. “This is a first step towards developing a fully-capable brain-controlled communication and computer interface for restoring function for people with paralysis.”

share Share

Ronan the Sea Lion Can Keep a Beat Better Than You Can — and She Might Just Change What We Know About Music and the Brain

A rescued sea lion is shaking up what scientists thought they knew about rhythm and the brain

Giant Brain Study Took Seven Years to Test the Two Biggest Theories of Consciousness. Here's What Scientists Found

Both came up short but the search for human consciousness continues.

The Fat Around Your Thighs Might Be Affecting Your Mental Health

New research finds that where fat is stored—not just how much you have—might shape your mood.

Everyone else’s opinion is secretly changing yours (and that's huge for disinformation)

Public opinion may be swaying you a lot more than you think.

Magic Mushroom Use Is Soaring in the U.S. With More Americans Turning to Psilocybin Than Cocaine or Meth

Use is up across all age groups, with rising poison calls and shifting perceptions

What happens in your brain when your mind goes completely blank — neuroscientists say it's a distinct mental state

Mind blanking isn’t daydreaming. It's something more akin to meditation — but not quite the same.

Scientists Just Found the Clearest Evidence Yet That Lucid Dreaming Is a Real State of Consciousness

People who are aware they are dreaming show distinct brain patterns.

The UAE Wants AI to Write Its Laws — What Could Possibly Go Wrong?

But can machines really grasp justice, fairness, and human rights?

Scientists Invent a Color Humans Have Never Seen Before

Meet "olo": a vivid, hyper-saturated blue-green that can't be captured by screens or paint.

Here's why you should stop working out before bedtime

Even hours before bedtime, workouts can be a problem.