homehome Home chatchat Notifications


How a musician and his robots improvise together

In the video above, you can see PhD student Mason Bretan from the Robot Musicianship Group at Georgia Tech in the US jam with some of the robots he helped create. The robots got rhythm, and they got the skills. Just look at that amazing marimba solo at the middle of the video – that was completely […]

Mihai Andrei
January 26, 2015 @ 10:23 am

share Share

In the video above, you can see PhD student Mason Bretan from the Robot Musicianship Group at Georgia Tech in the US jam with some of the robots he helped create. The robots got rhythm, and they got the skills. Just look at that amazing marimba solo at the middle of the video – that was completely improvised.

“The piece is called “What You Say” and is inspired by the high energy funk piece, “What I Say”, from Miles Davis’ Live-Evil album. The incredible brilliance of the musicians on that album (as well as the numerous other great musicians around the world) are not only an inspiration to me and my own musical and instrumental aspirations, but also set the standard for the level of musicianship that I hope machines will one day achieve. And through the power of artificial intelligence, signal processing, and engineering I firmly believe it is possible for machines to be artistic, creative, and inspirational”, Bretan wrote in his Youtube description.

The lab has been working on the robots for the past six years, with the ultimate goal of enabling them to compose jazz music and grooving to it. The star of the band is Shimon, the robot who holds the mallets. Since Bretan has joined the team, they’ve also developed the three smartphone-connected, bopping members – Shimis. Shimis added a more electronic feel and some dance moves to the existing music.

“I’m always trying something new with the robots, and sometimes they surprise me with something that’s sort of out there or pretty cool,” Bretan said in an interview.

In order to do this, scientists have actually had to break down the music theory and translate it into a sort of programming language. Then, in order to progress, they had to make the robots understand what they can do and what their limitations are.

“Because their note generating algorithms rely on their physical constraints, if you give the same algorithm to a different robot (like a marimba playing robot with one arm or 10 arms), you will get different musical behaviours and outcomes,” Bretantold Mashable via email.

It’s important to note that the goal isn’t to replace human musicians – but rather to explore the creativity that robots might harbor. It seems a bit strange to say that robots harbot creativity, but that’s basically how you call exploring different musical patterns, isn’t it? Even if it’s based on preprogrammed algorithms, I think you can still call it creativity.

A musician since the age of 4, Bretan blended his passion for music with his interest in programming and robotics to develop robot musicians.

“I do this not only because of the interesting science behind it, but also because I think that autonomous machines have artistic potential and the ability to be creative”, Bretan added.

His project and dissertation will likely be finished in 2015.

share Share

These Moths in Australia Use the Milky Way as a GPS to Fly 1,000 Kilometers

A threatened Australian insect joins the exclusive club of celestial navigators.

A Giant Roman Soldier Lost His Shoe Near Hadrian's Wall 2,000 Years Ago

Roman soldiers were fit, but this one was built differently.

Astronomers Found a Volcano Hiding in Plain Sight on Mars

It's not active now, and it hasn't been active for some time, but it's a volcano.

The US just started selling lab-grown salmon

FDA-approved fish fillet now served at a Portland restaurant

Climate Change Unleashed a Hidden Wave That Triggered a Planetary Tremor

The Earth was trembling every 90 seconds. Now, we know why.

Archaeologists May Have Found Odysseus’ Sanctuary on Ithaca

A new discovery ties myth to place, revealing centuries of cult worship and civic ritual.

The World’s Largest Sand Battery Just Went Online in Finland. It could change renewable energy

This sand battery system can store 1,000 megawatt-hours of heat for weeks at a time.

A Hidden Staircase in a French Church Just Led Archaeologists Into the Middle Ages

They pulled up a church floor and found a staircase that led to 1500 years of history.

The World’s Largest Camera Is About to Change Astronomy Forever

A new telescope camera promises a 10-year, 3.2-billion-pixel journey through the southern sky.

AI 'Reanimated' a Murder Victim Back to Life to Speak in Court (And Raises Ethical Quandaries)

AI avatars of dead people are teaching courses and testifying in court. Even with the best of intentions, the emerging practice of AI ‘reanimations’ is an ethical quagmire.