Four-Armed Marimba Robot Uses Deep Learning to Compose Its Own Music

IEEE Spectrum Robotics

The Georgia Tech Center for Music Technology, led by Gil Weinberg, has a reputation for doing incredible musical things with robots, with a mix of creativity and technical expertise in robotics and AI. We've seen projects like a cybernetic second arm for a drummer, a cybernetic third arm (!) for a drummer, and a bunch of interesting research on ways that robots can dynamically collaborate with humans in the context of improvisational music. That last thing usually features Shimon, a four-armed expressive robotic marimba player, which can analyze music in real time and improvise along with human performers. It's an impressive thing to watch, but Shimon's talents were mostly restricted to riffing on what other human musicians were doing. Now, Shimon has leveraged deep learning to create structured and coherent and totally unique compositions of its very own.


Four-Armed Marimba Robot Uses Deep Learning to Compose Its Own Music

IEEE Spectrum Robotics

The Georgia Tech Center for Music Technology, led by Gil Weinberg, has a reputation for doing incredible musical things with robots, with a mix of creativity and technical expertise in robotics and AI. We've seen projects like a cybernetic second arm for a drummer, a cybernetic third arm (!) for a drummer, and a bunch of interesting research on ways that robots can dynamically collaborate with humans in the context of improvisational music. That last thing usually features Shimon, a four-armed expressive robotic marimba player, which can analyze music in real time and improvise along with human performers. It's an impressive thing to watch, but Shimon's talents were mostly restricted to riffing on what other human musicians were doing. Now, Shimon has leveraged deep learning to create structured and coherent and totally unique compositions of its very own.


A four-armed robot can now improvise music as well as human bandmates

#artificialintelligence

He bobbed his head with the groove, and leaned way in when he wanted to play more complicated melodies, rocking and rolling with the beat of the jam. This wasn't a your average jazz band member, though--this was Shimon, a four-armed robot marimba player built by the Georgia Institute of Technology to be able to listen to music, improvise, and play along with human musicians. At a performance at Moogfest, a four-day music and technology festival in Durham, North Carolina, Gil Weinberg, the lead researcher at Georgia Tech's Center for Music Technology, demonstrated what he and his lab have been working on for the past 12 years. Their efforts have aimed at augmenting the creative capabilities of humans with robotics. That can mean robots like Shimon, which uses machine-learning programs trained on music theory and a wide range of musical styles, from chamber music to dubstep, to be able to add a superhuman element to musical performances, playing chord structures that would be physically impossible for humans to hit.


Robot Uses Deep Learning and Big Data to Write and Play its Own Music

#artificialintelligence

Shimon, a four-armed, marimba playing robot, is writing and playing its own music using deep learning. This is the first of its two songs. A marimba-playing robot with four arms and eight sticks is writing and playing its own compositions in a lab at the Georgia Institute of Technology. The pieces are generated using artificial intelligence and deep learning. Researchers fed the robot nearly 5,000 complete songs -- from Beethoven to the Beatles to Lady Gaga to Miles Davis -- and more than 2 million motifs, riffs and licks of music.


New artificial intelligence robot can create its own music

#artificialintelligence

In a first, scientists have developed a marimba-playing robot that uses artificial intelligence to create its own music inspired by the works of musicians like Beethoven and Mozart. The robot with four arms and eight sticks writes and plays its own compositions on a marimba, using a database of well-known pop, classical and jazz artists. Researchers at Georgia Institute of Technology in the US fed the robot nearly 5,000 complete songs – from Beethoven to the Beatles to Lady Gaga to Miles Davis. They worked with the robot named'Shimon' for seven years, enabling it to listen to music played by humans and improvise over pre-composed chord progressions. Shimon is now a solo composer generating the melody and harmonic structure on its own, researchers said.