The Georgia Tech Center for Music Technology, led by Gil Weinberg, has a reputation for doing incredible musical things with robots, with a mix of creativity and technical expertise in robotics and AI. We've seen projects like a cybernetic second arm for a drummer, a cybernetic third arm (!) for a drummer, and a bunch of interesting research on ways that robots can dynamically collaborate with humans in the context of improvisational music. That last thing usually features Shimon, a four-armed expressive robotic marimba player, which can analyze music in real time and improvise along with human performers. It's an impressive thing to watch, but Shimon's talents were mostly restricted to riffing on what other human musicians were doing. Now, Shimon has leveraged deep learning to create structured and coherent and totally unique compositions of its very own.
Shimon, a four-armed, marimba playing robot, is writing and playing its own music using deep learning. This is the first of its two songs. A marimba-playing robot with four arms and eight sticks is writing and playing its own compositions in a lab at the Georgia Institute of Technology. The pieces are generated using artificial intelligence and deep learning. Researchers fed the robot nearly 5,000 complete songs -- from Beethoven to the Beatles to Lady Gaga to Miles Davis -- and more than 2 million motifs, riffs and licks of music.
Having four arms would be an advantage for any musician, but they are just one of the many unique features of Shimon, the marimba playing robot. The machine has used its artificial intelligence and deep learning algorithms to analyse more than two million motifs, riffs and licks of music to create its own masterpiece. Aside from giving the machine the first four bars to use as a starting point, no humans are involved in either the composition or the performance of the music. Shimon (pictured) has used its artificial intelligence and deep learning algorithms to analyse over two million motifs, riffs and licks of music to create and perform its own masterpiece. Shimon is the creation of Mason Bretan, a PhD student at Georgia Tech, that uses eight sticks to play the wooden percussion instrument.
In a first, scientists have developed a marimba-playing robot that uses artificial intelligence to create its own music inspired by the works of musicians like Beethoven and Mozart. The robot with four arms and eight sticks writes and plays its own compositions on a marimba, using a database of well-known pop, classical and jazz artists. Researchers at Georgia Institute of Technology in the US fed the robot nearly 5,000 complete songs – from Beethoven to the Beatles to Lady Gaga to Miles Davis. They worked with the robot named'Shimon' for seven years, enabling it to listen to music played by humans and improvise over pre-composed chord progressions. Shimon is now a solo composer generating the melody and harmonic structure on its own, researchers said.