cereproc
SophiaPop: Experiments in Human-AI Collaboration on Popular Music
Hanson, David, Storm, Frankie, Huang, Wenwei, Krisciunas, Vytas, Darrow, Tiger, Brown, Audrey, Lei, Mengna, Aylett, Matthew, Pickrell, Adam, Robot, Sophia the
A diverse team of engineers, artists, and algorithms, collaborated to create songs for SophiaPop, via various neural networks, robotics technologies, and artistic tools, and animated the results on Sophia the Robot, a robotic celebrity and animated character. Sophia is a platform for arts, research, and other uses. To advance the art and technology of Sophia, we combine various AI with a fictional narrative of her burgeoning career as a popstar. Her actual AI-generated pop lyrics, music, and paintings, and animated conversations wherein she interacts with humans real-time in narratives that discuss her experiences. To compose the music, SophiaPop team built corpora from human and AI-generated Sophia character personality content, along with pop music song forms, to train and provide seeds for a number of AI algorithms including expert models, and custom-trained transformer neural networks, which then generated original pop-song lyrics and melodies. Our musicians including Frankie Storm, Adam Pickrell, and Tiger Darrow, then performed interpretations of the AI-generated musical content, including singing and instrumentation. The human-performed singing data then was processed by a neural-network-based Sophia voice, which was custom-trained from human performances by Cereproc. This AI then generated the unique Sophia voice singing of the songs. Then we animated Sophia to sing the songs in music videos, using a variety of animation generators and human-generated animations. Being algorithms and humans, working together, SophiaPop represents a human-AI collaboration, aspiring toward human AI symbiosis. We believe that such a creative convergence of multiple disciplines with humans and AI working together, can make AI relevant to human culture in new and exciting ways, and lead to a hopeful vision for the future of human-AI relations.
- Asia > China > Hong Kong (0.05)
- North America > United States > Massachusetts > Suffolk County > Boston (0.04)
- Europe > United Kingdom (0.04)
- (2 more...)
- Research Report (0.40)
- Overview (0.34)
- Media > Music (1.00)
- Leisure & Entertainment (1.00)
How Deepfakes Make Disinformation More Real Than Ever
One video shows Barack Obama using an obscenity to refer to U.S. President Donald Trump. Another features a different former president, Richard Nixon, performing a comedy routine. But neither video is real: The first was created by filmmaker Jordan Peele, the second by Jigsaw, a technology incubator within Alphabet, Inc. Both are examples of deepfakes, videos or audios that use artificial intelligence to make someone appear to do or say something they didn't. The technology is a few years old and getting better.
- North America > United States > Virginia (0.05)
- North America > United States > Texas (0.05)
- North America > United States > New York (0.05)
- (6 more...)
This tech company used AI to give a radio host his voice back after it was robbed by a rare medical disorder
A tech company based in Scotland has built a new voice for US journalist Jamie Dupree, who lost the ability to speak due to a rare neurological condition. Dupree is a Washington-based political journalist and radio host for local broadcaster WSB Atlanta. He began to lose his voice in 2016 and was diagnosed with tongue protrusion dystonia, a neurological condition which causes people to lose control over their tongues, making speech almost impossible. While Dupree continued to work as a journalist, losing his voice meant he had to come off the air. After a two-year absence, he will be back broadcasting this month with a new AI-generated voice on WSB Atlanta and other Cox Media-owned stations in Orlando, Jacksonville, Dayton, and Tulsa.
AI gives journalist his voice back
A US radio journalist who lost his voice two years ago will soon return to the air, thanks to artificial intelligence. Jamie Dupree, 54, a political radio journalist with Cox Media Group, is unable to talk due to a rare neurological condition. A new voice was created for him by Scottish technology company CereProc. CereProc trained a neural network to predict how Mr Dupree would talk, using samples from his old voice recordings. "This has saved my job and saved my family from a terrible financial unknown," Mr Dupree told the BBC.
- Media > News (0.85)
- Health & Medicine > Therapeutic Area > Neurology (0.37)