We introduce a new class of generative models for music called live music models that produce a continuous stream of music in real-time with synchronized user control. We release Magenta RealTime, an open-weights live music model that can be steered using text or audio prompts to control acoustic style. On automatic metrics of music quality, Magenta RealTime outperforms other open-weights music generation models, despite using fewer parameters and offering first-of-its-kind live generation capabilities. We also release Lyria RealTime, an API-based model with extended controls, offering access to our most powerful model with wide prompt coverage. These models demonstrate a new paradigm for AI-assisted music creation that emphasizes human-in-the-loop interaction for live music performance.

Sparse autoencoders (SAEs) are designed to extract interpretable features from language models by enforcing a sparsity constraint. Ideally, training an SAE would yield latents that are both sparse and semantically meaningful. However, many SAE latents activate frequently (i.e., are \emph{dense}), raising concerns that they may be undesirable artifacts of the training procedure. In this work, we systematically investigate the geometry, function, and origin of dense latents and show that they are not only persistent but often reflect meaningful model representations. We first demonstrate that dense latents tend to form antipodal pairs that reconstruct specific directions in the residual stream, and that ablating their subspace suppresses the emergence of new dense features in retrained SAEs -- suggesting that high density features are an intrinsic property of the residual space. We then introduce a taxonomy of dense latents, identifying classes tied to position tracking, context binding, entropy regulation, letter-specific output signals, part-of-speech, and principal component reconstruction. Finally, we analyze how these features evolve across layers, revealing a shift from structural features in early layers, to semantic features in mid layers, and finally to output-oriented signals in the last layers of the model. Our findings indicate that dense latents serve functional roles in language model computation and should not be dismissed as training noise.

Doctor's husband who left daughter, 2, to die in hot car while watching adult movies DIES day he was to be locked up I keep hearing the same mortifying whisper about Meghan and Harry... their American dream is about to come crumbling down: MEGYN KELLY Baby girl with horrifying side effects, mom couldn't breathe and dad seriously sick... after simple error turned dream home into a death trap Super hot seductresses entrap Silicon Valley nerds and steal vital secrets... so we tracked one down and found out how Bryan Kohberger's staggering prison slush fund is revealed as prosecutors demand he give money to Idaho victims' families Why screaming female migrant who shouted'Help me, I have papers!' was arrested by ICE at Salt Lake City airport Inside Kate and William's forever home: Princess is kitting out Forest Lodge in her preferred'classic contemporary style' to create a'lovely but absolutely inoffensive' look Somali-American who said protecting illegal migrants from Trump was top priority LOSES bid to become America's wokest mayor Influencer Barbara Jankavski who was known online as'Human Barbie' dies age 31 My girlfriend's new body modification is repulsive. She says she did it for me... This Leftist election landslide was caused by the same vile disease that's triggered a GOP civil war. Famous American writer's son, 19, arrested over alleged plot to bomb Detroit gay bars in ISIS terror attack The murder that haunts the Kennedys: Martha Moxley's loved ones reveal their truth in the FREE The Crime Desk newsletter... as accused cousin cleared in killing breaks cover Taylor Momsen admits Gossip Girl role was'killing' her during'long battle' to quit hit series Inside Zohran Mamdani's woke, celebrity filled victory party after socialist won NYC mayoral election Ariana Grande looks worlds away from her'clean-girl look' as she rocks black curly hair and skinny jeans in a major throwback snap from 18 years ago Three astronauts already in space for six months are now stranded in orbit after their craft may have been damaged by dangerous debris floating around Earth . China's Manned Spaceflight Agency (CMSA) has revealed that crew from its Shenzhou 20 mission will need to stay on board the Chinese station Tiangong.

Breakthroughs, discoveries, and DIY tips sent every weekday. Japan is calling in its army to wrestle its ongoing bear problem . Last month, the country's Ministry of the Environment reported that Asian black bear or moon bear () and brown bear () populations have attacked over 100 people since March. With at least 10 fatalities among the tally, the government announced on November 5 that it is stepping up control efforts by deploying soldiers to Akita prefecture on the island of Honshu in northern Japan. In a statement to reporters, Akita's Governor Kenta Suzuki called the situation "desperate," noting that sightings and attacks are now occurring daily.

Foreign-owned apps secretly collect personal data from users and sell it to overseas data brokers, with retirees being particularly vulnerable to targeted scams.

This material may not be published, broadcast, rewritten, or redistributed. Quotes displayed in real-time or delayed by at least 15 minutes. Market data provided by Factset . Powered and implemented by FactSet Digital Solutions . Mutual Fund and ETF data provided by Refinitiv Lipper .

New research finds that walking just 3,000 to 5,000 steps per day slows tau protein buildup and delays Alzheimer's-related brain changes in at-risk older adults.

Plus loud rats and other weird things we learned this week. Breakthroughs, discoveries, and DIY tips sent every weekday. What's the weirdest thing you learned this week? Well, whatever it is, we promise you'll have an even weirder answer if you listen to's hit podcast . It's your new favorite source for the strangest science-adjacent facts, figures, and Wikipedia spirals the editors of can muster.

Sarah Martin investigates the virtual world of the children's online game Roblox with the profile of an eight-year-old girl with parental control settings turned on. Sarah Martin investigates the virtual world of the children's online game Roblox with the profile of an eight-year-old girl with parental control settings turned on. In seven days my young alter ego is cyberbullied and attacked while exploring clubs, casinos and horror games, all with parental controls in place. Is the platform safe for children - or an'X-rated paedophile hellscape'? Wed 5 Nov 2025 09.00 ESTLast modified on Wed 5 Nov 2025 09.01 EST I am an eight-year-old girl, standing near-naked in a room full of strangers. As the room spins and zooms upon me and people glide around me, I clock my features.

New York's new mayor Zohran Mamdani tells Trump'I have four words for you' in blistering victory speech quoting his socialist hero, bragging about'toppling a dynasty' and promising a'new dawn' Driver screaming'Allahu Akbar' ploughs in to pedestrians'trying to hit everyone he encountered' on French holiday island leaving ten injured This Leftist election landslide was caused by the same vile disease that's triggered a GOP civil war. Amazon signals it's finally fed up with Whole Foods' sluggish sales - and is making sweeping, controversial changes Why Mamdani's socialist revolution in New York has sparked a civil war for Democrats... and Trump is secretly loving it Simone Biles details all the plastic surgery she's had after her boob job this summer Inside Kate and William's forever home: Princess is kitting out Forest Lodge in her preferred'classic contemporary style' to create a'lovely but absolutely inoffensive' look REVEALED: Fattest states in America ranked... including region where three-quarters of residents are obese Now he's dead, here's the full story of what happened that day... and the ghastly aftermath no one knows about Shocking moment Mexico's president is groped by man who grabs her breasts and tries to kiss her Miss Universe contestant called'dumb' in humiliating dressing-down by official hits back with powerful speech as furious organisers condemn her treatment and he issues grovelling apology Hollywood A-listers may be blacklisted for'antisemitism' under Paramount's new anti-woke leadership Nepo baby turns heads at Glamour Women Of The Year Awards in a glitzy gold sequin feathered gown - but can YOU guess who her A-list mother is? New footage reveals the moments before football manager collapsed and died mid-match, leaving his players in disbelief, as it emerges he'complained about fish he had eaten' hours before Texas teen'tears masterpiece from wall at the Met in unhinged meltdown' before being handed in by his MOTHER Scientists have been faced with a huge dilemma, as research reveals that reducing air pollution has increased global warming . While smog kills millions of people every year, it also whitens clouds - making them more reflective. So by slashing air pollution, we're inadvertently diminishing the brightness of clouds, which are key regulators of global temperature.