We identify semantically coherent, context-consistent network components in large language models (LLMs) using coactivation of sparse autoencoder (SAE) features collected from just a handful of prompts. Focusing on concept-relation prediction tasks, we show that ablating these components for concepts (e.g., countries and words) and relations (e.g., capital city and translation language) changes model outputs in predictable ways, while amplifying these components induces counterfactual responses. Notably, composing relation and concept components yields compound counterfactual outputs. Further analysis reveals that while most concept components emerge from the very first layer, more abstract relation components are concentrated in later layers. Lastly, we show that extracted components more comprehensively capture concepts and relations than individual features while maintaining specificity. Overall, our findings suggest a modular organization of knowledge accessed through compositional operations, and advance methods for efficient, targeted LLM manipulation.

The £5.30 orange juice that tells the story of why supermarket prices are sky high There has been more than a bitter twang in the glasses at British breakfast tables. Only five years ago, a typical supermarket own-label carton of orange juice could be bought for 76p for 1 litre. One colleague was outraged to be sent a bill for £9 for a glass of hangover-busting orange juice and lemonade at an unassuming little restaurant in Kent. Asked why so much, she was told that the orange juice - albeit freshly squeezed - accounted for £5.30 of the price. Yet as costs have surged, the taste is changing too, with certain manufacturers substituting oranges for mandarins to cut costs.

The head of global theme park giant Merlin Entertainments says its biggest competition is people choosing to stay at home on their phones and other devices. Fiona Eastwood says a day out at one of its UK attractions - which include Legoland, Thorpe Park and Alton Towers - was the perfect antidote for spiralling screen time. In a wide-ranging BBC Big Boss Interview, the chief executive reflected on challenges in the forthcoming Budget, big brand partnerships, and how its customers were responding to cost-of-living pressures. Eastwood also highlighted the importance of seasonal attractions to its customers - with Halloween now rivalling its summer season in driving profits at some attractions. Having been in the job since February, Eastwood has taken over at a time when her industry is facing challenges from a dip in consumer confidence.

The Ukrainian city of Chernihiv is in total blackout following what the authorities describe as a massive assault by Russian missiles and drones, with hundreds of thousands of people affected. Across the wider Chernihiv region, four people are reported to have been killed as residential neighbourhoods were struck in the town of Novhorod-Siverskyi. Ten others were injured, including a 10-year-old girl. The country's most northerly region is the latest to be hit in an intensifying series of attacks on civilian infrastructure as Russia targets energy supplies, the rail network, homes and businesses in its full-scale invasion of Ukraine. I personally heard the drones flying overhead, 55-year-old Oleksandr Babich said.

The Netherlands's data protection watchdog has cautioned citizens against consulting with artificial intelligence on how to vote, warning that popular chatbots provide a "highly distorted and polarised view" of politics. The Dutch Data Protection Authority said on Tuesday that an increasing number of voters were using AI to help decide who to vote for, despite the models offering "unreliable and clearly biased" advice. The research found that the chatbots more often recommended parties on the fringes of the political spectrum when asked to identify the three choices that best matched the policy preferences of 1,500 fictitious voter profiles. In more than half of cases, the AI models identified the hard-right Party for Freedom (PVV) or left-wing Green Left-Labour Party as the top choice, the watchdog said. Parties closer to the political middle ground - such as the right-leaning People's Party for Freedom and Democracy and the centre-left Democrats 66 - were recommended much less often, according to the watchdog.

How successful is Ukraine's'gas war' against Russia? How will Putin travel to Hungary with an ICC arrest warrant? How much of Europe's oil still comes from Russia? How Russia's new tactics pose new winter threat to Ukraine The Russian drone strike was surgically precise and destroyed a giant transformer at a key power station in the Ukrainian capital. "There's nothing left to repair," Mykola Svyrydenko, who lives close to Thermal Station 5, a sprawling, Soviet-era structure with two giant steam pipes that provides electricity and heat to hundreds of thousands of Kyiv's residents, told Al Jazeera.

Trump henchman's'Nazi texts' emerge as racist message crisis tears through White House Kate and William lead bid to exile Andrew and Fergie from Royal Lodge as public anger grows at his taxpayer-funded luxury: Waleses'can't abide' Prince and are pushing for him to leave, author claims Meghan's hit a trashy new low. JILLIAN MICHAELS: The trans trend is reversing. Now it's time to admit what's really been driving this extremist fad all along Napa tycoon is accused of slamming Rolls Royce into women because he couldn't find a parking spot... now his scandalous divorce secrets are exposed I know why Prince Harry and Andrew were'cut so much slack' by the late Queen - it's to do with her father and sister, reveals ROBERT HARDMAN The Prince Harry interview that left the Royals reeling and resumed the war against them, with even Downing Street forced to issue a statement! Married Congressman had alleged affair with aide... before she set herself on fire: Bombshell revelation as police block release of 911 call and other evidence Trapped on death island: 'Marooned' Russian troops are starving to death and 5,000 have died after being cut off from other Russian forces in Ukraine Apple Martin's music debut is likened to an'off-key, drunken karaoke performance' and proof that'nepotism is killing art' - as she attempts to follow in Coldplay star dad Chris' footsteps Fox News host Jesse Watters stunned as he admits his MOM joined millions protesting Trump at'No Kings' rally RFK Jr's desperate proposition to Cheryl Hines after his sexting fiasco pushed their marriage to the brink'Woke to blame for Louvre robbery': Female museum security chief accused of being a'diversity hire' comes under fire as politicians say heist has made France'the laughing stock of the world' Bombshell twist in Nicole Kidman and Keith Urban's divorce: 'She'd get back with him in a heartbeat,' says insider who's known her for years - as her inner circle reacts to'girlfriend' rumours Bella Hadid under fire over'offensive' social media posts she made as a teenager: 'Should've known better' Ellen Greenberg's parents reveal harrowing final phone call with daughter's ex fiancé after shock suicide ruling The new drug obsessions of the posh'wines and lines' mums: They scoff at cocaine now - but these three vices are the talk of the private school gate: JANA HOCKING Channel your inner John Wayne! 'Tough guy' walk used by western movie heroes makes you appear more powerful When it comes to swagger, nobody does it quite like John Wayne. His distinctive wide-based walk helped solidify his'tough guy' persona that became iconic in his western films.

Drone attack in Sudan threatens Khartoum airport's reopening: Reports A series of drone attacks has hit areas in Sudan's capital, including near Khartoum international airport, a day before its long-awaited reopening, according to the AFP news agency and Sudanese media reports. Witnesses told AFP they heard drones over central and southern Khartoum early on Tuesday. A wave of explosions was reported near the airport between 4am and 6am (02:00-04:00 GMT). The airport has been shut since fighting erupted in April 2023 between the Sudanese army and the paramilitary Rapid Support Forces (RSF), badly damaging infrastructure. Sudan's Rakoba News, citing witnesses, reported more than eight blasts in and around the airport.

A tornado tore through Val-d'Oise, north of Paris, on Monday, toppling construction cranes, damaging properties and uprooting trees in its path. One person was killed and four others critically injured, authorities said. The town of Ermont, about 20 km (13 miles) northeast of Paris was hardest hit by the sudden twister, which caused damage in multiple districts. Interior Minister Laurent Nunez said on the X social media platform that it had been a storm of rare intensity. Drone footage shows blaze destroying the historic Bernaga Monastery in Italy.

The Business Secretary has insisted the government is making it easier for businesses by reducing red tape. Peter Kyle defended Labour's approach to business, telling the BBC it will implement changes in a way that is pro-worker and pro-business. Ahead of next month's Budget, Chancellor Rachel Reeves is launching a crackdown on needless form-filling for businesses at the first-ever Regional Investment Summit in Birmingham. The government has been criticised by firms who say increased employers' National Insurance contributions and the Employment Rights Bill add to the burdens facing businesses. The Chancellor will say at the Birmingham summit on Tuesday that the changes will save firms almost £6bn a year.