Genre
On Language Generation in the Limit with Bounded Memory
Kleinberg, Jon, Mehrotra, Anay, Saberi, Amin, Velegkas, Grigoris
We study language generation in the limit under bounded memory. In this task, a learner observes examples from an unknown target language one at a time and must eventually output only new valid examples. Prior work assumes access to the entire history, a strong assumption since realistic algorithms retain limited past information. Classical work in learning theory shows memory constraints dramatically alter learnability; we extend this to language generation. First, we study memoryless generators. Under a mild enumeration restriction, every countable collection of infinite languages remains generable without memory. Without this restriction, we exactly characterize when memoryless generation is possible. For finite collections, we characterize the optimal minimax density achievable by memoryless generators -- the best density guaranteed against any collection of a given size. This combinatorial bound relies on Sperner's theorem and symmetric chain decompositions. We further show that a sliding window of the last $W$ examples does not improve this worst-case density, whereas allowing it to store $b$ adaptively chosen past examples improves the achievable density for every $b \geq 1$. Finally, we revisit identification in the limit, where the learner must converge to a single correct hypothesis for the target language. We focus on its incremental variant, where the learner remembers only its previous guess. Here, although exact identification fails on a collection of just three languages, a mild relaxation requiring convergence to an ``approximate'' version of the target is achievable for every finite collection. These results show bounded memory affects these tasks differently: generation remains achievable for every countable collection, while density and identification are confined to finite collections, with guarantees weakening as the collection grows.
Reasoning with Sampling: Cutting at Decision Points
Zhou, Felix, Mehrotra, Anay, Liu, Quanquan C.
Frontier reasoning models are produced by posttraining base language models with reinforcement learning. Recent work has challenged this by showing that sampling from a sharpened version of the base model's distribution, a so-called power distribution, elicits comparable reasoning without additional training, curated datasets, or verifiers. However, making this method practical requires efficiently sampling from the power distribution. A sampler needs to "mix" to the power distribution, which necessitates moving between modes of the target distribution; intuitively, e.g., trying different reasoning strategies. The samplers proposed in prior works repeatedly select a "cut" position in the current reasoning trace uniformly at random and resample the suffix from that position onward. However, reasoning traces typically contain a few consequential decisions (e.g., the choice of proof strategy or algorithm), and we observe that a uniformly chosen cut tends to rewrite local details rather than revisit decision points. We introduce an algorithm (Entropy-Cut Metropolis-Hastings) that uses the base model's next-token entropy as a proxy to identify key decision points and resample from those positions. We empirically verify that entropy jumps are a useful proxy for decision points and, in a stylized model of reasoning, prove that our method's mixing time scales with the number of decisions in a trace rather than with the number of tokens, which can be much larger. Across MATH500, HumanEval, GPQA Diamond, and AIME26, our method consistently improves over baselines and RL-trained models.
Pigeons use their livers to sense Earth's magnetic field
Pigeons use their livers to sense Earth's magnetic field Special immune cells may be one piece of their internal compass. More information Adding us as a Preferred Source in Google by using this link indicates that you would like to see more of our content in Google News results. The homing pigeons in this study were trained to fly 12.4 miles back to their aviary. Breakthroughs, discoveries, and DIY tips sent six days a week. By signing up, you confirm you are 16+, will receive newsletters and promotional content and agree to our Terms of Use and acknowledge the data practices in our Privacy Policy .
Stan Lee's voice and likeness have been resurrected, thanks to AI
Stan Lee's voice and likeness have been resurrected, thanks to AI Stan Lee's voice and likeness have been resurrected, thanks to AI ElevenLabs can now offer the late Marvel icon as part of its AI-generated voice portfolio. Marvel Comics legend Stan Lee is the latest deceased celebrity icon who, thanks to the wonder of AI, can now keep entertaining fans from beyond the grave. Voice cloning specialist ElevenLabs has signed a deal with Stan Lee Universe that will allow it to use the X-Men and Spider-Man co-creator's voice and likeness in its apps and licensing platforms. Lee joins the likes of Judy Garland, Michael Caine, John Wayne and David Hasselhoff on the ElevenLabs Iconic Marketplace, where companies can license celebrity voices and IP for commercial use. The comic book pioneer, who in later life became just as famous for his reliable cameo appearances in Marvel movies, is also now part of the ElevenReader app, launched in 2024, where you can upload various text files and have them read aloud by an AI-generated narrator.
Mosquitoes can learn that DEET means dinner is served
But don't throw away the bug spray just yet. More information Adding us as a Preferred Source in Google by using this link indicates that you would like to see more of our content in Google News results. DEET has helped repel mosquitoes for 80 years. Breakthroughs, discoveries, and DIY tips sent six days a week. By signing up, you confirm you are 16+, will receive newsletters and promotional content and agree to our Terms of Use and acknowledge the data practices in our Privacy Policy .
Irish datacentres have increased household bills by hundreds of euros, report finds
Datacentre industry representatives disputed the findings and said the sector boosted the economy. Datacentre industry representatives disputed the findings and said the sector boosted the economy. 'Hidden datacentre tax' costing Irish households millions, report says Datacentres used 22% of country's electricity last year, pushing up household bills, study suggests Thu 28 May 2026 09.01 EDTLast modified on Thu 28 May 2026 09.32 EDT Energy demand by datacentres in Ireland has added hundreds of euros to household electricity bills in a pattern that could be replicated across Europe, according to a report. Ireland's growing number of datacentres last year used 22% of the country's electricity, more than all urban homes combined, according to the Central Statistics Office. The equivalent figure in the US and UK is 6%.
Uber passengers can now make audio recordings of their journey if they feel unsafe
Moment Dame Helen Mirren is called an'evil Zionist b****' as she is accosted by pro-Palestine stranger on London street'Hell on Wheels' teen Mackenzie Shirilla's diva demands and disturbing obsession with fame revealed in prison calls with mom Girl, 14, was enjoying evening walk through her leafy Midwest neighborhood... then a stranger in a black car pulled up alongside her and horror ensued Scandalous underbelly of America's new high-stakes obsession: Secret backroom games, brazen cheating allegations... and savage public humiliations I know the devil, he's far more terrifying than in the movies... you can feel his power He became a MAGA star at Trump rallies dressed as the border wall... find out what happened to'Brick Suit Guy' in the free DC Insider newsletter Rich Christians in the'Hamptons of South' are turning on their new neighbor - beach-baptizer and MAGA convert Russell Brand Hugh Jackman's girlfriend Sutton Foster admits she feels'really alone' after she was pictured looking tense with actor and says'women shouldn't be pitted against one another' amid ongoing comparisons to his ex-wife Naomi Osaka doubles down with new French Open'fashion show', despite infuriating opponent, as she adds an ivory train to her'problematic' Eiffel Tower dress as part of £7.5m Nike deal Every man I date has the same vile bedroom kink... it's a total turn off, but I keep saying yes: DEAR JANE Russia's tactics in Ukraine reach a new hellish low as troops are forced to crawl for miles through underground pipes - with a life expectancy of ten minutes at the other end Our perfect summer body secrets: We've found the ultimate shortcut to the'after' photo... and the easy '30:30' diet that sparked a 22-pound transformation Triumphant Trump nominee's bold statement: Cheater Ken Paxton struts out in Margaritaville mode as secrets of his love nest with mistress are exposed Iran attacks US airbase after Trump condemns Tehran's peace plan and strikes regime drone site near Strait of Hormuz Kim Kardashian is introduced to Lewis Hamilton's mother Carmen Larbalestier as new couple dine out with their families in Los Angeles Trump's DHS chief rocked by wild rumor about his WIFE... as furious staff leak scandalous details about his life of luxury Meghan Markle adds luxury matchboxes to As Ever product range as she reveals'limited edition' item will be part of £190 candle set How I dropped from 17.5st to 10st WITHOUT getting loose, saggy skin. So many women struggle with unsightly wrinkles and flapping folds left by extreme weight loss. Here's how to avoid them Uber is making a major update to improve safety for millions of passengers in the UK. Riders will now be able to make audio recordings of their journey through the Uber app if they feel unsafe. Users can activate the feature either before or during the trip and start recording at any point with the press of a button.
Amazon Thinks the Future of Data Centers Depends on a Technical Problem It Just Solved
The tech giant says a breakthrough in data-center networking has dramatically accelerated the flow of information through its massive cloud infrastructure. Amazon says it recently achieved a major breakthrough in networking design--and has been quietly deploying the new technology in its data centers since late last year. The company claims it has significantly increased data speeds while reducing energy use, potentially giving the tech giant an edge as companies race to build ever-faster systems in the cloud. The new technology hinges on a "quasi-random" design that combines elements of traditional, structured data networks with the performance advantages of more random architectures. Researchers have explored random networks for decades, but the technology has never been successfully scaled.
Scammers Are Using Your Real Hotel Reservations to Trick You With Spear-Phishing Attacks
Customer data from more than 350 hotels around the world may have been accessed as part of realistic reservation-hijacking scams. Travelers' information and booking details may have been stolen from hundreds of hotels around the world, according to new findings from security researchers. These swiped trip details, such as booking names and reservation information, are then being repurposed by cybercriminals to create highly targeted phishing messages used to steal credit card information. At least 350 hotels, vacation rentals, motels, and guesthouses in 50 different countries have been caught up in so-called reservation hijacking scams, according to an analysis of phishing messages and cybercriminal infrastructure by security company Norton. Researchers say the use of legitimate booking information in phishing messages may increase the chances that someone clicks on a fraudulent link and hands over other sensitive details to criminals.
AIhub monthly digest: May 2026 – AI for science, the lottery ticket hypothesis, and world models
Welcome to our monthly digest, where you can catch up with any AIhub stories you may have missed, peruse the latest news, recap recent events, and more. This month, we learn about AI for science, delve into world models, research transparent and trustworthy AI, and hear about the lottery ticket hypothesis. The latest interview in our series with the AAAI/SIGAI Doctoral Consortium participants featured Ximing Wen who is researching transparent and trustworthy AI systems. We found out more about her work, her experience as a research intern, and what inspired her to study AI. In this wide-ranging conversation, Jonathan Frankle delves into empiricism versus theoretical proofs, how the approach to computer science has changed (even if the fundamental problems haven't), how younger researchers are rapidly adapting to a world that values impact above all else, and what it means to be a researcher.