A central challenge in language models (LMs) is faithfulness hallucination: the generation of information unsubstantiated by input context. To study this problem, we propose Precise Information Control (PIC), a new task formulation that requires models to generate long-form outputs grounded in a provided set of short self-contained statements, without adding any unsupported ones. PIC includes a full setting that tests a model's ability to include exactly all input claims, and a partial setting that requires the model to selectively incorporate only relevant claims. We present PIC-Bench, a benchmark of eight long-form generation tasks (e.g., summarization, biography generation) adapted to the PIC setting, where LMs are supplied with well-formed, verifiable input claims. Our evaluation of a range of open and proprietary LMs on PIC-Bench reveals that, surprisingly, state-of-the-art LMs still hallucinate against user-provided input in over 70% of generations. To alleviate this lack of faithfulness, we introduce a post-training framework that uses a weakly supervised preference data construction method to train an 8BPIC-LM with stronger PIC ability--improving from 69.1% to 91.0% F1 in the full PIC setting. When integrated into end-to-end factual generation pipelines, PIC-LM improves exact match recall by 17.1% on ambiguous QA with retrieval, and factual precision by 30.5% on a birthplace fact-checking task, underscoring the potential of precisely grounded generation.

This material may not be published, broadcast, rewritten, or redistributed. Quotes displayed in real-time or delayed by at least 15 minutes. Market data provided by Factset . Powered and implemented by FactSet Digital Solutions . Mutual Fund and ETF data provided by LSEG .

Is Vladimir Putin Finally Feeling Pressure? The Russian President is facing growing domestic discontent after a series of successful attacks by the Ukrainian Army, including a major attack on Moscow. The war in Ukraine, which not long ago seemed to be turning in favor of Vladimir Putin's invading Russian Army, appears to have undergone another reversal. Thanks in part to its drone campaign, the Ukrainians have, according to some analysts, " turned the tide," putting pressure on Putin to potentially accept a ceasefire in the coming months. At the same time, there have been bubbles of discontent forming within Russia, over the cost of the war and government crackdowns on internet access. To understand what might be happening in Russia, and how the Putin regime might respond, I recently e-mailed several rounds of questions to Tatiana Stanovaya, a senior fellow at the Carnegie Russia Eurasia Center, and the founder of the political analysis organization R.Politik. Our conversation, edited for length and clarity, is below.

On today's, we dive into the dysfunction in Meta's newly formed AI unit and why it's been driving already-low employee morale even further into the ground. This week on, our hosts discuss the meltdown that has been recently unfolding at Meta and what it says about the company's relentless ambitions in the AI race. They also dive into the leaked messages and names of an invite-only group cofounded by billionaire tech founder Peter Thiel, and how Sam Bankman-Fried is now actively seeking a pardon from the Trump administration. Plus, they share their impressions on SpaceX acquiring Cursor and the latest on the negotiations between Anthropic and the government. 'Tell Him He's a Piece of Shit': Meta's New AI Unit Is a Total Mess Write to us at [email protected] . You can always listen to this week's podcast through the audio player on this page, but if you want to subscribe for free to get every episode, here's how: If you're on an iPhone or iPad, open the app called Podcasts, or just tap this link . Before we start, two quick things. If you've been enjoying listening to the show, we would appreciate it if you took a second to rate it in your podcast app of choice. It really helps us reach more people. And second, if you have any questions related to tech, privacy, or politics that you would like me, Zoë, and Leah to take on, now is the time to submit them to [email protected] . It doesn't matter how big or how small, we want to hear from you and get you answers. Today on the show, we're talking about the dysfunction in Meta's newly formed AI unit and why it's been driving employee morale, which was already very, very low, even further into the ground. We'll also break down the recent online leak that shed light on Peter Thiel's invite-only group, Dialog, more than 200 names of high profile people in government, tech, academia, beyond are listed in the documents as members and guests of this secretive society, not to mention a look at what they talk about behind closed doors.

Embattled Gavin Newsom's stunning confession to Justin Trudeau caught on camera at World Cup when he thought no one was watching Tragic final moments of Hollywood legend's daughter and her husband revealed before being mysteriously found dead in their running SUV Boy, three, is thrown into crocodile enclosure at zoo: Man, 30, 'not known to him' arrested on suspicion of attempted murder Haunting final video of beloved Bay Area coffee shop owner, 52, who vanished without a trace: Investigator reveals'unnerving' new clues found inside her home Watch horrifying drone video that follows woman's plunge to death after bungee team threw her from bridge without rope Malia and Sasha Obama exude confidence as they attend grand opening of dad Barack's library Mystery surrounds JD Vance's dash to Switzerland as world holds breath for Iranians to confirm peace deal All my friends are suddenly getting divorced. Mid-life wives share taboo sex confessions about why they really leave... including common position that made one hate her husband: JANA HOCKING Taylor Swift's bottomless thirst for attention, her greed and sheer tackiness are now truly unbearable... this latest stunt has shown her true colors: MAUREEN CALLAHAN Male Israeli hostage sexually assaulted by Hamas captor describes multiple attacks he suffered - blindfolded and stripped naked at knifepoint... and'brutal' 20-minute ordeal World Cup's'sexiest fan' sends fans wild with barely-there outfit to watch her country's first game in Dallas Troubling new psychological side effect of Ozempic revealed... as users battle'ghost fat' after losing weight Infection found in wildlife evolved to spread between humans, experts fear... after two clusters are identified Sensational REAL reason Jelly Roll is divorcing Bunnie XO: Insiders reveal'preacher's wife' bombshell that's the talk of Nashville... truth about legendary rocker cuckolding rumor... and G-string mishap Fears of the'Big One' - an earthquake so big it devastates all of California - have risen to new heights after a disturbing discovery under America's most dangerous fault line. Researchers from the US and Switzerland revealed that the San Andreas Fault has reached its highest levels of stress in 1,000 years - adding that it has been more than 160 years since the giant crack in the Earth's crust had a major release of energy . The San Andreas is an 800-mile-long fault line which runs under most of California, passing by Los Angeles in the south and San Francisco in the north and connecting to several other major faults, most notably the San Jacinto Fault near Los Angeles. This connection is where researcher Liliane Burkhard from the University of Hawaiʻi at Mānoa said seismic stress has become so great at the southern end of the San Andreas that a rupture could travel along both fault lines - resulting in a mega quake .

Large language models (LLMs) are powerful tools capable of handling diverse tasks. Comparing and selecting appropriate LLMs for specific tasks requires systematic evaluation methods, as models exhibit varying capabilities across different domains. However, finding suitable benchmarks is difficult given the many available options. This complexity not only increases the risk of benchmark misuse and misinterpretation but also demands substantial effort from LLM users, seeking the most suitable benchmarks for their specific needs. To address these issues, we introduce BenchmarkCards, an intuitive and validated documentation framework that standardizes critical benchmark attributes such as objectives, methodologies, data sources, and limitations. Through user studies involving benchmark creators and users, we show that BenchmarkCardscan simplify benchmark selection and enhance transparency, facilitating informed decision-making in evaluating LLMs.

'Ringleader' of alleged UFC drone attack to kill Trump is unmasked as illegal migrant who was granted DACA stay under Obama Watch horrifying drone video that follows woman's plunge to death after bungee team threw her from bridge without rope Horrific new videos blow Texas woman's mystery death wide open: Her agonizing'final gasp'... unthinkably vile corpse claims... and sick past of man who saw her last Taylor Swift's bottomless thirst for attention, her greed and sheer tackiness are now truly unbearable... this latest stunt has shown her true colors: MAUREEN CALLAHAN Spy world panic as Tulsi Gabbard prepares to unleash bombshell file dumps on secret CIA'mind control' project and Dr. Fauci Olivia Wilde, 42, complains about being on Maxim's Hot 100 List calling it the'most f***** up thing in the world' Has Taylor Swift already revealed her wedding dress designer? All my friends are suddenly getting divorced. Mid-life wives share taboo sex confessions about why they really leave... including common position that made one hate her husband: JANA HOCKING Kanye West's wife Bianca Censori raises eyebrows in plunging white lace lingerie as she photographs a nude model at Art Basel in Switzerland Knicks set to come face to face with Trump after president was'thunderously booed' at NBA Finals game Sensational REAL reason Jelly Roll is divorcing Bunnie XO: Insiders reveal'preacher's wife' bombshell that's the talk of Nashville... truth about legendary rocker cuckolding rumor... and G-string mishap Teen tourist thrown to death by Central Park horse was trying to save mom who flew out of carriage during family's first visit to Big Apple Father keeps his cool as shouting man calls cops on him for taking his two young daughters into women's restroom Trump privately frets Bibi Netanyahu's zeal to'bomb everyone' could turn him into another disgraced president'Moscow will burn', Zelensky vows as Russia's capital is blanketed in toxic smoke following huge Ukraine drone attack He drove a Rolls-Royce and lived the American dream. But behind the Gucci was the ATF's most unlikely secret weapon. MORE: Meteorologist reveals America's most dangerous cities in super El Niño's'corridor of chaos'... and warns this is only the beginning As many as 40 million people across eight states are in the deadly path of Tropical Storm Arthur after the first named storm of hurricane season made landfall Wednesday night.

Follow this section to personalize your feed and get instant alerts. Follow Go to your personalized feed WHY FOLLOW? Smart Alerts: Get notified about major news as it happens. Follow this tag to personalize your feed and get instant alerts. Follow Go to your personalized feed WHY FOLLOW?

Large language models (LMs) often struggle to generate diverse, human-like creative content, raising concerns about the long-term homogenization of human thought through repeated exposure to similar outputs. Yet scalable methods for evaluating LM output diversity remain limited, especially beyond narrow tasks such as random number or name generation, or beyond repeated sampling from a single model. To address this gap, we introduce INFINITY-CHAT, a largescale dataset of 26K diverse, real-world, open-ended user queries that admit a wide range of plausible answers with no single ground truth. We introduce the first comprehensive taxonomy for characterizing the full spectrum of open-ended prompts posed to LMs, comprising 6 top-level categories (e.g., creative content generation, brainstorm & ideation) that further breaks down to 17 subcategories.

'Ringleader' of alleged UFC drone attack to kill Trump is unmasked as illegal migrant who was granted DACA stay under Obama Watch horrifying drone video that follows woman's plunge to death after bungee team threw her from bridge without rope Horrific new videos blow Texas woman's mystery death wide open: Her agonizing'final gasp'... unthinkably vile corpse claims... and sick past of man who saw her last Taylor Swift's bottomless thirst for attention, her greed and sheer tackiness are now truly unbearable... this latest stunt has shown her true colors: MAUREEN CALLAHAN Spy world panic as Tulsi Gabbard prepares to unleash bombshell file dumps on secret CIA'mind control' project and Dr. Fauci Beloved mattress company backed by Travis Kelce files for bankruptcy... but makes key promise to customers Olivia Wilde, 42, complains about being on Maxim's Hot 100 List calling it the'most f***** up thing in the world' All my friends are suddenly getting divorced. Mid-life wives share taboo sex confessions about why they really leave... including common position that made one hate her husband: JANA HOCKING Kanye West's wife Bianca Censori raises eyebrows in plunging white lace lingerie as she photographs a nude model at Art Basel in Switzerland Knicks set to come face to face with Trump after president was'thunderously booed' at NBA Finals game Sensational REAL reason Jelly Roll is divorcing Bunnie XO: Insiders reveal'preacher's wife' bombshell that's the talk of Nashville... truth about legendary rocker cuckolding rumor... and G-string mishap Has Taylor Swift already revealed her wedding dress designer? Teen tourist thrown to death by Central Park horse was trying to save mom who flew out of carriage during family's first visit to Big Apple Father keeps his cool as shouting man calls cops on him for taking his two young daughters into women's restroom Trump privately frets Bibi Netanyahu's zeal to'bomb everyone' could turn him into another disgraced president'Moscow will burn', Zelensky vows as Russia's capital is blanketed in toxic smoke following huge Ukraine drone attack He drove a Rolls-Royce and lived the American dream. But behind the Gucci was the ATF's most unlikely secret weapon. What do aliens EAT? Scientist reveals the foods extraterrestrials would go for on Earth - and why E.T.'s favourite Reese's Pieces are off the cards In the 1982 blockbuster, E.T. the Extra-Terrestrial, E.T. is lured out of hiding using a trail of Reese's Pieces.