This technical report analyzes the challenge of "hallucinations" (false information) in LLMs applied to law. It examines their causes, manifestations, and the effectiveness of the RAG mitigation strategy, highlighting its limitations and proposing holistic optimizations. The paper explores the ethical and regulatory implications, emphasizing human oversight as an irreplaceable role. It concludes that the solution lies not in incrementally improving generative models, but in adopting a "consultative" AI paradigm that prioritizes veracity and traceability, acting as a tool to amplify, not replace, professional judgment. -- Este informe técnico analiza el desafío de las "alucinaciones" (información falsa) en los LLMs aplicados al derecho. Se examinan sus causas, manifestaciones y la efectividad de la estrategia de mitigación RAG, exponiendo sus limitaciones y proponiendo optimizaciones holísticas. Se exploran las implicaciones éticas y regulatorias, enfatizando la supervisión humana como un rol insustituible. El documento concluye que la solución no reside en mejorar incrementalmente los modelos generativos, sino en adoptar un paradigma de IA "consultiva" que priorice la veracidad y la trazabilidad, actuando como una herramienta para amplificar, y no sustituir, el juicio profesional.

The legal field already uses various large language models (LLMs) in actual applications, but their quantitative performance and reasons for it are underexplored. We evaluated several open-source and proprietary LLMs -- including GPT-series, Anthropic, Deepseek and Llama-3, variants -- on parts of the European Qualifying Examination (EQE) for future European Patent Attorneys. OpenAI o1 led with 0.82 accuracy and 0.81 F1 score, whereas (Amazon Web Services) AWS Llama 3.1 8B lagged at 0.50 accuracy, and a Python-deployed Llama 3.1 8B scored 0.55. The latter two are within the range of mere guessing for the two-answer forced-choice design. None of the evaluated models could have passed the examination fully, as accuracy never exceeded the average threshold of 0.90 required for professional-level standards -- also not models that are regularly promoted for their assumed beyond-PhD- and bar-admitted-lawyer-level performance. GPT-4o excelled at integrating text and graphics, while Claude 3 Opus often lost formatting coherence. Human patent experts evaluated the textual justifications and uncovered various critical shortcomings of each model. They valued clarity and legal rationale over the raw correctness of the answers, which revealed misalignment between automatic metrics and expert judgment. Model outputs were sensitive to modest temperature changes and prompt wording, which underscores the remaining necessity of expert oversight. Future work should target logical consistency, robust multimodality, and adaptive prompting to approach human-level patent proficiency. In summary, despite the outstanding performance of recent large models, the general public might overestimate their performance. The field has a long way to go to develop a virtual patent attorney. This paper wants to point out several specific limitations that need solutions.

Classifying patents by their relevance to the UN Sustainable Development Goals (SDGs) is crucial for tracking how innovation addresses global challenges. However, the absence of a large, labeled dataset limits the use of supervised learning. Existing methods, such as keyword searches, transfer learning, and citation-based heuristics, lack scalability and generalizability. This paper frames patent-to-SDG classification as a weak supervision problem, using citations from patents to SDG-tagged scientific publications (NPL citations) as a noisy initial signal. To address its sparsity and noise, we develop a composite labeling function (LF) that uses large language models (LLMs) to extract structured concepts, namely functions, solutions, and applications, from patents and SDG papers based on a patent ontology. Cross-domain similarity scores are computed and combined using a rank-based retrieval approach. The LF is calibrated via a custom positive-only loss that aligns with known NPL-SDG links without penalizing discovery of new SDG associations. The result is a silver-standard, soft multi-label dataset mapping patents to SDGs, enabling the training of effective multi-label regression models. We validate our approach through two complementary strategies: (1) internal validation against held-out NPL-based labels, where our method outperforms several baselines including transformer-based models, and zero-shot LLM; and (2) external validation using network modularity in patent citation, co-inventor, and co-applicant graphs, where our labels reveal greater thematic, cognitive, and organizational coherence than traditional technological classifications. These results show that weak supervision and semantic alignment can enhance SDG classification at scale.

Charlie Kirk's killer'identified' by law enforcement in manhunt after Trump indicated he knew assassin's motive Charlie Kirk's body arrives in hearse at Salt Lake City as devastated wife and family gather with JD Vance Trump's address to the nation hit by outrageous'fake' claim REVEALED: The truth about the'vanishing plane' five miles from Charlie Kirk's assassination... as private jet owner is unmasked And the armed militia mystery. FBI terror hunter blows the lid on search for Charlie Kirk's assassin... and the vital clue cops are desperate for'Shots fired' at UMass Boston: SWAT teams rush to hall of residence as terrified students sprint away from scene Elite sniper breaks down Charlie Kirk assassin's sick plot... and reveals tiny detail everyone's missed: The gun. Joe Rogan is speechless as he learns of Charlie Kirk's assassination on his podcast Fans claim NFL is'rigged' after bizarre Vikings play against Bears goes viral Biden insiders spew venom on Kamala Harris claiming her scathing critique of the former president is a'sloppy attempt at deflecting blame' for her failure Charlotte Tilbury reveals the secrets behind the Dallas Cowboys Cheerleaders' flawless look Americans are unknowingly eating endangered animals... as study finds grocery store meat is mislabeled Mom of Ukrainian stabbing suspect says'killer' is'NOT racist because he dates all kinds of girls' Dave Portnoy: Trump played a huge part in Charlie Kirk's death Charlie Kirk's assassin sniper's nest giving him a terrifying clear shot before he vanished into thin air Charlie Kirk's body to be flown home aboard Air Force Two in rare tribute Silenced by a bullet to the throat - then came the sneers. MAUREEN CALLAHAN's blistering rebuke as America faces greatest political crisis since the 60s Looking to level up your home entertainment setup this fall? Sony's newest budget smart TV is a strong contender Daily Mail journalists select and curate the products that feature on our site.

FBI under pressure over open airport five miles from Charlie Kirk assassination hit as private jet'vanishes' after shooting Dave Portnoy slams'insane' left in furious Charlie Kirk rant... but adds Donald Trump'played a part' in death Elon Musk unleashes explosive rant on Kirk assassination calling the left'the party of murder' And the armed militia mystery. FBI terror hunter blows the lid on search for Charlie Kirk's assassin... and the vital clue cops are desperate for Elite sniper breaks down Charlie Kirk assassin's sick plot... and reveals tiny detail everyone's missed: The gun. Jimmy Kimmel reacts to assassination of Charlie Kirk: 'No finger pointing' Charlie Kirk's'incredibly strong' wife is too heartbroken to tell her children that'daddy isn't coming home' Sweater weather starts here - the cozy, chic pieces from Soft Surroundings you'll actually wear all season Vile protester screams'f***' Charlie Kirk as he drives through vigil Jennifer Lopez STILL living in $68M mansion she shared with Ben Affleck one year after listing, here's why NBA's first openly-gay player Jason Collins reveals brain tumor as ex-Nets center starts cancer treatment Silenced by a bullet to the throat - then came the sneers. MAUREEN CALLAHAN's blistering rebuke as America faces greatest political crisis since the 60s Microsoft denies any link to man behind'evil' Charlie Kirk assassination post A post has gone viral on X, claiming to show a Microsoft employee making'evil' comments about Charlie Kirk's assassination. Benjamin Van der Zar commented on a post saying: 'Professional hit from a few hundred yards, good job soldier.' Kirk, 31, was shot while speaking to a crowd at Utah Valley University in Orem, Utah, at 12:20pm local time.

Revealed: The political activist charged for distracting cops after'saying HE shot Charlie Kirk' FBI under pressure over open airport five miles from Charlie Kirk assassination hit as private jet'vanishes' after shooting Elite sniper breaks down Charlie Kirk assassin's sick plot... and reveals tiny detail everyone's missed: The gun. Elon Musk unleashes explosive rant on Kirk assassination calling the left'the party of murder' Shocking moment left-wing politicians refuse to take part in minute's silence for Charlie Kirk in European Parliament - prompting screaming match with right-wing opponents Silenced by a bullet to the throat - then came the sneers. MAUREEN CALLAHAN's blistering rebuke as America faces greatest political crisis since the 60s Jimmy Kimmel reacts to assassination of Charlie Kirk: 'No finger pointing' Charlie Kirk's'incredibly strong' wife is too heartbroken to tell her children that'daddy isn't coming home' Sweater weather starts here - the cozy, chic pieces from Soft Surroundings you'll actually wear all season Trader Joe's continues USA takeover as it snaps up more land after opening new stores this year My last conversation with Charlie: MARK HALPERIN remembers a dedicated, political genius, who didn't hate anyone. TMZ forced to apologize after staff heard erupting in laughter as Charlie Kirk's death was announced Police tapes capture chilling details of Charlie Kirk gunman's appearance as FBI faces fury over his escape This Oscar-nominated actress, 68, will soon reunite with her ex in Spain for their daughter's wedding, can you guess who? MORE: America's most famous scientist sparks outrage among liberals after MAGA post Social media platform Bluesky has issued a warning to all of its users, saying it will remove posts or ban anyone who celebrates the assassination of Charlie Kirk.

The Download: Trump's impact on science, and meet our climate and energy honorees How Trump's policies are affecting early-career scientists--in their own words Every year MIT Technology Review celebrates accomplished young scientists, entrepreneurs, and inventors from around the world in our Innovators Under 35 list. We've just published the 2025 edition . This year, though, the context is different: The US scientific community is under attack. Since Donald Trump took office in January, his administration has fired top government scientists, targeted universities and academia, and made substantial funding cuts to the country's science and technology infrastructure. We asked our six most recent cohorts about both positive and negative impacts of the administration's new policies. Their responses provide a glimpse into the complexities of building labs, companies, and careers in today's political climate.

Charlie Kirk dead at 31: What we know so far about MAGA star's death at Utah campus that sent shockwaves around the world as FBI botches arrest and Trump promises ultimate punishment MSNBC analyst Matthew Dowd fired over'disgusting' on-air comments about Charlie Kirk shortly after conservative star was assassinated Elite sniper breaks down Charlie Kirk assassin's sick plot... and reveals tiny detail everyone's missed: The gun. MAUREEN CALLAHAN: Charlie Kirk's body wasn't even cold... before the fighting started again. Do these ghouls not see where this is headed? Charlie Kirk's powerful tribute to murdered Ukrainian refugee hours before his own assassination: 'America will never be the same' Musk dethroned as richest person by forgotten Wall Street darling's founder as stock soars 42% Trump issues Oval Office address over Charlie Kirk's assassination: 'This is a dark moment for America' TMZ forced to apologize after staff heard erupting in laughter as Charlie Kirk's death was announced Sweater weather starts here - the cozy, chic pieces from Soft Surroundings you'll actually wear all season America's top banker Jamie Dimon makes chilling warning that economy is struggling Fierce debate erupts over'non-human' technology in space after video captures UFO surviving Hellfire strike Is this Charlie Kirk's killer? This Oscar-nominated actress, 68, will soon reunite with her ex in Spain for their daughter's wedding, can you guess who?

FBI under pressure over open airport five miles from Charlie Kirk assassination hit as private jet'vanishes' after shooting MSNBC analyst Matthew Dowd fired over'disgusting' on-air comments about Charlie Kirk shortly after conservative star was assassinated Elite sniper breaks down Charlie Kirk assassin's sick plot... and reveals tiny detail everyone's missed: The gun. MAUREEN CALLAHAN: Charlie Kirk's body wasn't even cold... before the fighting started again. Do these ghouls not see where this is headed? Charlie Kirk's powerful tribute to murdered Ukrainian refugee hours before his own assassination: 'America will never be the same' Musk dethroned as richest person by forgotten Wall Street darling's founder as stock soars 42% Charlie Kirk dead at 31: What we know so far about MAGA star's death at Utah campus that sent shockwaves around the world as FBI botches arrest and Trump promises ultimate punishment TMZ forced to apologize after staff heard erupting in laughter as Charlie Kirk's death was announced Sweater weather starts here - the cozy, chic pieces from Soft Surroundings you'll actually wear all season Trump issues Oval Office address over Charlie Kirk's assassination: 'This is a dark moment for America' Fierce debate erupts over'non-human' technology in space after video captures UFO surviving Hellfire strike Is this Charlie Kirk's killer? This Oscar-nominated actress, 68, will soon reunite with her ex in Spain for their daughter's wedding, can you guess who?

A legal battle is brewing, as two companies are suing to overturn the two-year ban. Last week, a legal battle over lab-grown meat kicked off in Texas. On September 1, a two-year ban on the technology went into effect across the state; the following day, two companies filed a lawsuit against state officials. The two companies, Wildtype Foods and Upside Foods, are part of a growing industry that aims to bring new types of food to people's plates. These products, often called cultivated meat by the industry, take live animal cells and grow them in the lab to make food products without the need to slaughter animals. Here's what we know about lab-grown meat and climate change Cultivated meat is coming to the US.