South America
Detective who stole 400k of seized drugs jailed
A "cocaine addicted" police officer who was found to be stealing drugs from an evidence store after he accidentally dropped a bag of white powder at his daughter's school has been jailed. Andrew Talbot, at the time a Greater Manchester Police detective, had taken just under 4kg (9lb) of cocaine worth almost 400,000 from police property rooms between 2018 and 2020. He also used the force's computer systems to find a drug dealer to help him sell the drugs on the streets of Manchester. The 54-year-old was found guilty of supplying the drug and misconduct in public office and sentenced to 19 years in jail at Liverpool Crown Court.GMPThe detective stole drugs from Greater Manchester's Police evidence rooms Sentencing him on Friday, Judge Neil Flewitt KC said Talbot had deceived colleagues to put a "significant" quantity of cocaine back into circulation as a result of his "addiction and greed". The investigation into Talbot by GMP's anti-corruption unit began in February 2020 after he dropped a small bag of cocaine outside his daughter's primary school.
The Download: AI for debates, and what to know about the Oropouche virus
Reaching a consensus in a democracy is difficult because people hold such different ideological, political, and social views. Perhaps an AI tool could help. Researchers from Google DeepMind trained a system of large language models to operate as a "caucus mediator," generating summaries that outline a group's areas of agreement on complex but important social or political issues. The researchers say their work highlights the potential of AI to help groups of people find common ground when discussing contentious subjects. But it's not going to replace human mediators anytime soon.
Elon Musk has been inescapable in this election. How could he affect the results?
Less than a month before the presidential election, Elon Musk has made himself a near-constant presence in the race. On social media, he posts AI-generated images attacking Kamala Harris. The billionaire CEO of Tesla and SpaceX has emerged as a unique influence on the campaign in ways that set him apart from even the most politically active billionaires and tech elite. He is all at once a vocal Trump surrogate, campaign mega-donor, informal policy adviser, media influencer and prolific source of online disinformation. At the same time, he is the world's richest man and the owner of one of the United States' most influential social networks, while also operating as a government defense contractor and wielding power over critical satellite communications infrastructure.
2D Basement Relief Inversion using Sparse Regularization
Barboza, Francisco Mรกrcio, Silva, Arthur Anthony da Cunha Romรฃo E, de Carvalho, Bruno Motta
Basement relief gravimetry is crucial in geophysics, especially for oil exploration and mineral prospecting. It involves solving an inverse problem to infer geological model parameters from observed data. The model represents basement relief with constant-density prisms, and the data reflect gravitational anomalies from these prisms. Inverse problems are often ill-posed, meaning small data changes can lead to large solution variations. To mitigate this, regularization techniques like Tikhonov's are used to stabilize solutions. This study compares regularization methods applied to gravimetric inversion, including Smoothness Constraints, Total Variation, Discrete Cosine Transform (DCT), and Discrete Wavelet Transform (DWT) using Daubechies D4 wavelets. Optimization, particularly with Genetic Algorithms (GA), is used to find prism depths that best match observed anomalies. GA, inspired by natural selection, selects the best solutions to minimize the objective function. The results, evaluated through fit metrics and error analysis, show the effectiveness of all regularization methods and GA, with the Smoothness constraint performing best in synthetic models. For the real data model, all methods performed similarly.
Tell me what I need to know: Exploring LLM-based (Personalized) Abstractive Multi-Source Meeting Summarization
Kirstein, Frederic, Ruas, Terry, Kratel, Robert, Gipp, Bela
Meeting summarization is crucial in digital communication, but existing solutions struggle with salience identification to generate personalized, workable summaries, and context understanding to fully comprehend the meetings' content. Previous attempts to address these issues by considering related supplementary resources (e.g., presentation slides) alongside transcripts are hindered by models' limited context sizes and handling the additional complexities of the multi-source tasks, such as identifying relevant information in additional files and seamlessly aligning it with the meeting content. This work explores multi-source meeting summarization considering supplementary materials through a three-stage large language model approach: identifying transcript passages needing additional context, inferring relevant details from supplementary materials and inserting them into the transcript, and generating a summary from this enriched transcript. Our multi-source approach enhances model understanding, increasing summary relevance by ~9% and producing more content-rich outputs. We introduce a personalization protocol that extracts participant characteristics and tailors summaries accordingly, improving informativeness by ~10%. This work further provides insights on performance-cost trade-offs across four leading model families, including edge-device capable options. Our approach can be extended to similar complex generative tasks benefitting from additional resources and personalization, such as dialogue systems and action planning.
MoDification: Mixture of Depths Made Easy
Zhang, Chen, Zhong, Meizhi, Wang, Qimeng, Lu, Xuantao, Ye, Zheyu, Lu, Chengqiang, Gao, Yan, Hu, Yao, Chen, Kehai, Zhang, Min, Song, Dawei
Long-context efficiency has recently become a trending topic in serving large language models (LLMs). And mixture of depths (MoD) is proposed as a perfect fit to bring down both latency and memory. In this paper, however, we discover that MoD can barely transform existing LLMs without costly training over an extensive number of tokens. To enable the transformations from any LLMs to MoD ones, we showcase top-k operator in MoD should be promoted to threshold-p operator, and refinement to architecture and data should also be crafted along. All these designs form our method termed MoDification. Through a comprehensive set of experiments covering model scales from 3B to 70B, we exhibit MoDification strikes an excellent balance between efficiency and effectiveness. MoDification can achieve up to ~1.2x speedup in latency and ~1.8x reduction in memory compared to original LLMs especially in long-context applications.
MixEval-X: Any-to-Any Evaluations from Real-World Data Mixtures
Ni, Jinjie, Song, Yifan, Ghosal, Deepanway, Li, Bo, Zhang, David Junhao, Yue, Xiang, Xue, Fuzhao, Zheng, Zian, Zhang, Kaichen, Shah, Mahir, Jain, Kabir, You, Yang, Shieh, Michael
Perceiving and generating diverse modalities are crucial for AI models to effectively learn from and engage with real-world signals, necessitating reliable evaluations for their development. We identify two major issues in current evaluations: (1) inconsistent standards, shaped by different communities with varying protocols and maturity levels; and (2) significant query, grading, and generalization biases. To address these, we introduce MixEval-X, the first any-to-any, real-world benchmark designed to optimize and standardize evaluations across diverse input and output modalities. We propose multi-modal benchmark mixture and adaptation-rectification pipelines to reconstruct real-world task distributions, ensuring evaluations generalize effectively to real-world use cases. Extensive meta-evaluations show our approach effectively aligns benchmark samples with real-world task distributions. Meanwhile, MixEval-X's model rankings correlate strongly with that of crowd-sourced real-world evaluations (up to 0.98) while being much more efficient. We provide comprehensive leaderboards to rerank existing models and organizations and offer insights to enhance understanding of multi-modal evaluations and inform future research.
SignAttention: On the Interpretability of Transformer Models for Sign Language Translation
Bianco, Pedro Alejandro Dal, Stanchi, Oscar Agustรญn, Quiroga, Facundo Manuel, Ronchetti, Franco, Ferrante, Enzo
This paper presents the first comprehensive interpretability analysis of a Transformer-based Sign Language Translation (SLT) model, focusing on the translation from video-based Greek Sign Language to glosses and text. Leveraging the Greek Sign Language Dataset, we examine the attention mechanisms within the model to understand how it processes and aligns visual input with sequential glosses. Our analysis reveals that the model pays attention to clusters of frames rather than individual ones, with a diagonal alignment pattern emerging between poses and glosses, which becomes less distinct as the number of glosses increases. We also explore the relative contributions of cross-attention and self-attention at each decoding step, finding that the model initially relies on video frames but shifts its focus to previously predicted tokens as the translation progresses. This work contributes to a deeper understanding of SLT models, paving the way for the development of more transparent and reliable translation systems essential for real-world applications.
DiscoGraMS: Enhancing Movie Screen-Play Summarization using Movie Character-Aware Discourse Graph
Chitale, Maitreya Prafulla, Bindal, Uday, Rajkumar, Rajakrishnan, Mishra, Rahul
Summarizing movie screenplays presents a unique set of challenges compared to standard document summarization. Screenplays are not only lengthy, but also feature a complex interplay of characters, dialogues, and scenes, with numerous direct and subtle relationships and contextual nuances that are difficult for machine learning models to accurately capture and comprehend. Recent attempts at screenplay summarization focus on fine-tuning transformer-based pre-trained models, but these models often fall short in capturing long-term dependencies and latent relationships, and frequently encounter the "lost in the middle" issue. To address these challenges, we introduce DiscoGraMS, a novel resource that represents movie scripts as a movie character-aware discourse graph (CaD Graph). This approach is well-suited for various downstream tasks, such as summarization, question-answering, and salience detection. The model aims to preserve all salient information, offering a more comprehensive and faithful representation of the screenplay's content. We further explore a baseline method that combines the CaD Graph with the corresponding movie script through a late fusion of graph and text modalities, and we present very initial promising results.
Locate-then-edit for Multi-hop Factual Recall under Knowledge Editing
Zhang, Zhuoran, Li, Yongxiang, Kan, Zijian, Cheng, Keyuan, Hu, Lijie, Wang, Di
The locate-then-edit paradigm has shown significant promise for knowledge editing (KE) in Large Language Models (LLMs). While previous methods perform well on single-hop fact recall tasks, they consistently struggle with multi-hop factual recall tasks involving newly edited knowledge. In this paper, leveraging tools in mechanistic interpretability, we first identify that in multi-hop tasks, LLMs tend to retrieve implicit subject knowledge from deeper MLP layers, unlike single-hop tasks, which rely on earlier layers. This distinction explains the poor performance of current methods in multi-hop queries, as they primarily focus on editing shallow layers, leaving deeper layers unchanged. To address this, we propose IFMET, a novel locate-then-edit KE approach designed to edit both shallow and deep MLP layers. IFMET employs multi-hop editing prompts and supplementary sets to locate and modify knowledge across different reasoning stages. Experimental results demonstrate that IFMET significantly improves performance on multi-hop factual recall tasks, effectively overcoming the limitations of previous locate-then-edit methods.