Media
AMREx: AMR for Explainable Fact Verification
Jayaweera, Chathuri, Youm, Sangpil, Dorr, Bonnie
With the advent of social media networks and the vast amount of information circulating through them, automatic fact verification is an essential component to prevent the spread of misinformation. It is even more useful to have fact verification systems that provide explanations along with their classifications to ensure accurate predictions. To address both of these requirements, we implement AMREx, an Abstract Meaning Representation (AMR)-based veracity prediction and explanation system for fact verification using a combination of Smatch, an AMR evaluation metric to measure meaning containment and textual similarity, and demonstrate its effectiveness in producing partially explainable justifications using two community standard fact verification datasets, FEVER and AVeriTeC. AMREx surpasses the AVeriTec baseline accuracy showing the effectiveness of our approach for real-world claim verification. It follows an interpretable pipeline and returns an explainable AMR node mapping to clarify the system's veracity predictions when applicable. We further demonstrate that AMREx output can be used to prompt LLMs to generate natural-language explanations using the AMR mappings as a guide to lessen the probability of hallucinations.
Multi-Channel Hypergraph Contrastive Learning for Matrix Completion
Li, Xiang, Shui, Changsheng, Yu, Yanwei, Huang, Chao, Zhao, Zhongying, Dong, Junyu
Rating is a typical user explicit feedback that visually reflects how much a user likes a related item. The (rating) matrix completion is essentially a rating prediction process, which is also a significant problem in recommender systems. Recently, graph neural networks (GNNs) have been widely used in matrix completion, which captures users' preferences over items by formulating a rating matrix as a bipartite graph. However, existing methods are susceptible due to data sparsity and long-tail distribution in real-world scenarios. Moreover, the messaging mechanism of GNNs makes it difficult to capture high-order correlations and constraints between nodes, which are essentially useful in recommendation tasks. To tackle these challenges, we propose a Multi-Channel Hypergraph Contrastive Learning framework for matrix completion, named MHCL. Specifically, MHCL adaptively learns hypergraph structures to capture high-order correlations between nodes and jointly captures local and global collaborative relationships through attention-based cross-view aggregation. Additionally, to consider the magnitude and order information of ratings, we treat different rating subgraphs as different channels, encourage alignment between adjacent ratings, and further achieve the mutual enhancement between different ratings through multi-channel cross-rating contrastive learning. Extensive experiments on five public datasets demonstrate that the proposed method significantly outperforms the current state-of-the-art approaches.
Towards Effective Planning Strategies for Dynamic Opinion Networks
Muppasani, Bharath, Nag, Protik, Narayanan, Vignesh, Srivastava, Biplav, Huhns, Michael N.
In this study, we investigate the under-explored intervention planning aimed at disseminating accurate information within dynamic opinion networks by leveraging learning strategies. Intervention planning involves identifying key nodes (search) and exerting control (e.g., disseminating accurate or official information through the nodes) to mitigate the influence of misinformation. However, as the network size increases, the problem becomes computationally intractable. To address this, we first introduce a ranking algorithm to identify key nodes for disseminating accurate information, which facilitates the training of neural network classifiers that provide generalized solutions for the search and planning problems. Second, we mitigate the complexity of label generation, which becomes challenging as the network grows, by developing a reinforcement learning-based centralized dynamic planning framework. We analyze these NN-based planners for opinion networks governed by two dynamic propagation models. Each model incorporates both binary and continuous opinion and trust representations. Our experimental results demonstrate that the ranking algorithm-based classifiers provide plans that enhance infection rate control, especially with increased action budgets for small networks. Further, we observe that the reward strategies focusing on key metrics, such as the number of susceptible nodes and infection rates, outperform those prioritizing faster blocking strategies. Additionally, our findings reveal that graph convolutional network-based planners facilitate scalable centralized plans that achieve lower infection rates (higher control) across various network configurations, including Watts-Strogatz topology, varying action budgets, varying initial infected nodes, and varying degrees of infected nodes.
What Features in Prompts Jailbreak LLMs? Investigating the Mechanisms Behind Attacks
Kirch, Nathalie Maria, Field, Severin, Casper, Stephen
While `jailbreaks' have been central to research on the safety and reliability of LLMs (large language models), the underlying mechanisms behind these attacks are not well understood. Some prior works have used linear methods to analyze jailbreak prompts or model refusal. Here, however, we compare linear and nonlinear methods to study the features in prompts that contribute to successful jailbreaks. We do this by probing for jailbreak success based only on the portions of the latent representations corresponding to prompt tokens. First, we introduce a dataset of 10,800 jailbreak attempts from 35 attack methods. We then show that different jailbreaking methods work via different nonlinear features in prompts. Specifically, we find that while probes can distinguish between successful and unsuccessful jailbreaking prompts with a high degree of accuracy, they often transfer poorly to held-out attack methods. We also show that nonlinear probes can be used to mechanistically jailbreak the LLM by guiding the design of adversarial latent perturbations. These mechanistic jailbreaks are able to jailbreak Gemma-7B-IT more reliably than 34 of the 35 techniques that it was trained on. Ultimately, our results suggest that jailbreaks cannot be thoroughly understood in terms of universal or linear prompt features alone.
Fast and Memory-Efficient Video Diffusion Using Streamlined Inference
Zhan, Zheng, Wu, Yushu, Gong, Yifan, Meng, Zichong, Kong, Zhenglun, Yang, Changdi, Yuan, Geng, Zhao, Pu, Niu, Wei, Wang, Yanzhi
The rapid progress in artificial intelligence-generated content (AIGC), especially with diffusion models, has significantly advanced development of high-quality video generation. However, current video diffusion models exhibit demanding computational requirements and high peak memory usage, especially for generating longer and higher-resolution videos. These limitations greatly hinder the practical application of video diffusion models on standard hardware platforms. To tackle this issue, we present a novel, training-free framework named Streamlined Inference, which leverages the temporal and spatial properties of video diffusion models. Our approach integrates three core components: Feature Slicer, Operator Grouping, and Step Rehash. Specifically, Feature Slicer effectively partitions input features into sub-features and Operator Grouping processes each sub-feature with a group of consecutive operators, resulting in significant memory reduction without sacrificing the quality or speed. Step Rehash further exploits the similarity between adjacent steps in diffusion, and accelerates inference through skipping unnecessary steps. Extensive experiments demonstrate that our approach significantly reduces peak memory and computational overhead, making it feasible to generate high-quality videos on a single consumer GPU (e.g., reducing peak memory of AnimateDiff from 42GB to 11GB, featuring faster inference on 2080Ti).
Engadget Podcast: Apple's M4 chip heads to the iMac, Mac mini and MacBook Pro
It's been a Mac-heavy week! The Mac mini, in particular, looks like it'll be a huge hit for anyone who needs a simple desktop system. Also, we dive into why Apple is pushing for every Mac to get 16GB of RAM at a minimum. That will benefit all users, even if they don't care about Apple Intelligence. Listen below or subscribe on your podcast app of choice. If you've got suggestions or topics you'd like covered on the show, be sure to email us or drop a note in the comments! And be sure to check out our other podcast, Engadget News! Regulators force Lyft to tell U.S. drivers accurate numbers of how much money they'll make – 45:30 This week, I'm joined by our podcast producer, Ben Ellman. Kind of a light ship this week because a lot of people are out. Everyone's on taking some break and a lot of people are just busy at Engadget. So it's just going to be us. But we've got a lot of news to dive into all of Apple's new Macs with M4 chips, the M4 Pro and M4 Max as well, that they all just announced this week. There's a lot of new stuff and I'm excited to talk about it as always, folks. So if you're enjoying the show, please be sure to subscribe to us on iTunes or your podcatcher of choice. Leave us a review on iTunes. And also, yeah, you can join us Thursday mornings, typically around 1045 AM Eastern on our YouTube channel for our live stream so we can do some Q& A. In fact, we'll be including some of those questions and our answers later in this episode as well. Ben, you are somebody who I know is fully in the Mac ecosystem, and I also know you're very conscientious. Well, unfortunately, or for what you do, you're kind of there, but you're also very conscientious about how you upgrade, right? How did you feel about all these new Macs? Because we have the M4 iMac, we have an adorable new Mac mini, which is tiny, absolutely tiny, and M4 chips on the MacBook Pros. Is anything particularly compelling to you? Ben: So as I was reading up on the Mac, All of the stuff they released this week. That chip is four years old now. Ben: cut me like a knife. But that is M1 Classic, not M1 Pro. My research says that the M1 Pro is only two times slower than this new M4 Pro. Please fact check me on this. Send us an email at podcast adding gadget. If I didn't get that right. Devindra: I mean, you, you bring up a good point though, Ben, be sure to be very clear about what Apple is comparing its devices to, right? Because they often go back to base M1, which. Was released at the end of 2020 2020. It took a full year before we got the M4 Pro and M4 Max chips, right. Before they really expanded the line. Ben: you mean M1 Pro and M1 Max. So remember that there was that time difference when they, they just dropped the M1 on us and that was on the MacBook Air, MacBook Pro 13 inch, which was a fricking waste of time and the Mac mini, I believe back then, right.
What your JOB says about you: Take the test to see if your career reflects your personality - as scientists say the stereotypes about estate agents, actors, and accountants are TRUE
If you were asked to envisage an actor, a neurotic person might spring to mind, while the thought of an salesperson may conjure up someone who is chatty and extraverted. While some consider these lazy stereotypes, a comprehensive new study suggests that such common assumptions are actually true. Using data from 68,540 people, researchers have identified the personality traits that typify more than 260 job roles. They found that actors, journalists, town planners, authors and graphic designers are among those that tend to be more neurotic. Meanwhile, PR managers, marketers, psychologists, dental assistants and film directors are generally more extraverted. 'People often have stereotypes about the personality traits typical of different jobs, and it turns out that many of these intuitions are quite accurate,' said study author Dr René Mõttus at the University of Edinburgh.
Narrative Analysis of True Crime Podcasts With Knowledge Graph-Augmented Large Language Models
Leng, Xinyi, Liang, Jason, Mauro, Jack, Wang, Xu, Bertozzi, Andrea L., Chapman, James, Lin, Junyuan, Chen, Bohan, Ye, Chenchen, Daniel, Temple, Brantingham, P. Jeffrey
Narrative data spans all disciplines and provides a coherent model of the world to the reader or viewer. Recent advancement in machine learning and Large Language Models (LLMs) have enable great strides in analyzing natural language. However, Large language models (LLMs) still struggle with complex narrative arcs as well as narratives containing conflicting information. Recent work indicates LLMs augmented with external knowledge bases can improve the accuracy and interpretability of the resulting models. In this work, we analyze the effectiveness of applying knowledge graphs (KGs) in understanding true-crime podcast data from both classical Natural Language Processing (NLP) and LLM approaches. We directly compare KG-augmented LLMs (KGLLMs) with classical methods for KG construction, topic modeling, and sentiment analysis. Additionally, the KGLLM allows us to query the knowledge base in natural language and test its ability to factually answer questions. We examine the robustness of the model to adversarial prompting in order to test the model's ability to deal with conflicting information. Finally, we apply classical methods to understand more subtle aspects of the text such as the use of hearsay and sentiment in narrative construction and propose future directions. Our results indicate that KGLLMs outperform LLMs on a variety of metrics, are more robust to adversarial prompts, and are more capable of summarizing the text into topics.
LongRAG: A Dual-Perspective Retrieval-Augmented Generation Paradigm for Long-Context Question Answering
Zhao, Qingfei, Wang, Ruobing, Cen, Yukuo, Zha, Daren, Tan, Shicheng, Dong, Yuxiao, Tang, Jie
Long-Context Question Answering (LCQA), a challenging task, aims to reason over long-context documents to yield accurate answers to questions. Existing long-context Large Language Models (LLMs) for LCQA often struggle with the "lost in the middle" issue. Retrieval-Augmented Generation (RAG) mitigates this issue by providing external factual evidence. However, its chunking strategy disrupts the global long-context information, and its low-quality retrieval in long contexts hinders LLMs from identifying effective factual details due to substantial noise. To this end, we propose LongRAG, a general, dual-perspective, and robust LLM-based RAG system paradigm for LCQA to enhance RAG's understanding of complex long-context knowledge (i.e., global information and factual details). We design LongRAG as a plug-and-play paradigm, facilitating adaptation to various domains and LLMs. Extensive experiments on three multi-hop datasets demonstrate that LongRAG significantly outperforms long-context LLMs (up by 6.94%), advanced RAG (up by 6.16%), and Vanilla RAG (up by 17.25%). Furthermore, we conduct quantitative ablation studies and multi-dimensional analyses, highlighting the effectiveness of the system's components and fine-tuning strategies. Data and code are available at https://github.com/QingFei1/LongRAG.
GDTB: Genre Diverse Data for English Shallow Discourse Parsing across Modalities, Text Types, and Domains
Liu, Yang Janet, Aoyama, Tatsuya, Scivetti, Wesley, Zhu, Yilun, Behzad, Shabnam, Levine, Lauren Elizabeth, Lin, Jessica, Tiwari, Devika, Zeldes, Amir
Work on shallow discourse parsing in English has focused on the Wall Street Journal corpus, the only large-scale dataset for the language in the PDTB framework. However, the data is not openly available, is restricted to the news domain, and is by now 35 years old. In this paper, we present and evaluate a new open-access, multi-genre benchmark for PDTB-style shallow discourse parsing, based on the existing UD English GUM corpus, for which discourse relation annotations in other frameworks already exist. In a series of experiments on cross-domain relation classification, we show that while our dataset is compatible with PDTB, substantial out-of-domain degradation is observed, which can be alleviated by joint training on both datasets.