Goto

Collaborating Authors

 Media


Towards Effective Planning Strategies for Dynamic Opinion Networks

arXiv.org Artificial Intelligence

In this study, we investigate the under-explored intervention planning aimed at disseminating accurate information within dynamic opinion networks by leveraging learning strategies. Intervention planning involves identifying key nodes (search) and exerting control (e.g., disseminating accurate or official information through the nodes) to mitigate the influence of misinformation. However, as the network size increases, the problem becomes computationally intractable. To address this, we first introduce a ranking algorithm to identify key nodes for disseminating accurate information, which facilitates the training of neural network classifiers that provide generalized solutions for the search and planning problems. Second, we mitigate the complexity of label generation, which becomes challenging as the network grows, by developing a reinforcement learning-based centralized dynamic planning framework. We analyze these NN-based planners for opinion networks governed by two dynamic propagation models. Each model incorporates both binary and continuous opinion and trust representations. Our experimental results demonstrate that the ranking algorithm-based classifiers provide plans that enhance infection rate control, especially with increased action budgets for small networks. Further, we observe that the reward strategies focusing on key metrics, such as the number of susceptible nodes and infection rates, outperform those prioritizing faster blocking strategies. Additionally, our findings reveal that graph convolutional network-based planners facilitate scalable centralized plans that achieve lower infection rates (higher control) across various network configurations, including Watts-Strogatz topology, varying action budgets, varying initial infected nodes, and varying degrees of infected nodes.


What Features in Prompts Jailbreak LLMs? Investigating the Mechanisms Behind Attacks

arXiv.org Artificial Intelligence

While `jailbreaks' have been central to research on the safety and reliability of LLMs (large language models), the underlying mechanisms behind these attacks are not well understood. Some prior works have used linear methods to analyze jailbreak prompts or model refusal. Here, however, we compare linear and nonlinear methods to study the features in prompts that contribute to successful jailbreaks. We do this by probing for jailbreak success based only on the portions of the latent representations corresponding to prompt tokens. First, we introduce a dataset of 10,800 jailbreak attempts from 35 attack methods. We then show that different jailbreaking methods work via different nonlinear features in prompts. Specifically, we find that while probes can distinguish between successful and unsuccessful jailbreaking prompts with a high degree of accuracy, they often transfer poorly to held-out attack methods. We also show that nonlinear probes can be used to mechanistically jailbreak the LLM by guiding the design of adversarial latent perturbations. These mechanistic jailbreaks are able to jailbreak Gemma-7B-IT more reliably than 34 of the 35 techniques that it was trained on. Ultimately, our results suggest that jailbreaks cannot be thoroughly understood in terms of universal or linear prompt features alone.


Fast and Memory-Efficient Video Diffusion Using Streamlined Inference

arXiv.org Artificial Intelligence

The rapid progress in artificial intelligence-generated content (AIGC), especially with diffusion models, has significantly advanced development of high-quality video generation. However, current video diffusion models exhibit demanding computational requirements and high peak memory usage, especially for generating longer and higher-resolution videos. These limitations greatly hinder the practical application of video diffusion models on standard hardware platforms. To tackle this issue, we present a novel, training-free framework named Streamlined Inference, which leverages the temporal and spatial properties of video diffusion models. Our approach integrates three core components: Feature Slicer, Operator Grouping, and Step Rehash. Specifically, Feature Slicer effectively partitions input features into sub-features and Operator Grouping processes each sub-feature with a group of consecutive operators, resulting in significant memory reduction without sacrificing the quality or speed. Step Rehash further exploits the similarity between adjacent steps in diffusion, and accelerates inference through skipping unnecessary steps. Extensive experiments demonstrate that our approach significantly reduces peak memory and computational overhead, making it feasible to generate high-quality videos on a single consumer GPU (e.g., reducing peak memory of AnimateDiff from 42GB to 11GB, featuring faster inference on 2080Ti).


Engadget Podcast: Apple's M4 chip heads to the iMac, Mac mini and MacBook Pro

Engadget

It's been a Mac-heavy week! The Mac mini, in particular, looks like it'll be a huge hit for anyone who needs a simple desktop system. Also, we dive into why Apple is pushing for every Mac to get 16GB of RAM at a minimum. That will benefit all users, even if they don't care about Apple Intelligence. Listen below or subscribe on your podcast app of choice. If you've got suggestions or topics you'd like covered on the show, be sure to email us or drop a note in the comments! And be sure to check out our other podcast, Engadget News! Regulators force Lyft to tell U.S. drivers accurate numbers of how much money they'll make – 45:30 This week, I'm joined by our podcast producer, Ben Ellman. Kind of a light ship this week because a lot of people are out. Everyone's on taking some break and a lot of people are just busy at Engadget. So it's just going to be us. But we've got a lot of news to dive into all of Apple's new Macs with M4 chips, the M4 Pro and M4 Max as well, that they all just announced this week. There's a lot of new stuff and I'm excited to talk about it as always, folks. So if you're enjoying the show, please be sure to subscribe to us on iTunes or your podcatcher of choice. Leave us a review on iTunes. And also, yeah, you can join us Thursday mornings, typically around 1045 AM Eastern on our YouTube channel for our live stream so we can do some Q& A. In fact, we'll be including some of those questions and our answers later in this episode as well. Ben, you are somebody who I know is fully in the Mac ecosystem, and I also know you're very conscientious. Well, unfortunately, or for what you do, you're kind of there, but you're also very conscientious about how you upgrade, right? How did you feel about all these new Macs? Because we have the M4 iMac, we have an adorable new Mac mini, which is tiny, absolutely tiny, and M4 chips on the MacBook Pros. Is anything particularly compelling to you? Ben: So as I was reading up on the Mac, All of the stuff they released this week. That chip is four years old now. Ben: cut me like a knife. But that is M1 Classic, not M1 Pro. My research says that the M1 Pro is only two times slower than this new M4 Pro. Please fact check me on this. Send us an email at podcast adding gadget. If I didn't get that right. Devindra: I mean, you, you bring up a good point though, Ben, be sure to be very clear about what Apple is comparing its devices to, right? Because they often go back to base M1, which. Was released at the end of 2020 2020. It took a full year before we got the M4 Pro and M4 Max chips, right. Before they really expanded the line. Ben: you mean M1 Pro and M1 Max. So remember that there was that time difference when they, they just dropped the M1 on us and that was on the MacBook Air, MacBook Pro 13 inch, which was a fricking waste of time and the Mac mini, I believe back then, right.


What your JOB says about you: Take the test to see if your career reflects your personality - as scientists say the stereotypes about estate agents, actors, and accountants are TRUE

Daily Mail - Science & tech

If you were asked to envisage an actor, a neurotic person might spring to mind, while the thought of an salesperson may conjure up someone who is chatty and extraverted. While some consider these lazy stereotypes, a comprehensive new study suggests that such common assumptions are actually true. Using data from 68,540 people, researchers have identified the personality traits that typify more than 260 job roles. They found that actors, journalists, town planners, authors and graphic designers are among those that tend to be more neurotic. Meanwhile, PR managers, marketers, psychologists, dental assistants and film directors are generally more extraverted. 'People often have stereotypes about the personality traits typical of different jobs, and it turns out that many of these intuitions are quite accurate,' said study author Dr René Mõttus at the University of Edinburgh.


Narrative Analysis of True Crime Podcasts With Knowledge Graph-Augmented Large Language Models

arXiv.org Artificial Intelligence

Narrative data spans all disciplines and provides a coherent model of the world to the reader or viewer. Recent advancement in machine learning and Large Language Models (LLMs) have enable great strides in analyzing natural language. However, Large language models (LLMs) still struggle with complex narrative arcs as well as narratives containing conflicting information. Recent work indicates LLMs augmented with external knowledge bases can improve the accuracy and interpretability of the resulting models. In this work, we analyze the effectiveness of applying knowledge graphs (KGs) in understanding true-crime podcast data from both classical Natural Language Processing (NLP) and LLM approaches. We directly compare KG-augmented LLMs (KGLLMs) with classical methods for KG construction, topic modeling, and sentiment analysis. Additionally, the KGLLM allows us to query the knowledge base in natural language and test its ability to factually answer questions. We examine the robustness of the model to adversarial prompting in order to test the model's ability to deal with conflicting information. Finally, we apply classical methods to understand more subtle aspects of the text such as the use of hearsay and sentiment in narrative construction and propose future directions. Our results indicate that KGLLMs outperform LLMs on a variety of metrics, are more robust to adversarial prompts, and are more capable of summarizing the text into topics.


LongRAG: A Dual-Perspective Retrieval-Augmented Generation Paradigm for Long-Context Question Answering

arXiv.org Artificial Intelligence

Long-Context Question Answering (LCQA), a challenging task, aims to reason over long-context documents to yield accurate answers to questions. Existing long-context Large Language Models (LLMs) for LCQA often struggle with the "lost in the middle" issue. Retrieval-Augmented Generation (RAG) mitigates this issue by providing external factual evidence. However, its chunking strategy disrupts the global long-context information, and its low-quality retrieval in long contexts hinders LLMs from identifying effective factual details due to substantial noise. To this end, we propose LongRAG, a general, dual-perspective, and robust LLM-based RAG system paradigm for LCQA to enhance RAG's understanding of complex long-context knowledge (i.e., global information and factual details). We design LongRAG as a plug-and-play paradigm, facilitating adaptation to various domains and LLMs. Extensive experiments on three multi-hop datasets demonstrate that LongRAG significantly outperforms long-context LLMs (up by 6.94%), advanced RAG (up by 6.16%), and Vanilla RAG (up by 17.25%). Furthermore, we conduct quantitative ablation studies and multi-dimensional analyses, highlighting the effectiveness of the system's components and fine-tuning strategies. Data and code are available at https://github.com/QingFei1/LongRAG.


GDTB: Genre Diverse Data for English Shallow Discourse Parsing across Modalities, Text Types, and Domains

arXiv.org Artificial Intelligence

Work on shallow discourse parsing in English has focused on the Wall Street Journal corpus, the only large-scale dataset for the language in the PDTB framework. However, the data is not openly available, is restricted to the news domain, and is by now 35 years old. In this paper, we present and evaluate a new open-access, multi-genre benchmark for PDTB-style shallow discourse parsing, based on the existing UD English GUM corpus, for which discourse relation annotations in other frameworks already exist. In a series of experiments on cross-domain relation classification, we show that while our dataset is compatible with PDTB, substantial out-of-domain degradation is observed, which can be alleviated by joint training on both datasets.


Conditional GAN for Enhancing Diffusion Models in Efficient and Authentic Global Gesture Generation from Audios

arXiv.org Artificial Intelligence

Audio-driven simultaneous gesture generation is vital for human-computer communication, AI games, and film production. While previous research has shown promise, there are still limitations. Methods based on VAEs are accompanied by issues of local jitter and global instability, whereas methods based on diffusion models are hampered by low generation efficiency. This is because the denoising process of DDPM in the latter relies on the assumption that the noise added at each step is sampled from a unimodal distribution, and the noise values are small. DDIM borrows the idea from the Euler method for solving differential equations, disrupts the Markov chain process, and increases the noise step size to reduce the number of denoising steps, thereby accelerating generation. However, simply increasing the step size during the step-by-step denoising process causes the results to gradually deviate from the original data distribution, leading to a significant drop in the quality of the generated actions and the emergence of unnatural artifacts. In this paper, we break the assumptions of DDPM and achieves breakthrough progress in denoising speed and fidelity. Specifically, we introduce a conditional GAN to capture audio control signals and implicitly match the multimodal denoising distribution between the diffusion and denoising steps within the same sampling step, aiming to sample larger noise values and apply fewer denoising steps for high-speed generation.


Latent Paraphrasing: Perturbation on Layers Improves Knowledge Injection in Language Models

arXiv.org Artificial Intelligence

As Large Language Models (LLMs) are increasingly deployed in specialized domains with continuously evolving knowledge, the need for timely and precise knowledge injection has become essential. Fine-tuning with paraphrased data is a common approach to enhance knowledge injection, yet it faces two significant challenges: high computational costs due to repetitive external model usage and limited sample diversity. To this end, we introduce LaPael, a latent-level paraphrasing method that applies input-dependent noise to early LLM layers. This approach enables diverse and semantically consistent augmentations directly within the model. Furthermore, it eliminates the recurring costs of paraphrase generation for each knowledge update. Our extensive experiments on question-answering benchmarks demonstrate that LaPael improves knowledge injection over standard fine-tuning and existing noise-based approaches. Additionally, combining LaPael with data-level paraphrasing further enhances performance.