Goto

Collaborating Authors

 Media


Towards a Perspectivist Turn in Argument Quality Assessment

arXiv.org Artificial Intelligence

The assessment of argument quality depends on well-established logical, rhetorical, and dialectical properties that are unavoidably subjective: multiple valid assessments may exist, there is no unequivocal ground truth. This aligns with recent paths in machine learning, which embrace the co-existence of different perspectives. However, this potential remains largely unexplored in NLP research on argument quality. One crucial reason seems to be the yet unexplored availability of suitable datasets. We fill this gap by conducting a systematic review of argument quality datasets. We assign them to a multi-layered categorization targeting two aspects: (a) What has been annotated: we collect the quality dimensions covered in datasets and consolidate them in an overarching taxonomy, increasing dataset comparability and interoperability. (b) Who annotated: we survey what information is given about annotators, enabling perspectivist research and grounding our recommendations for future actions. To this end, we discuss datasets suitable for developing perspectivist models (i.e., those containing individual, non-aggregated annotations), and we showcase the importance of a controlled selection of annotators in a pilot study.


Stories that (are) Move(d by) Markets: A Causal Exploration of Market Shocks and Semantic Shifts across Different Partisan Groups

arXiv.org Artificial Intelligence

Macroeconomic fluctuations and the narratives that shape them form a mutually reinforcing cycle: public discourse can spur behavioural changes leading to economic shifts, which then result in changes in the stories that propagate. We show that shifts in semantic embedding space can be causally linked to financial market shocks -- deviations from the expected market behaviour. Furthermore, we show how partisanship can influence the predictive power of text for market fluctuations and shape reactions to those same shocks. We also provide some evidence that text-based signals are particularly salient during unexpected events such as COVID-19, highlighting the value of language data as an exogenous variable in economic forecasting. Our findings underscore the bidirectional relationship between news outlets and market shocks, offering a novel empirical approach to studying their effect on each other.


ChatGPT will now combat bias with new measures put forth by OpenAI

FOX News

Fox News Correspondent, William La Jeunesse, joins'Fox News Sunday' to discuss the evolution of A.I. and the push lawmakers are making to regulate it. OpenAI has announced a set of new measures to combat bias within its suite of products, including ChatGPT. The artificial intelligence (AI) company recently unveiled an updated Model Spec, a document that defines how OpenAI wants its models to behave in ChatGPT and the OpenAI API. The company says this iteration of the Model Spec builds on the foundational version released last May. "I think with a tool as powerful as this, one where people can access all sorts of different information, if you really believe we're moving to artificial general intelligence (AGI) one day, you have to be willing to share how you're steering the model," Laurentia Romaniuk, who works on model behavior at OpenAI, told Fox News Digital.


Robot Iris turns out to be a straw man in horror-comedy Companion

New Scientist

Arriving at a house in the country, Iris (Sophie Thatcher) isn't sure she is welcome. The owner, Sergey (Rupert Friend), is leery; his wife, Kat (Megan Suri), is unfriendly. It isn't Iris she dislikes, Kat later admits, it is "the idea" of her: she makes her feel redundant. Iris's boyfriend, Josh (Jack Quaid), is patient and encouraging, but even he finds her shyness and clinginess hard to bear. "Go to sleep, Iris," he says, and Iris's eyes roll up inside her head as…


Fox News AI Newsletter: Can Musk's Grok AI beat the Warren Buffett challenge?

FOX News

Tech expert Kurt Knutsson examines the convergence of cutting-edge technology and traditional culture. Elon Musk debuted xAI last year. AI DREAMS: Billionaire Elon Musk on Monday said his startup xAI's latest iteration of the Grok chatbot could help college basketball fans pick a perfect bracket once March Madness begins. BUSTIN' A MOVE: In a stunning display of technological prowess and cultural fusion, Unitree's H1 humanoid robots recently stole the show at China's Spring Festival Gala, performing alongside human dancers in a mesmerizing rendition of the traditional Yangge folk dance. This groundbreaking performance marks a significant milestone in the world of robotics and entertainment.


Humanoid robots bust dance moves alongside humans

FOX News

Tech expert Kurt Knutsson examines the convergence of cutting-edge technology and traditional culture. In a stunning display of technological prowess and cultural fusion, Unitree's H1 humanoid robots recently stole the show at China's Spring Festival Gala, performing alongside human dancers in a mesmerizing rendition of the traditional Yangge folk dance. This groundbreaking performance marks a significant milestone in the world of robotics and entertainment. Get security alerts & expert tech tips--sign up for Kurt's The CyberGuy Report now The performance featured 16 H1 robots, each standing at an impressive 5.74 feet tall, seamlessly integrated with a troupe of human dancers. What set this performance apart was not just the robots' ability to keep pace with the music and their human counterparts but their mastery of a particularly challenging aspect of the Yangge dance: the handkerchief trick.


Instruction Tuning on Public Government and Cultural Data for Low-Resource Language: a Case Study in Kazakh

arXiv.org Artificial Intelligence

Instruction tuning in low-resource languages remains underexplored due to limited text data, particularly in government and cultural domains. To address this, we introduce and open-source a large-scale (10,600 samples) instruction-following (IFT) dataset, covering key institutional and cultural knowledge relevant to Kazakhstan. Our dataset enhances LLMs' understanding of procedural, legal, and structural governance topics. We employ LLM-assisted data generation, comparing open-weight and closed-weight models for dataset construction, and select GPT-4o as the backbone. Each entity of our dataset undergoes full manual verification to ensure high quality. We also show that fine-tuning Qwen, Falcon, and Gemma on our dataset leads to consistent performance improvements in both multiple-choice and generative tasks, demonstrating the potential of LLM-assisted instruction tuning for low-resource languages.


Local Differences, Global Lessons: Insights from Organisation Policies for International Legislation

arXiv.org Artificial Intelligence

The rapid adoption of AI across diverse domains has led to the development of organisational guidelines that vary significantly, even within the same sector. This paper examines AI policies in two domains, news organisations and universities, to understand how bottom-up governance approaches shape AI usage and oversight. By analysing these policies, we identify key areas of convergence and divergence in how organisations address risks such as bias, privacy, misinformation, and accountability. We then explore the implications of these findings for international AI legislation, particularly the EU AI Act, highlighting gaps where practical policy insights could inform regulatory refinements. Our analysis reveals that organisational policies often address issues such as AI literacy, disclosure practices, and environmental impact, areas that are underdeveloped in existing international frameworks. We argue that lessons from domain-specific AI policies can contribute to more adaptive and effective AI governance at the global level. This study provides actionable recommendations for policymakers seeking to bridge the gap between local AI practices and international regulations.


CoME: An Unlearning-based Approach to Conflict-free Model Editing

arXiv.org Artificial Intelligence

Large language models (LLMs) often retain outdated or incorrect information from pre-training, which undermines their reliability. While model editing methods have been developed to address such errors without full re-training, they frequently suffer from knowledge conflicts, where outdated information interferes with new knowledge. In this work, we propose Conflict-free Model Editing (CoME), a novel framework that enhances the accuracy of knowledge updates in LLMs by selectively removing outdated knowledge. CoME leverages unlearning to mitigate knowledge interference, allowing new information to be integrated without compromising relevant linguistic features. Through experiments on GPT-J and LLaMA-3 using Counterfact and ZsRE datasets, we demonstrate that CoME improves both editing accuracy and model reliability when applied to existing editing methods. Our results highlight that the targeted removal of outdated knowledge is crucial for enhancing model editing effectiveness and maintaining the model's generative performance.


A Tale of Two Structures: Do LLMs Capture the Fractal Complexity of Language?

arXiv.org Artificial Intelligence

Language exhibits a fractal structure in its information-theoretic complexity (i.e. bits per token), with self-similarity across scales and long-range dependence (LRD). In this work, we investigate whether large language models (LLMs) can replicate such fractal characteristics and identify conditions-such as temperature setting and prompting method-under which they may fail. Moreover, we find that the fractal parameters observed in natural language are contained within a narrow range, whereas those of LLMs' output vary widely, suggesting that fractal parameters might prove helpful in detecting a non-trivial portion of LLM-generated texts. Notably, these findings, and many others reported in this work, are robust to the choice of the architecture; e.g. Gemini 1.0 Pro, Mistral-7B and Gemma-2B. We also release a dataset comprising of over 240,000 articles generated by various LLMs (both pretrained and instruction-tuned) with different decoding temperatures and prompting methods, along with their corresponding human-generated texts. We hope that this work highlights the complex interplay between fractal properties, prompting, and statistical mimicry in LLMs, offering insights for generating, evaluating and detecting synthetic texts.