Goto

Collaborating Authors

 Generative AI


AI Risk-Management Standards Profile for General-Purpose AI (GPAI) and Foundation Models

arXiv.org Artificial Intelligence

Increasingly multi-purpose AI models, such as cutting-edge large language models or other 'general-purpose AI' (GPAI) models, 'foundation models,' generative AI models, and 'frontier models' (typically all referred to hereafter with the umbrella term 'GPAI/foundation models' except where greater specificity is needed), can provide many beneficial capabilities but also risks of adverse events with profound consequences. This document provides risk-management practices or controls for identifying, analyzing, and mitigating risks of GPAI/foundation models. We intend this document primarily for developers of large-scale, state-of-the-art GPAI/foundation models; others that can benefit from this guidance include downstream developers of end-use applications that build on a GPAI/foundation model. This document facilitates conformity with or use of leading AI risk management-related standards, adapting and building on the generic voluntary guidance in the NIST AI Risk Management Framework and ISO/IEC 23894, with a focus on the unique issues faced by developers of GPAI/foundation models.


Securing AI Systems: A Guide to Known Attacks and Impacts

arXiv.org Artificial Intelligence

Embedded into information systems, artificial intelligence (AI) faces security threats that exploit AI-specific vulnerabilities. This paper provides an accessible overview of adversarial attacks unique to predictive and generative AI systems. We identify eleven major attack types and explicitly link attack techniques to their impacts -- including information leakage, system compromise, and resource exhaustion -- mapped to the confidentiality, integrity, and availability (CIA) security triad. We aim to equip researchers, developers, security practitioners, and policymakers, even those without specialized AI security expertise, with foundational knowledge to recognize AI-specific risks and implement effective defenses, thereby enhancing the overall security posture of AI systems.


Data Can Speak for Itself: Quality-guided Utilization of Wireless Synthetic Data

arXiv.org Artificial Intelligence

Generative models have gained significant attention for their ability to produce realistic synthetic data that supplements the quantity of real-world datasets. While recent studies show performance improvements in wireless sensing tasks by incorporating all synthetic data into training sets, the quality of synthetic data remains unpredictable and the resulting performance gains are not guaranteed. To address this gap, we propose tractable and generalizable metrics to quantify quality attributes of synthetic data - affinity and diversity. Our assessment reveals prevalent affinity limitation in current wireless synthetic data, leading to mislabeled data and degraded task performance. We attribute the quality limitation to generative models' lack of awareness of untrained conditions and domain-specific processing. To mitigate these issues, we introduce SynCheck, a quality-guided synthetic data utilization scheme that refines synthetic data quality during task model training. Our evaluation demonstrates that SynCheck consistently outperforms quality-oblivious utilization of synthetic data, and achieves 4.3% performance improvement even when the previous utilization degrades performance by 13.4%.


Apple weighs using Anthropic or OpenAI to power Siri in major reversal

The Japan Times

Apple is considering using artificial intelligence technology from Anthropic or OpenAI to power a new version of Siri, sidelining its own in-house models in a potentially blockbuster move aimed at turning around its flailing AI effort. The iPhone maker has talked with both companies about using their large language models for Siri, according to people familiar with the discussions. It has asked them to train versions of their models that could run on Apple's cloud infrastructure for testing, said the people, who asked not to be identified discussing private deliberations. If Apple ultimately moves forward, it would represent a monumental reversal. The company currently powers most of its AI features with homegrown technology that it calls Apple Foundation Models and had been planning a new version of its voice assistant that runs on that technology for 2026.


Two New Legal Rulings Are Bad News for Your Favorite Authors

Slate

Judge Vince Chhabria sided with Meta but appeared to do so regretfully, stating that Meta's use of the writers' work to train its bots isn't necessarily legal but that the plaintiffs "made the wrong arguments."


Here Is Everyone Mark Zuckerberg Has Hired So Far for Meta's 'Superintelligence' Team

WIRED

Mark Zuckerberg notified Meta staff today to introduce them to the new superintelligence team. The memo, which WIRED obtained, lists names and bios for the recently hired employees, many of whom came from rival AI firms like OpenAI, Anthropic, and Google. Over the past few months, Meta CEO Mark Zuckerberg has been on a recruiting frenzy to poach some of the most sought after talent in AI. The social media giant has invested 14.3 billion in Scale AI and hired Alexandr Wang, its CEO, to run Meta's Superintelligence Labs (MSL). News of the memo was first reported by Bloomberg.


How generative AI is affecting people's minds

Al Jazeera

Researchers at Stanford University recently tested out some of the more popular AI tools on the market, from companies like OpenAI and Character.ai, The researchers found that when they imitated someone who had suicidal intentions, these tools were more than unhelpful -- they failed to notice they were helping that person plan their own death. "[AI] systems are being used as companions, thought-partners, confidants, coaches, and therapists," says Nicholas Haber, an assistant professor at the Stanford Graduate School of Education and senior author of the new study. "These aren't niche uses โ€“ this is happening at scale." AI is becoming more and more ingrained in people's lives and is being deployed in scientific research in areas as wide-ranging as cancer and climate change.


Roundtables: Inside OpenAI's Empire with Karen Hao

MIT Technology Review

AI journalist Karen Hao's book, Empire of AI: Dreams and Nightmares in Sam Altman's OpenAI, tells the story of OpenAI's rise to power and its far-reaching impact all over the world. Hear from Karen Hao, former MIT Technology Review senior editor, and executive editor Niall Firth for a conversation exploring the AI arms race, what it means for all of us, and where it's headed.


The Download: meet RFK Jr's right-hand man, and inside OpenAI

MIT Technology Review

When Jim O'Neill was nominated to be the second in command at the US Department of Health and Human Services, longevity enthusiasts were excited. As Robert F. Kennedy Jr.'s new right-hand man, O'Neill is expected to wield authority at health agencies that fund biomedical research and oversee the regulation of new drugs. And while O'Neill doesn't subscribe to Kennedy's most contentious beliefs--and supports existing vaccine schedules--he may still steer the agencies in controversial new directions. O'Neill is well-known in the increasingly well-funded and tight-knit longevity community. In speaking with more than 20 people who work in the longevity field and are familiar with O'Neill, it's clear that they share a genuine optimism about his leadership.


Meta spending big on AI talent but will it pay off?

The Japan Times

Mark Zuckerberg and Meta are spending billions of dollars for top talent to make up ground in the generative artificial intelligence race, sparking doubt about the wisdom of the spree. OpenAI boss Sam Altman recently lamented that Meta has offered 100 million bonuses to engineers who jump to Zuckerberg's ship, where hefty salaries await. A few OpenAI employees have reportedly taken Meta up on the offer, joining Scale AI founder and former chief executive Alexandr Wang at the Menlo Park-based tech titan.