Goto

Collaborating Authors

 arm race


Semidefinite relaxations for certifying robustness to adversarial examples

Neural Information Processing Systems

Despite their impressive performance on diverse tasks, neural networks fail catastrophically in the presence of adversarial inputs--imperceptibly but adversarially perturbed versions of natural inputs. We have witnessed an arms race between defenders who attempt to train robust networks and attackers who try to construct adversarial examples. One promise of ending the arms race is developing certified defenses, ones which are provably robust against all attackers in some family. These certified defenses are based on convex relaxations which construct an upper bound on the worst case loss over all attackers in the family. Previous relaxations are loose on networks that are not trained against the respective relaxation. In this paper, we propose a new semidefinite relaxation for certifying robustness that applies to arbitrary ReLU networks. We show that our proposed relaxation is tighter than previous relaxations and produces meaningful robustness guarantees on three different foreign networks whose training objectives are agnostic to our proposed relaxation.


Semidefinite relaxations for certifying robustness to adversarial examples

Neural Information Processing Systems

Despite their impressive performance on diverse tasks, neural networks fail catastrophically in the presence of adversarial inputs--imperceptibly but adversarially perturbed versions of natural inputs. We have witnessed an arms race between defenders who attempt to train robust networks and attackers who try to construct adversarial examples. One promise of ending the arms race is developing certified defenses, ones which are provably robust against all attackers in some family. These certified defenses are based on convex relaxations which construct an upper bound on the worst case loss over all attackers in the family. Previous relaxations are loose on networks that are not trained against the respective relaxation. In this paper, we propose a new semidefinite relaxation for certifying robustness that applies to arbitrary ReLU networks. We show that our proposed relaxation is tighter than previous relaxations and produces meaningful robustness guarantees on three different foreign networks whose training objectives are agnostic to our proposed relaxation.


Co-Evolving Complexity: An Adversarial Framework for Automatic MARL Curricula

Hill, Brennen

arXiv.org Artificial Intelligence

The advancement of general-purpose intelligent agents is intrinsically linked to the environments in which they are trained. While scaling models and datasets has yielded remarkable capabilities, scaling the complexity, diversity, and interactivity of environments remains a crucial bottleneck. Hand-crafted environments are finite and often contain implicit biases, limiting the potential for agents to develop truly generalizable and robust skills. In this work, we propose a paradigm for generating a boundless and adaptive curriculum of challenges by framing the environment generation process as an adversarial game. We introduce a system where a team of cooperative multi-agent defenders learns to survive against a procedurally generative attacker. The attacker agent learns to produce increasingly challenging configurations of enemy units, dynamically creating novel worlds tailored to exploit the defenders' current weaknesses. Concurrently, the defender team learns cooperative strategies to overcome these generated threats. This co-evolutionary dynamic creates a self-scaling environment where complexity arises organically from the adversarial interaction, providing an effectively infinite stream of novel and relevant training data. We demonstrate that with minimal training, this approach leads to the emergence of complex, intelligent behaviors, such as flanking and shielding by the attacker, and focus-fire and spreading by the defenders. Our findings suggest that adversarial co-evolution is a powerful mechanism for automatically scaling environmental complexity, driving agents towards greater robustness and strategic depth.


'Ukraine is only first': Zelenskyy warns against Putin's expansionist goals

Al Jazeera

How is Russia replenishing its military? What is a'coalition of the willing'? How China forgot promises and'debts' to Ukraine How are Europe, the US pulling apart on Ukraine? 'Ukraine is only first': Zelenskyy warns against Putin's expansionist goals Ukrainian President Volodymyr Zelenskyy says the world is in "the most destructive arms race in history" as he calls on the international community to act against Russia now, asserting in his address to the United Nations General Assembly that President Vladimir Putin wants to expand his war in Europe . "Ukraine is only the first, and now Russian drones are already flying across Europe, and Russian operations are already spreading across countries, and Putin wants to continue this war by expanding it," Zelenskyy said on Wednesday at UN headquarters in New York. Moscow has denied the claims of incursions into NATO members' airspace, accusing European powers of levying baseless accusations.


Billion-dollar coffins? New technology could make oceans transparent and Aukus submarines vulnerable

The Guardian

Australia's forthcoming Aukus nuclear-powered submarines have been called the'apex predator of the oceans'. Australia's forthcoming Aukus nuclear-powered submarines have been called the'apex predator of the oceans'. Quantum sensing, satellite tracking and AI are part of an accelerating arms race in detection that should prompt a re-evaluation of Australia's defence strategy Military history is littered with the corpses of apex predators. All once possessed unassailable power - then were undermined, in some cases wiped out, by the march of new technology. " Speed and stealth and firepower," the head of the Australian Submarine Agency, Jonathan Mead, told the Guardian two years ago of Australia's forthcoming fleet of nuclear submarines.


Who will launch nukes first amid WW3 fears, according to experts

Daily Mail - Science & tech

As fears of all-out nuclear war intensify, scientists are sounding the alarm that the decision to launch a catastrophic strike could soon rest not with world leaders, but with a machine. In a stark warning, the Stockholm International Peace Research Institute (SIPRI), an independent group that monitors global security issues, reported that the decades-long decline in global nuclear arsenals has come to an end. Instead, nations are now modernizing, expanding, and deploying their stockpiles at a rapid and alarming pace, signaling the onset of a new, high-tech arms race. While AI and similar technologies can accelerate decision-making during crises, scientists warn they also raise the risk of nuclear conflict through miscommunication, misunderstanding, or technical failure, the report stated. In a nuclear standoff, decision-makers often have only minutes to assess threats and respond.


AI could spark nuclear Armageddon and World War Three, experts fear

Daily Mail - Science & tech

Artificial intelligence could spark an accidental nuclear war, conflict experts fear. The Stockholm International Peace Research Institute (SIPRI), the world's leading organisation on nuclear assessments, said technologies like AI are aggravating the risk carried with growing global nuclear stockpiles. SIPRI pointed to China's rapidly growing stockpile, from 500 to 600 in a single year, as well as the imminent expiry of the final arms control treaty between the US and Russia, two nuclear-armed nations. The institute's director, Dan Smith, warned: 'One component of the coming arms race will be the attempt to gain and maintain a competitive edge in artificial intelligence (AI), both for offensive and defensive purposes. 'There are benefits to be found but the careless adoption of AI could significantly increase nuclear risk.'


US Marine Corps creates attack drone team as arms race with Russia, China heats up

FOX News

Fox News contributor and Army veteran Brett Velicovich shares insight into the United States' drone capabilities and how it compares to adversaries like Russia and China. The U.S. Marine Corps established an attack drone team earlier this year to respond to the rapid development of armed first-person view (FPV) drone technology and tactics, offering a glimpse into the evolving landscape of modern warfare and how future battles could be fought. The Marine Corps Attack Drone Team (MCADT) will be based at the Weapons Training Battalion, Marine Corps Base in Quantico, Virginia. The FPV drones used will offer squad-level lethality at a range of up to 20 kilometers, nearly 12.5 miles, for under 5,000, compared to more expensive weapons systems with less capability, according to a press release from the service. "MCADT is committed to rapidly integrating armed first-person view drones into the FMF [Fleet Marine Force], enhancing small-unit lethality and providing organic capabilities that warfighters currently lack," said Maj. Alejandro Tavizon, the headquarters company commander at Weapons Training Battalion and officer in charge of MCADT.


Why Grimes No Longer Believes That Art Is Dead

TIME - Tech

A couple of years ago, Grimes thought art might be dying. She worried that TikTok was overwhelming attention spans; that transgressive artists were becoming more sanitized; that gimmicky NFTs like the Bored Ape Yacht Club--digital cartoon monkeys which were selling for millions of dollars--were warping value systems. "I just went through this whole big'art isn't worth anything' internal existential crisis," the Canadian singer-songwriter says. "But I've come out the other end thinking, actually, maybe it's the main thing that matters. In the last year, I feel like things became way more about artists again." The rise of AI, Grimes believes, has played a role in that shift, perhaps paradoxically. Earlier this month, Grimes was honored at the TIME100 AI Impact Awards in Dubai for her role in shaping the present and future of the technology. While many other artists are terrified of AI and its potential to replace them, Grimes has embraced the technology, even releasing an AI tool allowing people to sing through her voice. Grimes' penchant for seriously engaging with what others fear or distrust makes her one of pop culture's most singular--and at times divisive--figures. But Grimes wears her contrarianism as a badge of honor, and doesn't hesitate to offer insights and perspectives on a variety of issues. "I'm so canceled that I basically have nothing left to lose," she says. She argues that hyper-partisan hysteria has consumed social media, and wishes people would have more measured, nuanced conversations, even with people that they disagree with. "A lot of people think I'm one way or the other, but my whole vibe is just like, I just want people to think well," she says.


Why DeepSeek Is Sparking Debates Over National Security, Just Like TikTok

TIME - Tech

The fast-rising Chinese AI lab DeepSeek is sparking national security concerns in the U.S., over fears that its AI models could be used by the Chinese government to spy on American civilians, learn proprietary secrets, and wage influence campaigns. In her first press briefing, White House Press Secretary Karoline Leavitt said that the National Security Council was "looking into" the potential security implications of DeepSeek. This comes amid news that the U.S. Navy has banned use of DeepSeek among its ranks due to "potential security and ethical concerns." DeepSeek, which currently tops the Apple App Store in the U.S., marks a major inflection point in the AI arms race between the U.S. and China. For the last couple years, many leading technologists and political leaders have argued that whichever country developed AI the fastest will have a huge economic and military advantage over its rivals. DeepSeek shows that China's AI has developed much faster than many had believed, despite efforts from American policymakers to slow its progress.