Goto

Collaborating Authors

 Government


A Defensive Framework Against Adversarial Attacks on Machine Learning-Based Network Intrusion Detection Systems

arXiv.org Artificial Intelligence

As cyberattacks become increasingly sophisticated, advanced Network Intrusion Detection Systems (NIDS) are critical for modern network security. Traditional signature-based NIDS are inadequate against zero-day and evolving attacks. In response, machine learning (ML)-based NIDS have emerged as promising solutions; however, they are vulnerable to adversarial evasion attacks that subtly manipulate network traffic to bypass detection. To address this vulnerability, we propose a novel defensive framework that enhances the robustness of ML-based NIDS by simultaneously integrating adversarial training, dataset balancing techniques, advanced feature engineering, ensemble learning, and extensive model fine-tuning. We validate our framework using the NSL-KDD and UNSW-NB15 datasets. Experimental results show, on average, a 35% increase in detection accuracy and a 12.5% reduction in false positives compared to baseline models, particularly under adversarial conditions. The proposed defense against adversarial attacks significantly advances the practical deployment of robust ML-based NIDS in real-world networks.


Verification and Validation for Trustworthy Scientific Machine Learning

arXiv.org Artificial Intelligence

Scientific machine learning (SciML) integrates machine learning (ML) into scientific workflows to enhance system simulation and analysis, with an emphasis on computational modeling of physical systems. This field emerged from Department of Energy workshops and initiatives starting in 2018, which also identified the need to increase "the scale, rigor, robustness, and reliability of SciML necessary for routine use in science and engineering applications" [5]. The field's subsequent growth through funding initiatives, conference themes, and high-profile publications stems from its ability to unite ML's predictive power with the domain knowledge and mathematical rigor of computational science and engineering (CSE). However, this surge in SciML development has outpaced good practices and reporting standards for building trust [66, 51, 109, 117]. SciML models must demonstrate trustworthiness to be safe and useful [44]. Organizational and computational trust definitions [92, 106] inform our criteria for trustworthy SciML: competence in basic performance, reliability across conditions, transparency about processes and limitations, and alignment with scientific objectives. These criteria span technical attributes (correctness, reliability, safety) and human-centric qualities (comprehensibility, transparency).


Single-pass Detection of Jailbreaking Input in Large Language Models

arXiv.org Artificial Intelligence

Defending aligned Large Language Models (LLMs) against jailbreaking attacks is a challenging problem, with existing approaches requiring multiple requests or even queries to auxiliary LLMs, making them computationally heavy. Instead, we focus on detecting jail-breaking input in a single forward pass. Our method, called Single Pass Detection SPD, leverages the information carried by the logits to predict whether the output sentence will be harmful. This allows us to defend in just one forward pass. SPD can not only detect attacks effectively on open-source models, but also minimizes the misclassification of harmless inputs. Furthermore, we show that SPD remains effective even without complete logit access in GPT-3.5 and GPT-4. We believe that our proposed method offers a promising approach to efficiently safeguard LLMs against adversarial attacks.


Evaluate with the Inverse: Efficient Approximation of Latent Explanation Quality Distribution

arXiv.org Artificial Intelligence

Obtaining high-quality explanations of a model's output enables developers to identify and correct biases, align the system's behavior with human values, and ensure ethical compliance. Explainable Artificial Intelligence (XAI) practitioners rely on specific measures to gauge the quality of such explanations. These measures assess key attributes, such as how closely an explanation aligns with a model's decision process (faithfulness), how accurately it pinpoints the relevant input features (localization), and its consistency across different cases (robustness). Despite providing valuable information, these measures do not fully address a critical practitioner's concern: how does the quality of a given explanation compare to other potential explanations? Traditionally, the quality of an explanation has been assessed by comparing it to a randomly generated counterpart. This paper introduces an alternative: the Quality Gap Estimate (QGE). The QGE method offers a direct comparison to what can be viewed as the `inverse' explanation, one that conceptually represents the antithesis of the original explanation. Our extensive testing across multiple model architectures, datasets, and established quality metrics demonstrates that the QGE method is superior to the traditional approach. Furthermore, we show that QGE enhances the statistical reliability of these quality assessments. This advance represents a significant step toward a more insightful evaluation of explanations that enables a more effective inspection of a model's behavior.


Drug-Target Interaction/Affinity Prediction: Deep Learning Models and Advances Review

arXiv.org Artificial Intelligence

Drug discovery remains a slow and expensive process that involves many steps, from detecting the target structure to obtaining approval from the Food and Drug Administration (FDA), and is often riddled with safety concerns. Accurate prediction of how drugs interact with their targets and the development of new drugs by using better methods and technologies have immense potential to speed up this process, ultimately leading to faster delivery of life-saving medications. Traditional methods used for drug-target interaction prediction show limitations, particularly in capturing complex relationships between drugs and their targets. As an outcome, deep learning models have been presented to overcome the challenges of interaction prediction through their precise and efficient end results. By outlining promising research avenues and models, each with a different solution but similar to the problem, this paper aims to give researchers a better idea of methods for even more accurate and efficient prediction of drug-target interaction, ultimately accelerating the development of more effective drugs. A total of 180 prediction methods for drug-target interactions were analyzed throughout the period spanning 2016 to 2025 using different frameworks based on machine learning, mainly deep learning and graph neural networks. Additionally, this paper discusses the novelty, architecture, and input representation of these models.


Attention Eclipse: Manipulating Attention to Bypass LLM Safety-Alignment

arXiv.org Artificial Intelligence

Recent research has shown that carefully crafted jailbreak inputs can induce large language models to produce harmful outputs, despite safety measures such as alignment. It is important to anticipate the range of potential Jailbreak attacks to guide effective defenses and accurate assessment of model safety. In this paper, we present a new approach for generating highly effective Jailbreak attacks that manipulate the attention of the model to selectively strengthen or weaken attention among different parts of the prompt. By harnessing attention loss, we develop more effective jailbreak attacks, that are also transferrable. The attacks amplify the success rate of existing Jailbreak algorithms including GCG, AutoDAN, and ReNeLLM, while lowering their generation cost (for example, the amplified GCG attack achieves 91.2% ASR, vs. 67.9% for the original attack on Llama2-7B/AdvBench, using less than a third of the generation time).


The National Institute of Standards and Technology Braces for Mass Firings

WIRED

Sweeping layoffs architected by the Trump administration and the so-called Department of Government Efficiency may be coming as soon as this week at the National Institute of Standards and Technology (NIST), a non-regulatory agency responsible for establishing benchmarks that ensure everything from beauty products to quantum computers are safe and reliable. According to several current and former employees at NIST, the agency has been bracing for cuts since President Donald Trump took office last month and ordered billionaire Elon Musk and DOGE to slash spending across the federal government. The fears were heightened last week when some NIST workers witnessed a handful of people they believed to be associated with DOGE inside Building 225, which houses the NIST Information Technology Laboratory at the agency's Gaithersburg, Maryland campus, according to multiple people briefed on the sightings. The DOGE staff were seeking access to NIST's IT systems, one of the people said. Soon after the purported visit, NIST leadership told employees that DOGE staffers were not currently on campus, but that office space and technology were being provisioned for them, according to the same people.


The Dream of a Dating App That Doesn't Want Your Money

The Atlantic - Technology

Spending time on dating apps, I know from experience, can make you a little paranoid. When you swipe and swipe and nothing's working out, it could be that you've had bad luck. It could be that you're too picky. It could be--oh God--that you simply don't pull like you thought you did. But sometimes, whether out of self-protection or righteous skepticism of corporate motives, you might think: Maybe the nameless faces who created this product are conspiring against me to turn a profit--meddling in my dating life so that I'll spend the rest of my days alone, paying for any feature that gives me a shred of hope.


Why the billionaire class is kissing Trump's proverbial ring

Al Jazeera

Despite all beliefs to the contrary, the billionaires who have been seen in President Donald Trump's orbit since he won the presidency for a second time last November are not mere sycophants to his regime. Former Washington Post political cartoonist Ann Telnaes should know. Last month, Telnaes quit her job after her editor refused to publish what turned out to be her last cartoon for the newspaper. In it, Telnaes drew Amazon and Washington Post owner Jeff Bezos, Los Angeles Times owner Patrick Soon-Shiong, OpenAI billionaire Sam Altman, Meta's Mark Zuckerberg, and Mickey Mouse (representing media giant Disney/American Broadcasting Company) either kneeling or bowing face down in front of a statue of the president. In explaining her decision to resign from the Post, Telnaes wrote, "Owners of such press organizations are responsible for safeguarding that free press – and trying to get in the good graces of an autocrat-in-waiting will only result in undermining that free press."


Shelters, Jesus, and Miss Pac-Man: US judge grills DOJ over trans policy in dizzying line of questioning

FOX News

Nic Talbott, a transgender U.S. Army reservist, spoke with Fox News about his lawsuit challenging a Trump executive order barring transgender military personnel. A federal judge in D.C. peppered Justice Department lawyers with hypothetical questions and video game references as she presided over the second day of oral arguments about the Trump administration's attempt to restrict or ban transgender U.S. service members in the military. U.S. District Judge Ana Reyes searched in vain for answers to key questions about the nature of a Jan. 27 executive order signed by President Donald Trump that requires the Defense Department to update its guidance regarding "trans-identifying medical standards for military service" and to "rescind guidance inconsistent with military readiness." Though Trump has instructed that "radical gender ideology" be banned from all military branches, the executive order did not explain how the Pentagon should do this – a lack of clarity that Judge Reyes, a Biden appointee, zeroed in on Wednesday. For a second day, Judge Reyes led the court through a dizzying-fast line of questions that whipsawed between real and hypothetical, fact and fiction, and was flecked with her own sarcastic quips and observations.