Government
Cyber Knowledge Completion Using Large Language Models
Webb, Braden K, Purohit, Sumit, Meyur, Rounak
The integration of the Internet of Things (IoT) into Cyber-Physical Systems (CPSs) has expanded their cyber-attack surface, introducing new and sophisticated threats with potential to exploit emerging vulnerabilities. Assessing the risks of CPSs is increasingly difficult due to incomplete and outdated cybersecurity knowledge. This highlights the urgent need for better-informed risk assessments and mitigation strategies. While previous efforts have relied on rule-based natural language processing (NLP) tools to map vulnerabilities, weaknesses, and attack patterns, recent advancements in Large Language Models (LLMs) present a unique opportunity to enhance cyber-attack knowledge completion through improved reasoning, inference, and summarization capabilities. We apply embedding models to encapsulate information on attack patterns and adversarial techniques, generating mappings between them using vector embeddings. Additionally, we propose a Retrieval-Augmented Generation (RAG)-based approach that leverages pre-trained models to create structured mappings between different taxonomies of threat patterns. Further, we use a small hand-labeled dataset to compare the proposed RAG-based approach to a baseline standard binary classification model. Thus, the proposed approach provides a comprehensive framework to address the challenge of cyber-attack knowledge graph completion.
EnIGMA: Enhanced Interactive Generative Model Agent for CTF Challenges
Abramovich, Talor, Udeshi, Meet, Shao, Minghao, Lieret, Kilian, Xi, Haoran, Milner, Kimberly, Jancheska, Sofija, Yang, John, Jimenez, Carlos E., Khorrami, Farshad, Krishnamurthy, Prashanth, Dolan-Gavitt, Brendan, Shafique, Muhammad, Narasimhan, Karthik, Karri, Ramesh, Press, Ofir
Although language model (LM) agents are demonstrating growing potential in many domains, their success in cybersecurity has been limited due to simplistic design and the lack of fundamental features for this domain. We present EnIGMA, an LM agent for autonomously solving Capture The Flag (CTF) challenges. EnIGMA introduces new Agent-Computer Interfaces (ACIs) to improve the success rate on CTF challenges. We establish the novel Interactive Agent Tool concept, which enables LM agents to run interactive command-line utilities essential for these challenges. Empirical analysis of EnIGMA on over 350 CTF challenges from three different benchmarks indicates that providing a robust set of new tools with demonstration of their usage helps the LM solve complex problems and achieves state-of-the-art results on the NYU CTF and Intercode-CTF benchmarks. Finally, we discuss insights on ACI design and agent behavior on cybersecurity tasks that highlight the need to adapt real-world tools for LM agents.
Seeing Faces in Things: A Model and Dataset for Pareidolia
Hamilton, Mark, Stent, Simon, DuTell, Vasha, Harrington, Anne, Corbett, Jennifer, Rosenholtz, Ruth, Freeman, William T.
The human visual system is well-tuned to detect faces of all shapes and sizes. While this brings obvious survival advantages, such as a better chance of spotting unknown predators in the bush, it also leads to spurious face detections. "Face pareidolia" describes the perception of face-like structure among otherwise random stimuli: seeing faces in coffee stains or clouds in the sky. In this paper, we study face pareidolia from a computer vision perspective. We present an image dataset of "Faces in Things", consisting of five thousand web images with humanannotated pareidolic faces. Using this dataset, we examine the extent to which a state-of-the-art human face detector exhibits pareidolia, and find a significant behavioral gap between humans and machines. We find that the evolutionary need for humans to detect animal faces, as well as human faces, may explain some of this gap. Finally, we propose a simple statistical model of pareidolia in images. Through studies on human subjects and our pareidolic face detectors we confirm a key prediction of our model regarding what image conditions are most likely to induce pareidolia.
Creating Healthy Friction: Determining Stakeholder Requirements of Job Recommendation Explanations
Schellingerhout, Roan, Barile, Francesco, Tintarev, Nava
The increased use of information retrieval in recruitment, primarily through job recommender systems (JRSs), can have a large impact on job seekers, recruiters, and companies. As a result, such systems have been determined to be high-risk in recent legislature. This requires JRSs to be trustworthy and transparent, allowing stakeholders to understand why specific recommendations were made. To fulfill this requirement, the stakeholders' exact preferences and needs need to be determined. To do so, we evaluated an explainable job recommender system using a realistic, task-based, mixed-design user study (n=30) in which stakeholders had to make decisions based on the model's explanations. This mixed-methods evaluation consisted of two objective metrics - correctness and efficiency, along with three subjective metrics - trust, transparency, and usefulness. These metrics were evaluated twice per participant, once using real explanations and once using random explanations. The study included a qualitative analysis following a think-aloud protocol while performing tasks adapted to each stakeholder group. We find that providing stakeholders with real explanations does not significantly improve decision-making speed and accuracy. Our results showed a non-significant trend for the real explanations to outperform the random ones on perceived trust, usefulness, and transparency of the system for all stakeholder types. We determine that stakeholders benefit more from interacting with explanations as decision support capable of providing healthy friction, rather than as previously-assumed persuasive tools.
Five questions and answers about artificial intelligence
Prieto, Alberto, Prieto, Beatriz
Rapid advances in Artificial Intelligence (AI) are generating much controversy in society, often without scientific basis. As occurred the development of other emerging technologies, such as the introduction of electricity in the early 20th century, AI causes both fascination and fear. Following the advice of the philosopher R.W. Emerson's advice'the knowledge is the antidote to fear', this paper seeks to contribute to the dissemination of knowledge about AI. To this end, it reflects on the following questions: the origins of AI, its possible future evolution, its ability to show feelings, the associated threats and dangers, and the concept of AI singularity Keywords: Artificial Intelligence (AI), Fourth Industrial Revolution, Beginnings of AI, Development of AI, Automatic learning, Machine learning, Feelings in AI, Dangers of AI, Advantages of AI, Singularity of AI, Superintelligence, Frictionless Reproducibility (FR), Large Language Models, General AI (GAI), Intelligence, GPT Chat.
TiltXter: CNN-based Electro-tactile Rendering of Tilt Angle for Telemanipulation of Pasteur Pipettes
Cabrera, Miguel Altamirano, Tirado, Jonathan, Fedoseev, Aleksey, Sautenkov, Oleg, Poliakov, Vladimir, Kopanev, Pavel, Tsetserukou, Dzmitry
The shape of deformable objects can change drastically during grasping by robotic grippers, causing an ambiguous perception of their alignment and hence resulting in errors in robot positioning and telemanipulation. Rendering clear tactile patterns is fundamental to increasing users' precision and dexterity through tactile haptic feedback during telemanipulation. Therefore, different methods have to be studied to decode the sensors' data into haptic stimuli. This work presents a telemanipulation system for plastic pipettes that consists of a Force Dimension Omega.7 haptic interface endowed with two electro-stimulation arrays and two tactile sensor arrays embedded in the 2-finger Robotiq gripper. We propose a novel approach based on convolutional neural networks (CNN) to detect the tilt of deformable objects. The CNN generates a tactile pattern based on recognized tilt data to render further electro-tactile stimuli provided to the user during the telemanipulation. The study has shown that using the CNN algorithm, tilt recognition by users increased from 23.13\% with the downsized data to 57.9%, and the success rate during teleoperation increased from 53.12% using the downsized data to 92.18% using the tactile patterns generated by the CNN.
PALLM: Evaluating and Enhancing PALLiative Care Conversations with Large Language Models
Wang, Zhiyuan, Yuan, Fangxu, LeBaron, Virginia, Flickinger, Tabor, Barnes, Laura E.
Effective patient-provider communication is crucial in clinical care, directly impacting patient outcomes and quality of life. Traditional evaluation methods, such as human ratings, patient feedback, and provider self-assessments, are often limited by high costs and scalability issues. Although existing natural language processing (NLP) techniques show promise, they struggle with the nuances of clinical communication and require sensitive clinical data for training, reducing their effectiveness in real-world applications. Emerging large language models (LLMs) offer a new approach to assessing complex communication metrics, with the potential to advance the field through integration into passive sensing and just-in-time intervention systems. This study explores LLMs as evaluators of palliative care communication quality, leveraging their linguistic, in-context learning, and reasoning capabilities. Specifically, using simulated scripts crafted and labeled by healthcare professionals, we test proprietary models (e.g., GPT-4) and fine-tune open-source LLMs (e.g., LLaMA2) with a synthetic dataset generated by GPT-4 to evaluate clinical conversations, to identify key metrics such as `understanding' and `empathy'. Our findings demonstrated LLMs' superior performance in evaluating clinical communication, providing actionable feedback with reasoning, and demonstrating the feasibility and practical viability of developing in-house LLMs. This research highlights LLMs' potential to enhance patient-provider interactions and lays the groundwork for downstream steps in developing LLM-empowered clinical health systems.
Footage shows underwater robot salvaging Titan sub
Footage of the Titan submersible's salvage has been released by the US Coast Guard's Marine Board of Investigation (MBI). A remotely operated vehicle captured the footage on 26 June 2023, but the video was shown 23 September 2024 during a hearing investigating what led to the submersible imploding. The wreckage was recovered and transported to a secure facility for further analysis as part of the ongoing investigation.
US plans to prohibit key Chinese software, hardware in connected vehicles
The United States Department of Commerce has proposed prohibiting key Chinese software and hardware in connected vehicles on American roads due to national security concerns, a move that would in effect bar Chinese cars and trucks from the US market. The planned regulation, proposed on Monday, would also force American and other major automakers in years ahead to remove key Chinese software and hardware from vehicles in the US. President Joe Biden's administration has raised concerns about data collection on US drivers and infrastructure by connected Chinese vehicles and potential foreign manipulation of vehicles connected to the internet and navigation systems. In February, the White House ordered an investigation. The proposed prohibitions would prevent testing of self-driving cars on US roads by Chinese automakers, extend to vehicle software and hardware produced by Russia, and could be extended to other US adversaries.
Hundreds of millions of US research dollars may have aided Chinese military technology, GOP-led report says
House Republicans argue in a new congressional report that hundreds of millions of dollars in federal research funding over the last decade has contributed to China's military technological advancements. Collaborations between U.S. and Chinese academics have led to research publications related to advanced research on topics like hypersonics, directed energy, nuclear and high energy physics, and artificial intelligence and autonomy. That information, Republicans argue, could be weaponized against the U.S. in the event of war with China. Some of the collaborative research they identified related to military applications like high-performance explosives, tracking of targets and drone operation networks. The House Select Committee on China Competition, together with the Education and Workforce Committee, found some 9,000 joint research publications that were funded either through the Department of Defense (DOD) or the Intelligence Community (IC) published by co-authors with ties to China's "defense and security apparatus," including entities that are on a Commerce Department blacklist.