Government
The DevSafeOps Dilemma: A Systematic Literature Review on Rapidity in Safe Autonomous Driving Development and Operation
Nouri, Ali, Cabrero-Daniel, Beatriz, Törner, Fredrik, Berger, Christian
Developing autonomous driving (AD) systems is challenging due to the complexity of the systems and the need to assure their safe and reliable operation. The widely adopted approach of DevOps seems promising to support the continuous technological progress in AI and the demand for fast reaction to incidents, which necessitate continuous development, deployment, and monitoring. We present a systematic literature review meant to identify, analyse, and synthesise a broad range of existing literature related to usage of DevOps in autonomous driving development. Our results provide a structured overview of challenges and solutions, arising from applying DevOps to safety-related AI-enabled functions. Our results indicate that there are still several open topics to be addressed to enable safe DevOps for the development of safe AD.
A General Method for Detecting Information Generated by Large Language Models
Mao, Minjia, Wei, Dongjun, Fang, Xiao, Chau, Michael
The proliferation of large language models (LLMs) has significantly transformed the digital information landscape, making it increasingly challenging to distinguish between human-written and LLM-generated content. Detecting LLM-generated information is essential for preserving trust on digital platforms (e.g., social media and e-commerce sites) and preventing the spread of misinformation, a topic that has garnered significant attention in IS research. However, current detection methods, which primarily focus on identifying content generated by specific LLMs in known domains, face challenges in generalizing to new (i.e., unseen) LLMs and domains. This limitation reduces their effectiveness in real-world applications, where the number of LLMs is rapidly multiplying and content spans a vast array of domains. In response, we introduce a general LLM detector (GLD) that combines a twin memory networks design and a theory-guided detection generalization module to detect LLM-generated information across unseen LLMs and domains. Using real-world datasets, we conduct extensive empirical evaluations and case studies to demonstrate the superiority of GLD over state-of-the-art detection methods. The study has important academic and practical implications for digital platforms and LLMs.
A Deep Learning framework for building damage assessment using VHR SAR and geospatial data: demonstration on the 2023 Turkiye Earthquake
Russo, Luigi, Tapete, Deodato, Ullo, Silvia Liberata, Gamba, Paolo
Building damage identification shortly after a disaster is crucial for guiding emergency response and recovery efforts. Although optical satellite imagery is commonly used for disaster mapping, its effectiveness is often hampered by cloud cover or the absence of pre-event acquisitions. To overcome these challenges, we introduce a novel multimodal deep learning (DL) framework for detecting building damage using single-date very high resolution (VHR) Synthetic Aperture Radar (SAR) imagery from the Italian Space Agency (ASI) COSMO SkyMed (CSK) constellation, complemented by auxiliary geospatial data. Our method integrates SAR image patches, OpenStreetMap (OSM) building footprints, digital surface model (DSM) data, and structural and exposure attributes from the Global Earthquake Model (GEM) to improve detection accuracy and contextual interpretation. Unlike existing approaches that depend on pre and post event imagery, our model utilizes only post event data, facilitating rapid deployment in critical scenarios. The framework effectiveness is demonstrated using a new dataset from the 2023 earthquake in Turkey, covering multiple cities with diverse urban settings. Results highlight that incorporating geospatial features significantly enhances detection performance and generalizability to previously unseen areas. By combining SAR imagery with detailed vulnerability and exposure information, our approach provides reliable and rapid building damage assessments without the dependency from available pre-event data. Moreover, the automated and scalable data generation process ensures the framework's applicability across diverse disaster-affected regions, underscoring its potential to support effective disaster management and recovery efforts. Code and data will be made available upon acceptance of the paper.
Digital Gatekeepers: Exploring Large Language Model's Role in Immigration Decisions
With globalization and increasing immigrant populations, many countries' immigration departments face the numerous workload with its limited staff. For instance, the Home Office Immigration and Nationality Directorate in the UK has faced increased workloads, leading to significant backlogs and administrative challenges (Yeo, 2022). Similarly, immigration judges in the USA are experiencing burnout due to enormous caseloads (Lustig et al., 2008). At the same time, these offices also face the significant challenge of ensuring fairness in their decision-making processes. Although immigration officers often view themselves as objective administrators regarding the entry and stay of immigrants (Armenta, 2012), research shows that their decisions are profoundly influenced by personal attributes (Dinesen et al., 2016), and broader social norms (Turper et al., 2015), leading to biased and discriminatory outcomes (Coates and Carr, 2005). Studies reveal that officers' decisions can be affected by emotions, stereotypes, and cultural values, resulting in profiling and differential treatment of immigrants based on nationality, race, and religion (Armenta, 2012; Dekkers, 2018).
FEAST: A Flexible Mealtime-Assistance System Towards In-the-Wild Personalization
Jenamani, Rajat Kumar, Silver, Tom, Dodson, Ben, Tong, Shiqin, Song, Anthony, Yang, Yuting, Liu, Ziang, Howe, Benjamin, Whitneck, Aimee, Bhattacharjee, Tapomayukh
Physical caregiving robots hold promise for improving the quality of life of millions worldwide who require assistance with feeding. However, in-home meal assistance remains challenging due to the diversity of activities (e.g., eating, drinking, mouth wiping), contexts (e.g., socializing, watching TV), food items, and user preferences that arise during deployment. In this work, we propose FEAST, a flexible mealtime-assistance system that can be personalized in-the-wild to meet the unique needs of individual care recipients. Developed in collaboration with two community researchers and informed by a formative study with a diverse group of care recipients, our system is guided by three key tenets for in-the-wild personalization: adaptability, transparency, and safety. FEAST embodies these principles through: (i) modular hardware that enables switching between assisted feeding, drinking, and mouth-wiping, (ii) diverse interaction methods, including a web interface, head gestures, and physical buttons, to accommodate diverse functional abilities and preferences, and (iii) parameterized behavior trees that can be safely and transparently adapted using a large language model. We evaluate our system based on the personalization requirements identified in our formative study, demonstrating that FEAST offers a wide range of transparent and safe adaptations and outperforms a state-of-the-art baseline limited to fixed customizations. To demonstrate real-world applicability, we conduct an in-home user study with two care recipients (who are community researchers), feeding them three meals each across three diverse scenarios. We further assess FEAST's ecological validity by evaluating with an Occupational Therapist previously unfamiliar with the system. In all cases, users successfully personalize FEAST to meet their individual needs and preferences. Website: https://emprise.cs.cornell.edu/feast
Mic-hackathon 2024: Hackathon on Machine Learning for Electron and Scanning Probe Microscopy
Pratiush, Utkarsh, Houston, Austin, Barakati, Kamyar, Raghavan, Aditya, Yoon, Dasol, KP, Harikrishnan, Baraissov, Zhaslan, Ma, Desheng, Welborn, Samuel S., Jakowski, Mikolaj, Barhorst, Shawn-Patrick, Pattison, Alexander J., Manganaris, Panayotis, Madugula, Sita Sirisha, Ayyagari, Sai Venkata Gayathri, Kennedy, Vishal, Bulanadi, Ralph, Wang, Michelle, Pang, Kieran J., Addison-Smith, Ian, Menacho, Willy, Guzman, Horacio V., Kiefer, Alexander, Furth, Nicholas, Kolev, Nikola L., Petrov, Mikhail, Liu, Viktoriia, Ilyev, Sergey, Rairao, Srikar, Rodani, Tommaso, Pinto-Huguet, Ivan, Chen, Xuli, Cruañes, Josep, Torrens, Marta, Pomar, Jovan, Su, Fanzhi, Vedanti, Pawan, Lyu, Zhiheng, Wang, Xingzhi, Yao, Lehan, Taqieddin, Amir, Laskowski, Forrest, Yin, Xiangyu, Shao, Yu-Tsun, Fein-Ashley, Benjamin, Jiang, Yi, Kumar, Vineet, Mishra, Himanshu, Paul, Yogesh, Bazgir, Adib, Madugula, Rama chandra Praneeth, Zhang, Yuwen, Omprakash, Pravan, Huang, Jian, Montufar-Morales, Eric, Chawla, Vivek, Sethi, Harshit, Huang, Jie, Kurki, Lauri, Guinan, Grace, Salvador, Addison, Ter-Petrosyan, Arman, Van Winkle, Madeline, Spurgeon, Steven R., Narasimha, Ganesh, Wu, Zijie, Liu, Richard, Liu, Yongtao, Slautin, Boris, Lupini, Andrew R, Vasudevan, Rama, Duscher, Gerd, Kalinin, Sergei V.
Microscopy is a primary source of information on materials structure and functionality at nanometer and atomic scales. The data generated is often well-structured, enriched with metadata and sample histories, though not always consistent in detail or format. The adoption of Data Management Plans (DMPs) by major funding agencies promotes preservation and access. However, deriving insights remains difficult due to the lack of standardized code ecosystems, benchmarks, and integration strategies. As a result, data usage is inefficient and analysis time is extensive. In addition to post-acquisition analysis, new APIs from major microscope manufacturers enable real-time, ML-based analytics for automated decision-making and ML-agent-controlled microscope operation. Yet, a gap remains between the ML and microscopy communities, limiting the impact of these methods on physics, materials discovery, and optimization. Hackathons help bridge this divide by fostering collaboration between ML researchers and microscopy experts. They encourage the development of novel solutions that apply ML to microscopy, while preparing a future workforce for instrumentation, materials science, and applied ML. This hackathon produced benchmark datasets and digital twins of microscopes to support community growth and standardized workflows. All related code is available at GitHub: https://github.com/KalininGroup/Mic-hackathon-2024-codes-publication/tree/1.0.0.1
Cannot See the Forest for the Trees: Invoking Heuristics and Biases to Elicit Irrational Choices of LLMs
Yang, Haoming, Ma, Ke, Jia, Xiaojun, Sun, Yingfei, Xu, Qianqian, Huang, Qingming
Despite the remarkable performance of Large Language Models (LLMs), they remain vulnerable to jailbreak attacks, which can compromise their safety mechanisms. Existing studies often rely on brute-force optimization or manual design, failing to uncover potential risks in real-world scenarios. To address this, we propose a novel jailbreak attack framework, ICRT, inspired by heuristics and biases in human cognition. Leveraging the simplicity effect, we employ cognitive decomposition to reduce the complexity of malicious prompts. Simultaneously, relevance bias is utilized to reorganize prompts, enhancing semantic alignment and inducing harmful outputs effectively. Furthermore, we introduce a ranking-based harmfulness evaluation metric that surpasses the traditional binary success-or-failure paradigm by employing ranking aggregation methods such as Elo, HodgeRank, and Rank Centrality to comprehensively quantify the harmfulness of generated content. Experimental results show that our approach consistently bypasses mainstream LLMs' safety mechanisms and generates high-risk content, providing insights into jailbreak attack risks and contributing to stronger defense strategies.
Graph ODEs and Beyond: A Comprehensive Survey on Integrating Differential Equations with Graph Neural Networks
Liu, Zewen, Wang, Xiaoda, Wang, Bohan, Huang, Zijie, Yang, Carl, Jin, Wei
Graph Neural Networks (GNNs) and differential equations (DEs) are two rapidly advancing areas of research that have shown remarkable synergy in recent years. GNNs have emerged as powerful tools for learning on graph-structured data, while differential equations provide a principled framework for modeling continuous dynamics across time and space. The intersection of these fields has led to innovative approaches that leverage the strengths of both, enabling applications in physics-informed learning, spatiotemporal modeling, and scientific computing. This survey aims to provide a comprehensive overview of the burgeoning research at the intersection of GNNs and DEs. We will categorize existing methods, discuss their underlying principles, and highlight their applications across domains such as molecular modeling, traffic prediction, and epidemic spreading. Furthermore, we identify open challenges and outline future research directions to advance this interdisciplinary field. A comprehensive paper list is provided at https://github.com/Emory-Melody/Awesome-Graph-NDEs. This survey serves as a resource for researchers and practitioners seeking to understand and contribute to the fusion of GNNs and DEs
A Framework for Multi-source Privacy Preserving Epidemic Analysis
Guan, Zihan, Zhao, Zhiyuan, Tian, Fengwei, Nguyen, Dung, Bhattacharjee, Payel, Tandon, Ravi, Prakash, B. Aditya, Vullikanti, Anil
It is now well understood that diverse datasets provide a lot of value in key epidemiology and public health analyses, such as forecasting and nowcasting, development of epidemic models, evaluation and design of interventions and resource allocation. Some of these datasets are often sensitive, and need adequate privacy protections. There are many models of privacy, but Differential Privacy (DP) has become a de facto standard because of its strong guarantees, without making models about adversaries. In this paper, we develop a framework the integrates deep learning and epidemic models to simultaneously perform epidemic forecasting and learning a mechanistic model of epidemic spread, while incorporating multiple datasets for these analyses, including some with DP guarantees. We demonstrate our framework using a realistic but synthetic financial dataset with DP; such a dataset has not been used in such epidemic analyses. We show that this dataset provides significant value in forecasting and learning an epidemic model, even when used with DP guarantees.
Evaluating Pointing Gestures for Target Selection in Human-Robot Collaboration
-- Pointing gestures are a common interaction method used in Human-Robot Collaboration for various tasks, ranging from selecting targets to guiding industrial processes. This study introduces a method for localizing pointed targets within a planar workspace. The approach employs pose estimation, and a simple geometric model based on shoulder-wrist extension to extract gesturing data from an RGB-D stream. The study proposes a rigorous methodology and comprehensive analysis for evaluating pointing gestures and target selection in typical robotic tasks. In addition to evaluating tool accuracy, the tool is integrated into a proof-of-concept robotic system, which includes object detection, speech transcription, and speech synthesis to demonstrate the integration of multiple modalities in a collaborative application. Finally, a discussion over tool limitations and performance is provided to understand its role in multimodal robotic systems. Deictic gestures are a natural way to interact with the world to identify objects of interest [1]. In collaborative robotic systems, pointing gestures can be used as a powerful tool to perform decision-making, such as target selection. Using gestures has its advantage especially in industrial environments, where interpreting speech commands can be difficult due to noise. Localizing pointing gestures creates a new layer of information that can be used as a basis for gestural algorithms in collaborative systems.