Government
Palmer Luckey's vision for the future of mixed reality
Silicon Valley players are poised to benefit. One of them is Palmer Luckey, the founder of the virtual-reality headset company Oculus, which he sold to Facebook for 2 billion. After Luckey's highly public ousting from Meta, he founded Anduril, which focuses on drones, cruise missiles, and other AI-enhanced technologies for the US Department of Defense. The company is now valued at 14 billion. My colleague James O'Donnell interviewed Luckey about his new pet project: headsets for the military.
Russia-Ukraine war: List of key events, day 977
At least four people were killed in Russia's overnight bombing of Ukraine's second-largest city of Kharkiv, Mayor Ihor Terekhov said on the Telegram messaging app. Kharkiv lies about 30km (18 miles) from the Russian border and has been repeatedly targeted by Russian aerial attacks. An earlier attack on Kharkiv injured six people and destroyed much of the Derzhprom building, one of the most celebrated landmarks in the city, dating from the 1920s. Two people were injured and a residential building caught fire in Solomianskyi, a district in the Ukrainian capital, Kyiv, after a Russian drone attack, Mayor Vitali Klitschko said. One person was killed and 11 wounded after a Russian missile struck a three-storey residential building in Kryvyi Rih, Ukrainian President Volodymyr Zelenskyy's hometown.
US finalises restrictions on AI, semiconductor investments in China
The United States has finalised rules that limit investments in critical technology sectors in China such as artificial intelligence on national security grounds, the Treasury Department has announced. The restrictions will bar US citizens and permanent residents, as well as US-based companies, from engaging in transactions involving technologies including AI, semiconductors and quantum computing, the Treasury said in a statement on Monday. US investors will also be obligated to inform the Treasury about investments in some less advanced technologies "that may contribute to the threat to the national security of the United States", the Treasury said. The curbs, which are due to take effect on January 2, will ensure "US investment is not exploited to advance the development of key technologies by those who may use them to threaten our national security," said Paul Rosen, the assistant secretary of the Treasury for Investment Security. "US investments, including the intangible benefits like managerial assistance and access to investment and talent networks that often accompany such capital flows, must not be used to help countries of concern develop their military, intelligence, and cyber capabilities," Rosen said.
Continuous-Time Line-of-Sight Constrained Trajectory Planning for 6-Degree of Freedom Systems
Hayner, Christopher R., Carson, John M. III, Açıkmeşe, Behçet, Leung, Karen
Perception algorithms are ubiquitous in modern autonomy stacks, providing necessary environmental information to operate in the real world. Many of these algorithms depend on the visibility of keypoints, which must remain within the robot's line-of-sight (LoS), for reliable operation. This paper tackles the challenge of maintaining LoS on such keypoints during robot movement. We propose a novel method that addresses these issues by ensuring applicability to various sensor footprints, adaptability to arbitrary nonlinear dynamics, and constant enforcement of LoS throughout the robot's path. Through our experiments, we show that the proposed approach achieves significantly reduced LoS violation and runtime compared to existing state-of-the-art methods in several representative and challenging scenarios.
Assessing the Auditability of AI-integrating Systems: A Framework and Learning Analytics Case Study
Fernsel, Linda, Kalff, Yannick, Simbeck, Katharina
Audits contribute to the trustworthiness of Learning Analytics (LA) systems that integrate Artificial Intelligence (AI) and may be legally required in the future. We argue that the efficacy of an audit depends on the auditability of the audited system. Therefore, systems need to be designed with auditability in mind. We present a framework for assessing the auditability of AI-integrating systems that consists of three parts: (1) Verifiable claims about the validity, utility and ethics of the system, (2) Evidence on subjects (data, models or the system) in different types (documentation, raw sources and logs) to back or refute claims, (3) Evidence must be accessible to auditors via technical means (APIs, monitoring tools, explainable AI, etc.). We apply the framework to assess the auditability of Moodle's dropout prediction system and a prototype AI-based LA. We find that Moodle's auditability is limited by incomplete documentation, insufficient monitoring capabilities and a lack of available test data. The framework supports assessing the auditability of AI-based LA systems in use and improves the design of auditable systems and thus of audits.
GraphAide: Advanced Graph-Assisted Query and Reasoning System
Purohit, Sumit, Chin, George, Mackey, Patrick S, Cottam, Joseph A
Curating knowledge from multiple siloed sources that contain both structured and unstructured data is a major challenge in many real-world applications. Pattern matching and querying represent fundamental tasks in modern data analytics that leverage this curated knowledge. The development of such applications necessitates overcoming several research challenges, including data extraction, named entity recognition, data modeling, and designing query interfaces. Moreover, the explainability of these functionalities is critical for their broader adoption. The emergence of Large Language Models (LLMs) has accelerated the development lifecycle of new capabilities. Nonetheless, there is an ongoing need for domain-specific tools tailored to user activities. The creation of digital assistants has gained considerable traction in recent years, with LLMs offering a promising avenue to develop such assistants utilizing domain-specific knowledge and assumptions. In this context, we introduce an advanced query and reasoning system, GraphAide, which constructs a knowledge graph (KG) from diverse sources and allows to query and reason over the resulting KG. GraphAide harnesses both the KG and LLMs to rapidly develop domain-specific digital assistants. It integrates design patterns from retrieval augmented generation (RAG) and the semantic web to create an agentic LLM application. GraphAide underscores the potential for streamlined and efficient development of specialized digital assistants, thereby enhancing their applicability across various domains.
Turkey's Earthquakes: Damage Prediction and Feature Significance Using A Multivariate Analysis
Shah, Shrey, Lin, Alex, Lin, Scott, Patel, Josh, Lam, Michael, Zhu, Kevin
Accurate damage prediction is crucial for disaster preparedness and response strategies, particularly given the frequent earthquakes in Turkey. Utilizing datasets on earthquake data, infrastructural quality metrics, and contemporary socioeconomic factors, we tested various machine-learning architectures to forecast death tolls and fatalities per affected population. Our findings indicate that the Random Forest model provides the most reliable predictions. The model highlights earthquake magnitude and building stability as the primary determinants of damage. This research contributes to the reduction of fatalities in future seismic events in Turkey.
WikiNER-fr-gold: A Gold-Standard NER Corpus
Cao, Danrun, Béchet, Nicolas, Marteau, Pierre-François
We address in this article the the quality of the WikiNER corpus, a multilingual Named Entity Recognition corpus, and provide a consolidated version of it. The annotation of WikiNER was produced in a semi-supervised manner i.e. no manual verification has been carried out a posteriori. Such corpus is called silver-standard. In this paper we propose WikiNER-fr-gold which is a revised version of the French proportion of WikiNER. Our corpus consists of randomly sampled 20% of the original French sub-corpus (26,818 sentences with 700k tokens). We start by summarizing the entity types included in each category in order to define an annotation guideline, and then we proceed to revise the corpus. Finally we present an analysis of errors and inconsistency observed in the WikiNER-fr corpus, and we discuss potential future work directions.
Is Our Chatbot Telling Lies? Assessing Correctness of an LLM-based Dutch Support Chatbot
Lassche, Herman, Overeem, Michiel, Rastogi, Ayushi
Companies support their customers using live chats and chatbots to gain their loyalty. AFAS is a Dutch company aiming to leverage the opportunity large language models (LLMs) offer to answer customer queries with minimal to no input from its customer support team. Adding to its complexity, it is unclear what makes a response correct, and that too in Dutch. Further, with minimal data available for training, the challenge is to identify whether an answer generated by a large language model is correct and do it on the fly. This study is the first to define the correctness of a response based on how the support team at AFAS makes decisions. It leverages literature on natural language generation and automated answer grading systems to automate the decision-making of the customer support team. We investigated questions requiring a binary response (e.g., Would it be possible to adjust tax rates manually?) or instructions (e.g., How would I adjust tax rate manually?) to test how close our automated approach reaches support rating. Our approach can identify wrong messages in 55\% of the cases. This work shows the viability of automatically assessing when our chatbot tell lies.
On the Robustness of Adversarial Training Against Uncertainty Attacks
Ledda, Emanuele, Scodeller, Giovanni, Angioni, Daniele, Piras, Giorgio, Cinà, Antonio Emanuele, Fumera, Giorgio, Biggio, Battista, Roli, Fabio
In learning problems, the noise inherent to the task at hand hinders the possibility to infer without a certain degree of uncertainty. Quantifying this uncertainty, regardless of its wide use, assumes high relevance for security-sensitive applications. Within these scenarios, it becomes fundamental to guarantee good (i.e., trustworthy) uncertainty measures, which downstream modules can securely employ to drive the final decision-making process. However, an attacker may be interested in forcing the system to produce either (i) highly uncertain outputs jeopardizing the system's availability or (ii) low uncertainty estimates, making the system accept uncertain samples that would instead require a careful inspection (e.g., human intervention). Therefore, it becomes fundamental to understand how to obtain robust uncertainty estimates against these kinds of attacks. In this work, we reveal both empirically and theoretically that defending against adversarial examples, i.e., carefully perturbed samples that cause misclassification, additionally guarantees a more secure, trustworthy uncertainty estimate under common attack scenarios without the need for an ad-hoc defense strategy. To support our claims, we evaluate multiple adversarial-robust models from the publicly available benchmark RobustBench on the CIFAR-10 and ImageNet datasets.