Energy
Isambard-AI: a leadership class supercomputer optimised specifically for Artificial Intelligence
McIntosh-Smith, Simon, Alam, Sadaf R, Woods, Christopher
Isambard-AI is a new, leadership-class supercomputer, designed to support AI-related research. Based on the HPE Cray EX4000 system, and housed in a new, energy efficient Modular Data Centre in Bristol, UK, Isambard-AI employs 5,448 NVIDIA Grace-Hopper GPUs to deliver over 21 ExaFLOP/s of 8-bit floating point performance for LLM training, and over 250 PetaFLOP/s of 64-bit performance, for under 5MW. Isambard-AI integrates two, all-flash storage systems: a 20 PiByte Cray ClusterStor and a 3.5 PiByte VAST solution. Combined these give Isambard-AI flexibility for training, inference and secure data accesses and sharing. But it is the software stack where Isambard-AI will be most different from traditional HPC systems. Isambard-AI is designed to support users who may have been using GPUs in the cloud, and so access will more typically be via Jupyter notebooks, MLOps, or other web-based, interactive interfaces, rather than the approach used on traditional supercomputers of sshing into a system before submitting jobs to a batch scheduler. Its stack is designed to be quickly and regularly upgraded to keep pace with the rapid evolution of AI software, with full support for containers. Phase 1 of Isambard-AI is due online in May/June 2024, with the full system expected in production by the end of the year.
Survival Multiarmed Bandits with Bootstrapping Methods
Veroutis, Peter, Godin, Frรฉdรฉric
Determining optimal actions requires an appropriate balance of exploration and exploitation at each stage. In the traditional setting, actions which maximize the cumulative expected reward are deemed to be optimal. The MAB framework has seen many practical applications in a wide variety of fields like healthcare, finance, machine learning and telecommunication to name a few [Bouneffouf and Rish, 2019]. Recent literature has extended the bandits framework with alternative objectives such as Risk-Averse Multiarmed Bandits (RA-MAB) and Budgeted Multiarmed Bandits (B-MAB), which broaden the scope of applications of bandits models. The RA-MAB are concerned with the risk of rewards [Sani et al., 2012] and the B-MAB with a cost associated with each action that depletes a finite budget [Xia et al., 2017].
Intelligent Mobility System with Integrated Motion Planning and Control Utilizing Infrastructure Sensor Nodes
Yang, Yufeng, Ning, Minghao, Huang, Shucheng, Hashemi, Ehsan, Khajepour, Amir
This paper introduces a framework for an indoor autonomous mobility system that can perform patient transfers and materials handling. Unlike traditional systems that rely on onboard perception sensors, the proposed approach leverages a global perception and localization (PL) through Infrastructure Sensor Nodes (ISNs) and cloud computing technology. Using the global PL, an integrated Model Predictive Control (MPC)-based local planning and tracking controller augmented with Artificial Potential Field (APF) is developed, enabling reliable and efficient motion planning and obstacle avoidance ability while tracking predefined reference motions. Simulation results demonstrate the effectiveness of the proposed MPC controller in smoothly navigating around both static and dynamic obstacles. The proposed system has the potential to extend to intelligent connected autonomous vehicles, such as electric or cargo transport vehicles with four-wheel independent drive/steering (4WID-4WIS) configurations.
Local Loss Optimization in the Infinite Width: Stable Parameterization of Predictive Coding Networks and Target Propagation
Ishikawa, Satoki, Yokota, Rio, Karakida, Ryo
Local learning, which trains a network through layer-wise local targets and losses, has been studied as an alternative to backpropagation (BP) in neural computation. However, its algorithms often become more complex or require additional hyperparameters because of the locality, making it challenging to identify desirable settings in which the algorithm progresses in a stable manner. To provide theoretical and quantitative insights, we introduce the maximal update parameterization ($\mu$P) in the infinite-width limit for two representative designs of local targets: predictive coding (PC) and target propagation (TP). We verified that $\mu$P enables hyperparameter transfer across models of different widths. Furthermore, our analysis revealed unique and intriguing properties of $\mu$P that are not present in conventional BP. By analyzing deep linear networks, we found that PC's gradients interpolate between first-order and Gauss-Newton-like gradients, depending on the parameterization. We demonstrate that, in specific standard settings, PC in the infinite-width limit behaves more similarly to the first-order gradient. For TP, even with the standard scaling of the last layer, which differs from classical $\mu$P, its local loss optimization favors the feature learning regime over the kernel regime.
Toward Realistic Cinema: The State of the Art in Mechatronics for Modern Animatronic
Hilal, Riham M., El-Hussieny, Haitham, Nada, Ayman A.
The pursuit of realism in cinema has driven significant advancements in animatronics, where the integration of mechatronics, a multidisciplinary field that combines mechanical engineering, electronics, and computer science, plays a pivotal role in enhancing the functionality and realism of animatronics. This interdisciplinary approach facilitates smoother characters movements and enhances the sophistication of behaviors in animatronic creatures, thereby increasing their realism. This article examines the most recent developments in mechatronic technology and their significant impact on the art and engineering of animatronics in the filmmaking. It explores the sophisticated integration of system components and analyzes how these enhancements foster complexity and integration, crucial for achieving unprecedented levels of realism in modern cinema. Further, the article delves into in-depth case studies of well-known movie characters, demonstrating the practical applicability of these state-of-the-art mechatronic solutions in creating compelling, lifelike cinematic experiences. This paper aims to bridge the gap between the technical aspects of mechatronics and the creative demands of the film industry, ultimately contributing to the ongoing evolution of cinematic realism.
Learning Multiple Initial Solutions to Optimization Problems
Sharony, Elad, Yang, Heng, Che, Tong, Pavone, Marco, Mannor, Shie, Karkus, Peter
Sequentially solving similar optimization problems under strict runtime constraints is essential for many applications, such as robot control, autonomous driving, and portfolio management. The performance of local optimization methods in these settings is sensitive to the initial solution: poor initialization can lead to slow convergence or suboptimal solutions. To address this challenge, we propose learning to predict \emph{multiple} diverse initial solutions given parameters that define the problem instance. We introduce two strategies for utilizing multiple initial solutions: (i) a single-optimizer approach, where the most promising initial solution is chosen using a selection function, and (ii) a multiple-optimizers approach, where several optimizers, potentially run in parallel, are each initialized with a different solution, with the best solution chosen afterward. We validate our method on three optimal control benchmark tasks: cart-pole, reacher, and autonomous driving, using different optimizers: DDP, MPPI, and iLQR. We find significant and consistent improvement with our method across all evaluation settings and demonstrate that it efficiently scales with the number of initial solutions required. The code is available at $\href{https://github.com/EladSharony/miso}{\tt{https://github.com/EladSharony/miso}}$.
First observations of the seiche that shook the world
Monahan, Thomas, Tang, Tianning, Roberts, Stephen, Adcock, Thomas A. A.
Extreme events are evolving as a direct consequence of climate change, leading to the emergence of new, previously unobserved phenomena [1, 2]. In remote regions like the Arctic, where in-situ measurements are sparse, scientists must increasingly depend on analytical and numerical models to explore these events. However, modeling in such regions presents significant challenges due to the uncertainties in the data required to calibrate and validate these models [3]. Consequently, large simplifications are often necessary, resulting in substantial discrepancies between observed and modeled phenomena. The mysterious 10.88 mHz very-long-period (VLP) seismic signal, which appeared following a tsunamigenic landslide in the Dickson Fjord, Greenland, on September 16th, 2023, and the subsequent interdisciplinary scientific efforts to determine its origin, underscore these challenges. Two independent studies [4, 5] have hypothesized that the signal was driven by a standing wave, or seiche, which formed in the aftermath of the tsunami. While it is well-documented that seiches can form in resonant enclosed and semi-enclosed basins [6], the loading-induced tilt they produce has only been observed locally (< 30 km) and for short durations (< 1 hour)[5, 7]. Moreover, no prior evidence exists of persistent fluid sloshing (lasting several days) without an external driver.
Intelligent Magnetic Inspection Robot for Enhanced Structural Health Monitoring of Ferromagnetic Infrastructure
Tseng, Angelina, Kalaycioglu, Sean
This paper presents an innovative solution to the issue of infrastructure deterioration in the U.S., where a significant portion of facilities are in poor condition, and over 130,000 steel bridges have exceeded their lifespan. Aging steel structures face corrosion and hidden defects, posing major safety risks. The Silver Bridge collapse, resulting from an undetected flaw, highlights the limitations of manual inspection methods, which often miss subtle or concealed defects. Addressing the need for improved inspection technology, this work introduces an AI-powered magnetic inspection robot. Equipped with magnetic wheels, the robot adheres to and navigates complex ferromagnetic surfaces, including challenging areas like vertical inclines and internal corners, enabling thorough, large-scale inspections. Utilizing MobileNetV2, a deep learning model trained on steel surface defects, the system achieved an 85% precision rate across six defect types. This AI-driven inspection process enhances accuracy and reliability, outperforming traditional methods in defect detection and efficiency. The findings suggest that combining robotic mobility with AI-based image analysis offers a scalable, automated approach to infrastructure inspection, reducing human labor while improving detection precision and the safety of critical assets.
Generative Artificial Intelligence Meets Synthetic Aperture Radar: A Survey
Huang, Zhongling, Zhang, Xidan, Tang, Zuqian, Xu, Feng, Datcu, Mihai, Han, Junwei
SAR images possess unique attributes that present challenges for both human observers and vision AI models to interpret, owing to their electromagnetic characteristics. The interpretation of SAR images encounters various hurdles, with one of the primary obstacles being the data itself, which includes issues related to both the quantity and quality of the data. The challenges can be addressed using generative AI technologies. Generative AI, often known as GenAI, is a very advanced and powerful technology in the field of artificial intelligence that has gained significant attention. The advancement has created possibilities for the creation of texts, photorealistic pictures, videos, and material in various modalities. This paper aims to comprehensively investigate the intersection of GenAI and SAR. First, we illustrate the common data generation-based applications in SAR field and compare them with computer vision tasks, analyzing the similarity, difference, and general challenges of them. Then, an overview of the latest GenAI models is systematically reviewed, including various basic models and their variations targeting the general challenges. Additionally, the corresponding applications in SAR domain are also included. Specifically, we propose to summarize the physical model based simulation approaches for SAR, and analyze the hybrid modeling methods that combine the GenAI and interpretable models. The evaluation methods that have been or could be applied to SAR, are also explored. Finally, the potential challenges and future prospects are discussed. To our best knowledge, this survey is the first exhaustive examination of the interdiscipline of SAR and GenAI, encompassing a wide range of topics, including deep neural networks, physical models, computer vision, and SAR images. The resources of this survey are open-source at \url{https://github.com/XAI4SAR/GenAIxSAR}.
Agent-Based Modeling for Multimodal Transportation of $CO_2$ for Carbon Capture, Utilization, and Storage: CCUS-Agent
Uddin, Majbah, Clark, Robin, Hilliard, Michael, Thompson, Joshua, Langholtz, Matthew, Webb, Erin
To understand the system-level interactions between the entities in Carbon Capture, Utilization, and Storage (CCUS), an agent-based foundational modeling tool, CCUS-Agent, is developed for a large-scale study of transportation flows and infrastructure in the United States. Key features of the tool include (i) modular design, (ii) multiple transportation modes, (iii) capabilities for extension, and (iv) testing against various system components and networks of small and large sizes. Five matching algorithms for CO2 supply agents (e.g., powerplants and industrial facilities) and demand agents (e.g., storage and utilization sites) are explored: Most Profitable First Year (MPFY), Most Profitable All Years (MPAY), Shortest Total Distance First Year (SDFY), Shortest Total Distance All Years (SDAY), and Shortest distance to long-haul transport All Years (ACAY). Before matching, the supply agent, demand agent, and route must be available, and the connection must be profitable. A profitable connection means the supply agent portion of revenue from the 45Q tax credit must cover the supply agent costs and all transportation costs, while the demand agent revenue portion must cover all demand agent costs. A case study employing over 5,500 supply and demand agents and multimodal CCUS transportation infrastructure in the contiguous United States is conducted. The results suggest that it is possible to capture over 9 billion tonnes (GT) of CO2 from 2025 to 2043, which will increase significantly to 22 GT if the capture costs are reduced by 40%. The MPFY and SDFY algorithms capture more CO2 earlier in the time horizon, while the MPAY and SDAY algorithms capture more later in the time horizon.