Government
RoboMNIST: A Multimodal Dataset for Multi-Robot Activity Recognition Using WiFi Sensing, Video, and Audio
Behzad, Kian, Zandi, Rojin, Motamedi, Elaheh, Salehinejad, Hojjat, Siami, Milad
We introduce a novel dataset for multi-robot activity recognition (MRAR) using two robotic arms integrating WiFi channel state information (CSI), video, and audio data. This multimodal dataset utilizes signals of opportunity, leveraging existing WiFi infrastructure to provide detailed indoor environmental sensing without additional sensor deployment. Data were collected using two Franka Emika robotic arms, complemented by three cameras, three WiFi sniffers to collect CSI, and three microphones capturing distinct yet complementary audio data streams. The combination of CSI, visual, and auditory data can enhance robustness and accuracy in MRAR. This comprehensive dataset enables a holistic understanding of robotic environments, facilitating advanced autonomous operations that mimic human-like perception and interaction. By repurposing ubiquitous WiFi signals for environmental sensing, this dataset offers significant potential aiming to advance robotic perception and autonomous systems. It provides a valuable resource for developing sophisticated decision-making and adaptive capabilities in dynamic environments.
Do Graph Neural Networks Work for High Entropy Alloys?
Zhang, Hengrui, Huang, Ruishu, Chen, Jie, Rondinelli, James M., Chen, Wei
Graph neural networks (GNNs) have excelled in predictive modeling for both crystals and molecules, owing to the expressiveness of graph representations. High-entropy alloys (HEAs), however, lack chemical long-range order, limiting the applicability of current graph representations. To overcome this challenge, we propose a representation of HEAs as a collection of local environment (LE) graphs. Based on this representation, we introduce the LESets machine learning model, an accurate, interpretable GNN for HEA property prediction. We demonstrate the accuracy of LESets in modeling the mechanical properties of quaternary HEAs. Through analyses and interpretation, we further extract insights into the modeling and design of HEAs. In a broader sense, LESets extends the potential applicability of GNNs to disordered materials with combinatorial complexity formed by diverse constituents and their flexible configurations.
Characterization of point-source transient events with a rolling-shutter compressed sensing system
Qiu, Frank, Michalenko, Joshua, Casias, Lilian K., Radosevich, Cameron J., Slater, Jon, Shields, Eric A.
Point-source transient events (PSTEs) - optical events that are both extremely fast and extremely small - pose several challenges to an imaging system. Due to their speed, accurately characterizing such events often requires detectors with very high frame rates. Due to their size, accurately detecting such events requires maintaining coverage over an extended field-of-view, often through the use of imaging focal plane arrays (FPA) with a global shutter readout. Traditional imaging systems that meet these requirements are costly in terms of price, size, weight, power consumption, and data bandwidth, and there is a need for cheaper solutions with adequate temporal and spatial coverage. To address these issues, we develop a novel compressed sensing algorithm adapted to the rolling shutter readout of an imaging system. This approach enables reconstruction of a PSTE signature at the sampling rate of the rolling shutter, offering a 1-2 order of magnitude temporal speedup and a proportional reduction in data bandwidth. We present empirical results demonstrating accurate recovery of PSTEs using measurements that are spatially undersampled by a factor of 25, and our simulations show that, relative to other compressed sensing algorithms, our algorithm is both faster and yields higher quality reconstructions. We also present theoretical results characterizing our algorithm and corroborating simulations. The potential impact of our work includes the development of much faster, cheaper sensor solutions for PSTE detection and characterization.
LLMs generate structurally realistic social networks but overestimate political homophily
Chang, Serina, Chaszczewicz, Alicja, Wang, Emma, Josifovska, Maya, Pierson, Emma, Leskovec, Jure
Generating social networks is essential for many applications, such as epidemic modeling and social simulations. Prior approaches either involve deep learning models, which require many observed networks for training, or stylized models, which are limited in their realism and flexibility. In contrast, LLMs offer the potential for zero-shot and flexible network generation. However, two key questions are: (1) are LLM's generated networks realistic, and (2) what are risks of bias, given the importance of demographics in forming social ties? To answer these questions, we develop three prompting methods for network generation and compare the generated networks to real social networks. We find that more realistic networks are generated with "local" methods, where the LLM constructs relations for one persona at a time, compared to "global" methods that construct the entire network at once. We also find that the generated networks match real networks on many characteristics, including density, clustering, community structure, and degree. However, we find that LLMs emphasize political homophily over all other types of homophily and overestimate political homophily relative to real-world measures.
Maven: A Multimodal Foundation Model for Supernova Science
Zhang, Gemma, Helfer, Thomas, Gagliano, Alexander T., Mishra-Sharma, Siddharth, Villar, V. Ashley
A common setting in astronomy is the availability of a small number of high-quality observations, and larger amounts of either lower-quality observations or synthetic data from simplified models. Time-domain astrophysics is a canonical example of this imbalance, with the number of supernovae observed photometrically outpacing the number observed spectroscopically by multiple orders of magnitude. At the same time, no data-driven models exist to understand these photometric and spectroscopic observables in a common context. Contrastive learning objectives, which have grown in popularity for aligning distinct data modalities in a shared embedding space, provide a potential solution to extract information from these modalities. We present Maven, the first foundation model for supernova science. To construct Maven, we first pre-train our model to align photometry and spectroscopy from 0.5M synthetic supernovae using a constrastive objective. We then fine-tune the model on 4,702 observed supernovae from the Zwicky Transient Facility. Maven reaches state-of-the-art performance on both classification and redshift estimation, despite the embeddings not being explicitly optimized for these tasks. Through ablation studies, we show that pre-training with synthetic data improves overall performance. In the upcoming era of the Vera C. Rubin Observatory, Maven serves as a Rosetta Stone for leveraging large, unlabeled and multimodal time-domain datasets.
Discovery of False Data Injection Schemes on Frequency Controllers with Reinforcement Learning
Prasad, Romesh, Hassanaly, Malik, Zhang, Xiangyu, Sahu, Abhijeet
While inverter-based distributed energy resources (DERs) play a crucial role in integrating renewable energy into the power system, they concurrently diminish the grid's system inertia, elevating the risk of frequency instabilities. Furthermore, smart inverters, interfaced via communication networks, pose a potential vulnerability to cyber threats if not diligently managed. To proactively fortify the power grid against sophisticated cyber attacks, we propose to employ reinforcement learning (RL) to identify potential threats and system vulnerabilities. This study concentrates on analyzing adversarial strategies for false data injection, specifically targeting smart inverters involved in primary frequency control. Our findings demonstrate that an RL agent can adeptly discern optimal false data injection methods to manipulate inverter settings, potentially causing catastrophic consequences.
From "Made In" to Mukokuseki: Exploring the Visual Perception of National Identity in Robots
Seaborn, Katie, Kotani, Haruki, Pennefather, Peter
People read human characteristics into the design of social robots, a visual process with socio-cultural implications. One factor may be nationality, a complex social characteristic that is linked to ethnicity, culture, and other factors of identity that can be embedded in the visual design of robots. Guided by social identity theory (SIT), we explored the notion of "mukokuseki," a visual design characteristic defined by the absence of visual cues to national and ethnic identity in Japanese cultural exports. In a two-phase categorization study (n=212), American (n=110) and Japanese (n=92) participants rated a random selection of nine robot stimuli from America and Japan, plus multinational Pepper. We found evidence of made-in and two kinds of mukokuseki effects. We offer suggestions for the visual design of mukokuseki robots that may interact with people from diverse backgrounds. Our findings have implications for robots and social identity, the viability of robotic exports, and the use of robots internationally.
Nvidia rides big tech's AI investment to beat Wall Street's sky-high expectations
Chipmaker Nvidia reported its latest financial results on Wednesday, recording 30.04bn in revenue over the past three months โ a 122% jump from the year prior โ and showing that artificial intelligence investment mania shows no signs of cooling. Analysts had anticipated about 28.7bn in revenue. Shares slid more than 3% in after-hours trading. "The company continues to benefit from a market paradox: big tech's aggressive AI investment strategies drive massive demand for Nvidia's chips, even as these same companies invest in developing their own silicon," said Jacob Bourne, a technology analyst with Emarketer. Nvidia has told customers that its next-generation AI chips, code-named Blackwell, will be delayed several months from January, though early samples are shipping to a small group of customers now.
Fox News AI Newsletter: Elon Musk endorses California AI regulation bill
Fox News chief political anchor Bret Baier has the latest on the pros and cons of the bombshell developments on'Special Report.' Elon Musk, co-founder of Tesla and SpaceX and owner of X Holdings Corp., speaks at the Milken Institute's Global Conference at the Beverly Hilton Hotel,on May 6, 2024, in Beverly Hills, California. 'TOUGH CALL': Tech billionaire Elon Musk has said that California should pass a controversial bill that would regulate artificial intelligence through having tech companies and AI developers be responsible for safety testing and implementing safeguards against cyberattacks. 'NEVER TIRED': While many musicians and celebrities have spoken out against A.I., rapper wiil.i.am is getting in on the technology, announcing a new artificial intelligence app called Raidio.FYI. AI HANDY HELPER: Meta's artificial intelligence chatbot, powered by Llama 3, is designed to make your online experience smoother and more enjoyable across platforms like Facebook, Messenger, Instagram and WhatsApp.
The skyscraper window-washing robots are here
Tourists and workers alike jostling their way through New York's bustling midtown may notice an odd sight next time they look up. Dozens of floors above ground, the world's first commercial window-cleaning-robot will be thrusting its two white mechanical arms back and forth, soapy squeegees in hand. Skyline Robotics, the New York-based company behind the "Ozmo" cleaning robot, believe machines like theirs are faster and safer than traditional cleaning methods and could help address the potential shortage of human skyscraper window washers in coming years. It's just the latest example of artificial intelligence and robotics merging together to perform real-word tasks once confined to people. Starting this week, Skyline's Ozmo robot will get to work cleaning windows at 1133 Avenue of the Americas, a 45-story Class A skyscraper owned and managed by the Durst Organization near New York's Bryant Park.