Goto

Collaborating Authors

 wavelength


How Does the Hive Mind Work in 'Pluribus?

WIRED

How Does the Hive Mind Work in? The "Joining" seems to connect people via radio waves. Let's dig into the physics at play. Carol Sturka (left) and her chaperone," Zosia, in the Apple TV show . You know what's great about a show like?


Water Quality Estimation Through Machine Learning Multivariate Analysis

Cardia, Marco, Chessa, Stefano, Micheli, Alessio, Luminare, Antonella Giuliana, Gambineri, Francesca

arXiv.org Artificial Intelligence

The quality of water is key for the quality of agrifood sector. Water is used in agriculture for fertigation, for animal husbandry, and in the agrifood processing industry. In the context of the progressive digitalization of this sector, the automatic assessment of the quality of water is thus becoming an important asset. In this work, we present the integration of Ultraviolet-Visible (UV-Vis) spectroscopy with Machine Learning in the context of water quality assessment aiming at ensuring water safety and the compliance of water regulation. Furthermore, we emphasize the importance of model inter-pretability by employing SHapley Additive exPlanations (SHAP) to understand the contribution of absorbance at different wavelengths to the predictions. Our approach demonstrates the potential for rapid, accurate, and interpretable assessment of key water quality parameters.


A Principles

Neural Information Processing Systems

A basic coherent optical component used in this work is an MZI. MZIs into a triangular mesh (Recks-style) or rectangular mesh (Clements-style), we can construct arbitrary N N unitary U ( N) . As a simple example, we show the principle of Recks-style MZI array for a simple demonstration. We give a detailed description of our parallel mapping algorithm. We implement ONN simulation, all models, and training logic in PyTorch 1.8.1.


The View From Space: Navigating Instrumentation Differences with EOFMs

Demilt, Ryan P., LaHaye, Nicholas, Tenneson, Karis

arXiv.org Artificial Intelligence

Earth Observation Foundation Models (EOFMs) have exploded in prevalence as tools for processing the massive volumes of remotely sensed and other earth observation data, and for delivering impact on the many essential earth monitoring tasks. An emerging trend posits using the outputs of pre-trained models as 'embeddings' which summarize high dimensional data to be used for generic tasks such as similarity search and content-specific queries. However, most EOFM models are trained only on single modalities of data and then applied or benchmarked by matching bands across different modalities. It is not clear from existing work what impact diverse sensor architectures have on the internal representations of the present suite of EOFMs. We show in this work that the representation space of EOFMs is highly sensitive to sensor architecture and that understanding this difference gives a vital perspective on the pitfalls of current EOFM design and signals for how to move forward as model developers, users, and a community guided by robust remote-sensing science.


SCANS: A Soft Gripper with Curvature and Spectroscopy Sensors for In-Hand Material Differentiation

Hanson, Nathaniel, Allison, Austin, DiMarzio, Charles, Padır, Taşkın, Dorsey, Kristen L.

arXiv.org Artificial Intelligence

We introduce the soft curvature and spectroscopy (SCANS) system: a versatile, electronics-free, fluidically actuated soft manipulator capable of assessing the spectral properties of objects either in hand or through pre-touch caging. This platform offers a wider spectral sensing capability than previous soft robotic counterparts. We perform a material analysis to explore optimal soft substrates for spectral sensing, and evaluate both pre-touch and in-hand performance. Experiments demonstrate explainable, statistical separation across diverse object classes and sizes (metal, wood, plastic, organic, paper, foam), with large spectral angle differences between items. Through linear discriminant analysis, we show that sensitivity in the near-infrared wavelengths is critical to distinguishing visually similar objects. These capabilities advance the potential of optics as a multi-functional sensory modality for soft robots. The complete parts list, assembly guidelines, and processing code for the SCANS gripper are accessible at: https://parses-lab.github.io/scans/.


A Gaussian Process Model of Quasar Spectral Energy Distributions Andrew Miller

Neural Information Processing Systems

We propose a method for combining two sources of astronomical data, spectroscopy and photometry, that carry information about sources of light (e.g., stars, galaxies, and quasars) at extremely different spectral resolutions. Our model treats the spectral energy distribution (SED) of the radiation from a source as a latent variable that jointly explains both photometric and spectroscopic observations. We place a flexible, nonparametric prior over the SED of a light source that admits a physically interpretable decomposition, and allows us to tractably perform inference. We use our model to predict the distribution of the redshift of a quasar from five-band (low spectral resolution) photometric data, the so called "photo-z" problem. Our method shows that tools from machine learning and Bayesian statistics allow us to leverage multiple resolutions of information to make accurate predictions with well-characterized uncertainties.


Field Calibration of Hyperspectral Cameras for Terrain Inference

Hanson, Nathaniel, Pyatski, Benjamin, Hibbard, Samuel, Lvov, Gary, De La Garza, Oscar, DiMarzio, Charles, Dorsey, Kristen L., Padır, Taşkın

arXiv.org Artificial Intelligence

Intra-class terrain differences such as water content directly influence a vehicle's ability to traverse terrain, yet RGB vision systems may fail to distinguish these properties. Evaluating a terrain's spectral content beyond red-green-blue wavelengths to the near infrared spectrum provides useful information for intra-class identification. However, accurate analysis of this spectral information is highly dependent on ambient illumination. We demonstrate a system architecture to collect and register multi-wavelength, hyperspectral images from a mobile robot and describe an approach to reflectance calibrate cameras under varying illumination conditions. To showcase the practical applications of our system, HYPER DRIVE, we demonstrate the ability to calculate vegetative health indices and soil moisture content from a mobile robot platform.


CARL: Camera-Agnostic Representation Learning for Spectral Image Analysis

Baumann, Alexander, Ayala, Leonardo, Seidlitz, Silvia, Sellner, Jan, Studier-Fischer, Alexander, Özdemir, Berkin, Maier-Hein, Lena, Ilic, Slobodan

arXiv.org Artificial Intelligence

Spectral imaging offers promising applications across diverse domains, including medicine and urban scene understanding, and is already established as a critical modality in remote sensing. However, variability in channel dimensionality and captured wavelengths among spectral cameras impede the development of AI-driven methodologies, leading to camera-specific models with limited generalizability and inadequate cross-camera applicability. To address this bottleneck, we introduce CARL, a model for Camera-Agnostic Representation Learning across RGB, multispectral, and hyperspectral imaging modalities. To enable the conversion of a spectral image with any channel dimensionality to a camera-agnostic representation, we introduce a novel spectral encoder, featuring a self-attention-cross-attention mechanism, to distill salient spectral information into learned spectral representations. Spatio-spectral pre-training is achieved with a novel feature-based self-supervision strategy tailored to CARL. Large-scale experiments across the domains of medical imaging, autonomous driving, and satellite imaging demonstrate our model's unique robustness to spectral heterogeneity, outperforming on datasets with simulated and real-world cross-camera spectral variations. The scalability and versatility of the proposed approach position our model as a backbone for future spectral foundation models.



What exactly is the UV Index? A dermatologist explains.

Popular Science

What exactly is the UV Index? The measurement has nothing to do with how hot it is outside. Wearing sunscreen all year round can help protect your skin from harmful UV rays. Breakthroughs, discoveries, and DIY tips sent every weekday. As of 2:19 p.m. EST today, it is officially autumn in the Northern Hemisphere .