Uncertainty
Map Point Selection for Visual SLAM
Müller, Christiaan J., van Daalen, Corné E.
Simultaneous localisation and mapping (SLAM) play a vital role in autonomous robotics. Robotic platforms are often resource-constrained, and this limitation motivates resource-efficient SLAM implementations. While sparse visual SLAM algorithms offer good accuracy for modest hardware requirements, even these more scalable sparse approaches face limitations when applied to large-scale and long-term scenarios. A contributing factor is that the point clouds resulting from SLAM are inefficient to use and contain significant redundancy. This paper proposes the use of subset selection algorithms to reduce the map produced by sparse visual SLAM algorithms. Information-theoretic techniques have been applied to simpler related problems before, but they do not scale if applied to the full visual SLAM problem. This paper proposes a number of novel information\hyp{}theoretic utility functions for map point selection and optimises these functions using greedy algorithms. The reduced maps are evaluated using practical data alongside an existing visual SLAM implementation (ORB-SLAM 2). Approximate selection techniques proposed in this paper achieve trajectory accuracy comparable to an offline baseline while being suitable for online use. These techniques enable the practical reduction of maps for visual SLAM with competitive trajectory accuracy. Results also demonstrate that SLAM front-end performance can significantly impact the performance of map point selection. This shows the importance of testing map point selection with a front-end implementation. To exploit this, this paper proposes an approach that includes a model of the front-end in the utility function when additional information is available. This approach outperforms alternatives on applicable datasets and highlights future research directions.
Variational Counterfactual Prediction under Runtime Domain Corruption
Wen, Hechuan, Chen, Tong, Chai, Li Kheng, Sadiq, Shazia, Gao, Junbin, Yin, Hongzhi
To date, various neural methods have been proposed for causal effect estimation based on observational data, where a default assumption is the same distribution and availability of variables at both training and inference (i.e., runtime) stages. However, distribution shift (i.e., domain shift) could happen during runtime, and bigger challenges arise from the impaired accessibility of variables. This is commonly caused by increasing privacy and ethical concerns, which can make arbitrary variables unavailable in the entire runtime data and imputation impractical. We term the co-occurrence of domain shift and inaccessible variables runtime domain corruption, which seriously impairs the generalizability of a trained counterfactual predictor. To counter runtime domain corruption, we subsume counterfactual prediction under the notion of domain adaptation. Specifically, we upper-bound the error w.r.t. the target domain (i.e., runtime covariates) by the sum of source domain error and inter-domain distribution distance. In addition, we build an adversarially unified variational causal effect model, named VEGAN, with a novel two-stage adversarial domain adaptation scheme to reduce the latent distribution disparity between treated and control groups first, and between training and runtime variables afterwards. We demonstrate that VEGAN outperforms other state-of-the-art baselines on individual-level treatment effect estimation in the presence of runtime domain corruption on benchmark datasets.
Improving Log-Cumulant Based Estimation of Roughness Information in SAR imagery
Neto, Jeova Farias Sales Rocha, Rodrigues, Francisco Alixandre Avila
Synthetic Aperture Radar (SAR) image understanding is crucial in remote sensing applications, but it is hindered by its intrinsic noise contamination, called speckle. Sophisticated statistical models, such as the $\mathcal{G}^0$ family of distributions, have been employed to SAR data and many of the current advancements in processing this imagery have been accomplished through extracting information from these models. In this paper, we propose improvements to parameter estimation in $\mathcal{G}^0$ distributions using the Method of Log-Cumulants. First, using Bayesian modeling, we construct that regularly produce reliable roughness estimates under both $\mathcal{G}^0_A$ and $\mathcal{G}^0_I$ models. Second, we make use of an approximation of the Trigamma function to compute the estimated roughness in constant time, making it considerably faster than the existing method for this task. Finally, we show how we can use this method to achieve fast and reliable SAR image understanding based on roughness information.
Auditing Predictive Models for Intersectional Biases
Boxer, Kate S., McFowland, Edward III, Neill, Daniel B.
Predictive models that satisfy group fairness criteria in aggregate for members of a protected class, but do not guarantee subgroup fairness, could produce biased predictions for individuals at the intersection of two or more protected classes. To address this risk, we propose Conditional Bias Scan (CBS), a flexible auditing framework for detecting intersectional biases in classification models. CBS identifies the subgroup for which there is the most significant bias against the protected class, as compared to the equivalent subgroup in the non-protected class, and can incorporate multiple commonly used fairness definitions for both probabilistic and binarized predictions. We show that this methodology can detect previously unidentified intersectional and contextual biases in the COMPAS pre-trial risk assessment tool and has higher bias detection power compared to similar methods that audit for subgroup fairness.
Robust Statistical Comparison of Random Variables with Locally Varying Scale of Measurement
Jansen, Christoph, Schollmeyer, Georg, Blocher, Hannah, Rodemann, Julian, Augustin, Thomas
Spaces with locally varying scale of measurement, like multidimensional structures with differently scaled dimensions, are pretty common in statistics and machine learning. Nevertheless, it is still understood as an open question how to exploit the entire information encoded in them properly. We address this problem by considering an order based on (sets of) expectations of random variables mapping into such non-standard spaces. This order contains stochastic dominance and expectation order as extreme cases when no, or respectively perfect, cardinal structure is given. We derive a (regularized) statistical test for our proposed generalized stochastic dominance (GSD) order, operationalize it by linear optimization, and robustify it by imprecise probability models. Our findings are illustrated with data from multidimensional poverty measurement, finance, and medicine.
CosmoPower-JAX: high-dimensional Bayesian inference with differentiable cosmological emulators
Spurio Mancini et al. (2022) (SM22 hereafter), the exploration of high-dimensional parameter spaces in particular, developed CosmoPower, a suite of - O(100) parameters and higher - necessary to accurately neural network emulators of cosmological power spectra model the physical signals and their several systematic that replaces the computation of these quantities traditionally contaminants. Sampling the posterior distribution performed with Einstein-Boltzmann solvers such in these high-dimensional spaces represents a significant as the Code for Anisotropies in the Microwave Background computational challenge for Markov Chain Monte Carlo (CAMB, Lewis & Challinor 2011) or the Cosmic (MCMC) algorithms (Roberts et al. 1997; Katafygiotis Linear Anisotropy Solving System (CLASS, Blas et al. & Zuev 2008; Liu 2009), which are traditionally used 2011). In SM22 the authors show how Bayesian inference in cosmological analyses (Lewis & Bridle 2002; Audren of cosmological parameters can be accelerated by several et al. 2013; Brinckmann & Lesgourgues 2019; Torrado & orders of magnitude using CosmoPower; the speed-up becomes Lewis 2021). Gradient-based inference methods, such as particularly relevant when the emulators are employed Hamiltonian Monte Carlo (HMC, Duane et al. 1987; Neal within an inference pipeline that can be run on 1996) and variational inference (VI, Hoffman et al. 2013; graphics processing units (GPUs). Blei et al. 2017), manage to concentrate the sampling An additional advantage in using machine learning in regions of high posterior mass, even in large parameter emulators is that they efficiently provide accurate derivatives spaces, provided one has efficient access to accurate with respect to their input parameters. This is derivatives of the likelihood function with respect to made possible by the automatic differentiation features the model parameters (Brooks et al. 2011; Neal 2011; implemented in the libraries routinely used to build these Zhang et al. 2017; Betancourt 2017).
Bayesian Networks for the robust and unbiased prediction of depression and its symptoms utilizing speech and multimodal data
Fara, Salvatore, Hickey, Orlaith, Georgescu, Alexandra, Goria, Stefano, Molimpakis, Emilia, Cummins, Nicholas
Predicting the presence of major depressive disorder (MDD) using behavioural and cognitive signals is a highly non-trivial task. The heterogeneous clinical profile of MDD means that any given speech, facial expression and/or observed cognitive pattern may be associated with a unique combination of depressive symptoms. Conventional discriminative machine learning models potentially lack the complexity to robustly model this heterogeneity. Bayesian networks, however, may instead be well-suited to such a scenario. These networks are probabilistic graphical models that efficiently describe the joint probability distribution over a set of random variables by explicitly capturing their conditional dependencies. This framework provides further advantages over standard discriminative modelling by offering the possibility to incorporate expert opinion in the graphical structure of the models, generating explainable model predictions, informing about the uncertainty of predictions, and naturally handling missing data. In this study, we apply a Bayesian framework to capture the relationships between depression, depression symptoms, and features derived from speech, facial expression and cognitive game data collected at thymia.
Semi-Autoregressive Energy Flows: Exploring Likelihood-Free Training of Normalizing Flows
Si, Phillip, Chen, Zeyi, Sahoo, Subham Sekhar, Schiff, Yair, Kuleshov, Volodymyr
Training normalizing flow generative models can be challenging due to the need to calculate computationally expensive determinants of Jacobians. This paper studies the likelihood-free training of flows and proposes the energy objective, an alternative sample-based loss based on proper scoring rules. The energy objective is determinant-free and supports flexible model architectures that are not easily compatible with maximum likelihood training, including semi-autoregressive energy flows, a novel model family that interpolates between fully autoregressive and non-autoregressive models. Energy flows feature competitive sample quality, posterior inference, and generation speed relative to likelihood-based flows; this performance is decorrelated from the quality of log-likelihood estimates, which are generally very poor. Our findings question the use of maximum likelihood as an objective or a metric, and contribute to a scientific study of its role in generative modeling.
Hierarchical Neural Simulation-Based Inference Over Event Ensembles
Heinrich, Lukas, Mishra-Sharma, Siddharth, Pollard, Chris, Windischhofer, Philipp
When analyzing real-world data it is common to work with event ensembles, which comprise sets of observations that collectively constrain the parameters of an underlying model of interest. Such models often have a hierarchical structure, where "local" parameters impact individual events and "global" parameters influence the entire dataset. We introduce practical approaches for optimal dataset-wide probabilistic inference in cases where the likelihood is intractable, but simulations can be realized via forward modeling. We construct neural estimators for the likelihood(-ratio) or posterior and show that explicitly accounting for the model's hierarchical structure can lead to tighter parameter constraints. We ground our discussion using case studies from the physical sciences, focusing on examples from particle physics (particle collider data) and astrophysics (strong gravitational lensing observations).
Complex Preferences for Different Convergent Priors in Discrete Graph Diffusion
Tseng, Alex M., Diamant, Nathaniel, Biancalani, Tommaso, Scalia, Gabriele
Diffusion models have achieved state-of-the-art performance in generating many different kinds of data, including images, text, and videos. Despite their success, there has been limited research on how the underlying diffusion process and the final convergent prior can affect generative performance; this research has also been limited to continuous data types and a score-based diffusion framework. To fill this gap, we explore how different discrete diffusion kernels (which converge to different prior distributions) affect the performance of diffusion models for graphs. To this end, we developed a novel formulation of a family of discrete diffusion kernels which are easily adjustable to converge to different Bernoulli priors, and we study the effect of these different kernels on generative performance. We show that the quality of generated graphs is sensitive to the prior used, and that the optimal choice cannot be explained by obvious statistics or metrics, which challenges the intuitions which previous works have suggested.