Learning Graphical Models
Single- and Multi-Agent Private Active Sensing: A Deep Neuroevolution Approach
Stamatelis, George, Kanatas, Angelos-Nikolaos, Asprogerakas, Ioannis, Alexandropoulos, George C.
The problem of single-agent Evasive AHT (EAHT), Active Hypothesis Testing (AHT) refers to the family of where a passive Eavesdropper (Eve) collects noisy estimates problems where one legitimate agent or decision maker, or a of the legit observations and tries to infer the underlying group of collaborating agents or decision makers, adaptively hypothesis, was studied in [24], focusing however explicitly select(s) sensing actions and collect(s) observations in order on the asymptotical case. In that work, the authors formulated to infer the underlying true hypothesis in a fast and reliable single-agent EAHT as a constrained optimization problem manner [1], [2]. AHT and related problems, such as active including the legitimate agent's and the Eavesdropper's (Eve) parameter estimation [3] and active change point detection [4], error exponent. However, near-optimal or optimal action selection [5], find numerous applications in wireless communications, policies were not presented. In this paper, motivated including anomaly detection over sensor networks [6], strong by the lack of explicit policies for EAHT, we present novel or weak radar models for target detection [7], cyber-intrusion single-and multi-agent EAHT approaches for wireless sensor detection, target search, and adaptive beamforming [8], as well networks that are based on a deep NeuroEvolution (NE) as, very recently, RIS-enabled localization [9] and channel framework. Our contributions are summarized as follows: estimation [10]. In addition, AHT is closely related to the 1) We formulate the single-agent EAHT problem studied feedback channel coding problem [11].
Generative Modelling of Stochastic Rotating Shallow Water Noise
Crisan, Dan, Lang, Oana, Lobbe, Alexander
In recent work, the authors have developed a generic methodology for calibrating the noise in fluid dynamics stochastic partial differential equations where the stochasticity was introduced to parametrize subgrid-scale processes. The stochastic parameterization of sub-grid scale processes is required in the estimation of uncertainty in weather and climate predictions, to represent systematic model errors arising from subgrid-scale fluctuations. The previous methodology used a principal component analysis (PCA) technique based on the ansatz that the increments of the stochastic parametrization are normally distributed. In this paper, the PCA technique is replaced by a generative model technique. This enables us to avoid imposing additional constraints on the increments. The methodology is tested on a stochastic rotating shallow water model with the elevation variable of the model used as input data. The numerical simulations show that the noise is indeed non-Gaussian. The generative modelling technology gives good RMSE, CRPS score and forecast rank histogram results.
Hessian-Free Laplace in Bayesian Deep Learning
McInerney, James, Kallus, Nathan
The Laplace approximation (LA) of the Bayesian posterior is a Gaussian distribution centered at the maximum a posteriori estimate. Its appeal in Bayesian deep learning stems from the ability to quantify uncertainty post-hoc (i.e., after standard network parameter optimization), the ease of sampling from the approximate posterior, and the analytic form of model evidence. However, an important computational bottleneck of LA is the necessary step of calculating and inverting the Hessian matrix of the log posterior. The Hessian may be approximated in a variety of ways, with quality varying with a number of factors including the network, dataset, and inference task. In this paper, we propose an alternative framework that sidesteps Hessian calculation and inversion. The Hessian-free Laplace (HFL) approximation uses curvature of both the log posterior and network prediction to estimate its variance. Only two point estimates are needed: the standard maximum a posteriori parameter and the optimal parameter under a loss regularized by the network prediction. We show that, under standard assumptions of LA in Bayesian deep learning, HFL targets the same variance as LA, and can be efficiently amortized in a pre-trained network. Experiments demonstrate comparable performance to that of exact and approximate Hessians, with excellent coverage for in-between uncertainty.
A resource-constrained stochastic scheduling algorithm for homeless street outreach and gleaning edible food
Artman, Conor M., Mate, Aditya, Nwankwo, Ezinne, Heching, Aliza, Idé, Tsuyoshi, Jiří\, null, Navrátil, null, Shanmugam, Karthikeyan, Sun, Wei, Varshney, Kush R., Goldkind, Lauri, Kroch, Gidi, Sawyer, Jaclyn, Watson, Ian
We developed a common algorithmic solution addressing the problem of resource-constrained outreach encountered by social change organizations with different missions and operations: Breaking Ground -- an organization that helps individuals experiencing homelessness in New York transition to permanent housing and Leket -- the national food bank of Israel that rescues food from farms and elsewhere to feed the hungry. Specifically, we developed an estimation and optimization approach for partially-observed episodic restless bandits under $k$-step transitions. The results show that our Thompson sampling with Markov chain recovery (via Stein variational gradient descent) algorithm significantly outperforms baselines for the problems of both organizations. We carried out this work in a prospective manner with the express goal of devising a flexible-enough but also useful-enough solution that can help overcome a lack of sustainable impact in data science for social good.
Structured Evaluation of Synthetic Tabular Data
Yang, Scott Cheng-Hsin, Eaves, Baxter, Schmidt, Michael, Swanson, Ken, Shafto, Patrick
Tabular data is common yet typically incomplete, small in volume, and access-restricted due to privacy concerns. Synthetic data generation offers potential solutions. Many metrics exist for evaluating the quality of synthetic tabular data; however, we lack an objective, coherent interpretation of the many metrics. To address this issue, we propose an evaluation framework with a single, mathematical objective that posits that the synthetic data should be drawn from the same distribution as the observed data. Through various structural decomposition of the objective, this framework allows us to reason for the first time the completeness of any set of metrics, as well as unifies existing metrics, including those that stem from fidelity considerations, downstream application, and model-based approaches. Moreover, the framework motivates model-free baselines and a new spectrum of metrics. We evaluate structurally informed synthesizers and synthesizers powered by deep learning. Using our structured framework, we show that synthetic data generators that explicitly represent tabular structure outperform other methods, especially on smaller datasets.
Active Classification based on Value of Classifier
Modern classification tasks usually involve many class labels and can be informed by a broad range of features. Many of these tasks are tackled by constructing a set of classifiers, which are then applied at test time and then pieced together in a fixed procedure determined in advance or at training time. We present an active classification process at the test time, where each classifier in a large ensemble is viewed as a potential observation that might inform our classification process. Observations are then selected dynamically based on previous observations, using a value-theoretic computation that balances an estimate of the expected classification gain from each observation as well as its computational cost. The expected classification gain is computed using a probabilistic model that uses the outcome from previous observations. This active classification process is applied at test time for each individual test instance, resulting in an efficient instance-specific decision path. We demonstrate the benefit of the active scheme on various real-world datasets, and show that it can achieve comparable or even higher classification accuracy at a fraction of the computational costs of traditional methods.
Dynamical segmentation of single trials from population neural data
Simultaneous recordings of many neurons embedded within a recurrentlyconnected cortical network may provide concurrent views into the dynamical processes of that network, and thus its computational function. In principle, these dynamics might be identified by purely unsupervised, statistical means. Here, we show that a Hidden Switching Linear Dynamical Systems (HSLDS) model-- in which multiple linear dynamical laws approximate a nonlinear and potentially non-stationary dynamical process--is able to distinguish different dynamical regimes within single-trial motor cortical activity associated with the preparation and initiation of hand movements. The regimes are identified without reference to behavioural or experimental epochs, but nonetheless transitions between them correlate strongly with external events whose timing may vary from trial to trial. The HSLDS model also performs better than recent comparable models in predicting the firing rate of an isolated neuron based on the firing rates of others, suggesting that it captures more of the "shared variance" of the data. Thus, the method is able to trace the dynamical processes underlying the coordinated evolution of network activity in a way that appears to reflect its computational role.
28fc2782ea7ef51c1104ccf7b9bea13d-Paper.pdf
In this paper, we derive a method to refine a Bayes network diagnostic model by exploiting constraints implied by expert decisions on test ordering. At each step, the expert executes an evidence gathering test, which suggests the test's relative diagnostic value. We demonstrate that consistency with an expert's test selection leads to non-convex constraints on the model parameters. We incorporate these constraints by augmenting the network with nodes that represent the constraint likelihoods. Gibbs sampling, stochastic hill climbing and greedy search algorithms are proposed to find a MAP estimate that takes into account test ordering constraints and any data available. We demonstrate our approach on diagnostic sessions from a manufacturing scenario.
Two is better than one: distinct roles for familiarity and recollection in retrieving palimpsest memories
Storing a new pattern in a palimpsest memory system comes at the cost of interfering with the memory traces of previously stored items. Knowing the age of a pattern thus becomes critical for recalling it faithfully. This implies that there should be a tight coupling between estimates of age, as a form of familiarity, and the neural dynamics of recollection, something which current theories omit. Using a normative model of autoassociative memory, we show that a dual memory system, consisting of two interacting modules for familiarity and recollection, has best performance for both recollection and recognition. This finding provides a new window onto actively contentious psychological and neural aspects of recognition memory.