Learning Graphical Models
Neural Posterior Estimation on Exponential Random Graph Models: Evaluating Bias and Implementation Challenges
Exponential random graph models (ERGMs) are flexible probabilistic frameworks to model statistical networks through a variety of network summary statistics. Conventional Bayesian estimation for ERGMs involves iteratively exchanging with an auxiliary variable due to the intractability of ERGMs, however, this approach lacks scalability to large-scale implementations. Neural posterior estimation (NPE) is a recent advancement in simulation-based inference, using a neural network based density estimator to infer the posterior for models with doubly intractable likelihoods for which simulations can be generated. While NPE has been successfully adopted in various fields such as cosmology, little research has investigated its use for ERGMs. Performing NPE on ERGM not only provides a differing angle of resolving estimation for the intractable ERGM likelihoods but also allows more efficient and scalable inference using the amortisation properties of NPE, and therefore, we investigate how NPE can be effectively implemented in ERGMs. In this study, we present the first systematic implementation of NPE for ERGMs, rigorously evaluating potential biases, interpreting the biases magnitudes, and comparing NPE fittings against conventional Bayesian ERGM fittings. More importantly, our work highlights ERGM-specific areas that may impose particular challenges for the adoption of NPE.
Improving the evaluation of samplers on multi-modal targets
Grenioux, Louis, Noble, Maxence, Gabrié, Marylou
Addressing multi-modality constitutes one of the major challenges of sampling. In this reflection paper, we advocate for a more systematic evaluation of samplers towards two sources of difficulty that are mode separation and dimension. For this, we propose a synthetic experimental setting that we illustrate on a selection of samplers, focusing on the challenging criterion of recovery of the mode relative importance. These evaluations are crucial to diagnose the potential of samplers to handle multi-modality and therefore to drive progress in the field.
Leveraging deep learning for plant disease identification: a bibliometric analysis in SCOPUS from 2018 to 2024
Albert, Enow Takang Achuo, Bille, Ngalle Hermine, Leonard, Ngonkeu Mangaptche Eddy
Deep learning has emerged as a transformative technology in agricultural science, particularly for the identification of plant diseases. This approach leverages advanced algorithms, primarily Convolutional Neural Networks (CNNs), to analyze images of plants and accurately diagnose diseases that threaten crop health and yield (Mohanty et al., 2016; Guo et al., 2020; Saleem et al., 2020; Ahmed & Y adav, 2023; Jung et al., 2023; Shoaib et al., 2023; Pacal et al., 2024). Plant diseases pose a significant threat to global food security, leading to substantial yield losses and economic impacts on agriculture. T raditional methods of disease identification often rely on visual assessments by trained professionals, which can be time-consuming, subjective, and prone to errors (Jafar et al., 2024). As a result, there is a pressing need for automated systems that can provide rapid and accurate disease detection to support farmers and agricultural experts in managing crop health effectively . Deep learning models, especially CNNs, have been shown to outperform traditional methods in terms of accuracy and efficiency . These models can learn hierarchical representations from raw image data, enabling them to identify complex patterns associated with various plant diseases. Recent studies have demonstrated that CNNs can achieve accuracy rates as high as 99.35% when classifying images of diseased and healthy plants. The architecture of CNNs typically includes layers for feature extraction and classification, allowing them to process visual information effectively .
Guarding Digital Privacy: Exploring User Profiling and Security Enhancements
Kohli, Rishika, Gupta, Shaifu, Gaur, Manoj Singh
User profiling, the practice of collecting user information for personalized recommendations, has become widespread, driving progress in technology. However, this growth poses a threat to user privacy, as devices often collect sensitive data without their owners' awareness. This article aims to consolidate knowledge on user profiling, exploring various approaches and associated challenges. Through the lens of two companies sharing user data and an analysis of 18 popular Android applications in India across various categories, including $\textit{Social, Education, Entertainment, Travel, Shopping and Others}$, the article unveils privacy vulnerabilities. Further, the article propose an enhanced machine learning framework, employing decision trees and neural networks, that improves state-of-the-art classifiers in detecting personal information exposure. Leveraging the XAI (explainable artificial intelligence) algorithm LIME (Local Interpretable Model-agnostic Explanations), it enhances interpretability, crucial for reliably identifying sensitive data. Results demonstrate a noteworthy performance boost, achieving a $75.01\%$ accuracy with a reduced training time of $3.62$ seconds for neural networks. Concluding, the paper suggests research directions to strengthen digital security measures.
Robustness quantification: a new method for assessing the reliability of the predictions of a classifier
Detavernier, Adrián, De Bock, Jasper
Based on existing ideas in the field of imprecise probabilities, we present a new approach for assessing the reliability of the individual predictions of a generative probabilistic classifier. We call this approach robustness quantification, compare it to uncertainty quantification, and demonstrate that it continues to work well even for classifiers that are learned from small training sets that are sampled from a shifted distribution.
Unifying and extending Diffusion Models through PDEs for solving Inverse Problems
Dasgupta, Agnimitra, da Cunha, Alexsander Marciano, Fardisi, Ali, Aminy, Mehrnegar, Binder, Brianna, Shaddy, Bryan, Oberai, Assad A
Diffusion models have emerged as powerful generative tools with applications in computer vision and scientific machine learning (SciML), where they have been used to solve large-scale probabilistic inverse problems. Traditionally, these models have been derived using principles of variational inference, denoising, statistical signal processing, and stochastic differential equations. In contrast to the conventional presentation, in this study we derive diffusion models using ideas from linear partial differential equations and demonstrate that this approach has several benefits that include a constructive derivation of the forward and reverse processes, a unified derivation of multiple formulations and sampling strategies, and the discovery of a new class of models. We also apply the conditional version of these models to solving canonical conditional density estimation problems and challenging inverse problems. These problems help establish benchmarks for systematically quantifying the performance of different formulations and sampling strategies in this study, and for future studies. Finally, we identify and implement a mechanism through which a single diffusion model can be applied to measurements obtained from multiple measurement operators. Taken together, the contents of this manuscript provide a new understanding and several new directions in the application of diffusion models to solving physics-based inverse problems.
From Observation to Orientation: an Adaptive Integer Programming Approach to Intervention Design
Elrefaey, Abdelmonem, Pan, Rong
Using both observational and experimental data, a causal discovery process can identify the causal relationships between variables. A unique adaptive intervention design paradigm is presented in this work, where causal directed acyclic graphs (DAGs) are for effectively recovered with practical budgetary considerations. In order to choose treatments that optimize information gain under these considerations, an iterative integer programming (IP) approach is proposed, which drastically reduces the number of experiments required. Simulations over a broad range of graph sizes and edge densities are used to assess the effectiveness of the suggested approach. Results show that the proposed adaptive IP approach achieves full causal graph recovery with fewer intervention iterations and variable manipulations than random intervention baselines, and it is also flexible enough to accommodate a variety of practical constraints.
Identifying Key Challenges of Hardness-Based Resampling
Pukowski, Pawel, Osmani, Venet
--Performance gap across classes remains a persistent challenge in machine learning, often attributed to variations in class hardness. One way to quantify class hardness is through sample complexity - the minimum number of samples required to effectively learn a given class. Sample complexity theory suggests that class hardness is driven by differences in the amount of data required for generalization. That is, harder classes need substantially more samples to achieve generalization. Therefore, hardness-based resampling is a promising approach to mitigate these performance disparities. While resampling has been studied extensively in data-imbalanced settings, its impact on balanced datasets remains unexplored. This raises the fundamental question whether resampling is effective because it addresses data imbalance or hardness imbalance. We begin addressing this question by introducing class imbalance into balanced datasets and evaluate its effect on performance disparities. We oversample hard classes and undersample easy classes to bring hard classes closer to their sample complexity requirements while maintaining a constant dataset size for fairness. We estimate class-level hardness using the Area Under the Margin (AUM) hardness estimator and leverage it to compute resampling ratios. Using these ratios, we perform hardness-based resampling on the well-known CIF AR-10 and CIF AR-100 datasets. Contrary to theoretical expectations, our results show that hardness-based resampling does not meaningfully affect class-wise performance disparities. T o explain this discrepancy, we conduct detailed analyses to identify key challenges unique to hardness-based imbalance, distinguishing it from traditional data-based imbalance. Our insights help explain why theoretical sample complexity expectations fail to translate into practical performance gains and we provide guidelines for future research. CCESS to large datasets has fueled recent machine learning breakthroughs [1], yet data efficiency remains a critical challenge [2]. Addressing this challenge requires a deep understanding of instance, class, and dataset level hardness. Empirical works reveal large performance gaps across classes [3]-[5] and clear distinctions between easy (e.g. ImageNet) [6], [7] as shown in see Figure 1. Pawel Pukowski is with the University of Sheffield. V enet Osmani is with the Digital Environment Research Institute, Queen Mary University of London. This work has been submitted to the IEEE for possible publication. Figure 1: Training an ensemble of ten ResNet18 networks on CIFAR-10 (left) and CIFAR-100 (right) reveals large recall gaps across classes, despite the balanced nature of these datasets. Paired with significantly larger recall gaps across classes for CIFAR-100 than CIFAR-10, this shows class-and dataset-level hardness discrepancies, which we call hardness-based imbalance.
Sim-to-Real of Humanoid Locomotion Policies via Joint Torque Space Perturbation Injection
Cha, Woohyun, Cha, Junhyeok, Shin, Jaeyong, Kim, Donghyeon, Park, Jaeheung
-- This paper proposes a novel alternative to existing sim-to-real methods for training control policies with simulated experiences. Prior sim-to-real methods for legged robots mostly rely on the domain randomization approach, where a fixed finite set of simulation parameters is randomized during training. Instead, our method adds state-dependent perturbations to the input joint torque used for forward simulation during the training phase. These state-dependent perturbations are designed to simulate a broader range of reality gaps than those captured by randomizing a fixed set of simulation parameters. Experimental results show that our method enables humanoid locomotion policies that achieve greater robustness against complex reality gaps unseen in the training domain. Deep Reinforcement Learning (DRL) for robotic applications has gained significant attention due to its demonstrated robustness and versatility. Although DRL algorithms are capable of solving complex, high-dimensional control problems, commonly used on-policy methods often require a prohibitively large amount of data, posing a substantial challenge when collecting sufficient samples solely from real hardware. Moreover, the exploration process required for policy improvement in early training stages can raise safety concerns for both the physical robot and its operational environment.
Agent-Arena: A General Framework for Evaluating Control Algorithms
Kadi, Halid Abdulrahim, Terzić, Kasim
Robotic research is inherently challenging, requiring expertise in diverse environments and control algorithms. Adapting algorithms to new environments often poses significant difficulties, compounded by the need for extensive hyper-parameter tuning in data-driven methods. To address these challenges, we present Agent-Arena, a Python framework designed to streamline the integration, replication, development, and testing of decision-making policies across a wide range of benchmark environments. Unlike existing frameworks, Agent-Arena is uniquely generalised to support all types of control algorithms and is adaptable to both simulation and real-robot scenarios. Please see our GitHub repository https://github.com/halid1020/agent-arena-v0.