Statistical Learning
On the Generalization of Adversarially Trained Quantum Classifiers
Georgiou, Petros, Thomas, Aaron Mark, Jose, Sharu Theresa, Simeone, Osvaldo
Petros Georgiou, Aaron Mark Thomas, and Sharu Theresa Jose Department of Computer Science, University of Birmingham, UK Osvaldo Simeone KCLIP Lab Centre for Intelligent Information Processing Systems (CIIPS) Department of Engineering, King's College London, UK (Dated: April 25, 2025) Quantum classifiers are vulnerable to adversarial attacks that manipulate their input classical or quantum data. A promising countermeasure is adversarial training, where quantum classifiers are trained by using an attack-aware, adversarial loss function. This work establishes novel bounds on the generalization error of adversarially trained quantum classifiers when tested in the presence of perturbation-constrained adversaries. The bounds quantify the excess generalization error incurred to ensure robustness to adversarial attacks as scaling with the training sample size m as 1 / m, while yielding insights into the impact of the quantum embedding. For quantum binary classifiers employing rotation embedding, we find that, in the presence of adversarial attacks on classical inputs x, the increase in sample complexity due to adversarial training over conventional training vanishes in the limit of high dimensional inputs x . In contrast, when the adversary can directly attack the quantum state ฯ ( x) encoding the input x, the excess generalization error depends on the choice of embedding only through its Hilbert space dimension. The results are also extended to multi-class classifiers. I. INTRODUCTION Context and Motivation: Quantum Machine Learning (QML) aims to leverage quantum computing capabilities to outperform classical ML techniques [1, 2]. Recent studies have highlighted limitations of QML including difficulties in training unstructured QML models [3, 4] and the classical simulability of some structured QML models [5]. Another concern with QML models is the fact that, similar to their classical counterparts, QML models are susceptible to adversarial attacks [6-8]. For instance, a quantum classifier utilizing superconduct-ing qubits to classify MRI images, achieving a test accuracy of 99%, was found to be easily deceived by minor adversarial perturbations [7]. This vulnerability poses another challenge on the way to realizing quantum advantages. To address this problem, recent works [9, 10] have explored efficient strategies to defend quantum classifiers against adversarial attacks, with adversarial training emerging as a promising strategy [6]. Adversarial training replaces the standard classification loss with an attack-aware adversarial loss, accounting for the worst-case effect of adversarial perturbation of the input data. This results in a min-max optimization problem with the classifier attempting to minimize the worst-case adversarial loss. In classical machine learning models it has been observed that adversarially trained classifiers have desirable training performance but a poor performance on pxg402@student.bham.ac.uk Figure 1.
Deciphering the unique dynamic activation pathway in a G protein-coupled receptor enables unveiling biased signaling and identifying cryptic allosteric sites in conformational intermediates
Fan, Jigang, Zhu, Chunhao, Lan, Xiaobing, Zhuang, Haiming, Li, Mingyu, Zhang, Jian, Lu, Shaoyong
N eurotensin receptor 1 (NTSR1), a member of the C lass A G protein - coupled receptor superfamily, plays a n important role in modulating dopamine rgic neuronal activity and eliciting opioid - independent analgesia. Recent studies suggest that promoting ฮฒ - arrestin - bias ed signaling in NTSR1 may diminish drugs of abuse, such as psychostimulants, thereby offering a potential avenue for treating human addiction - related disorders . In this study, we utiliz e d a novel computational and experimental approach that combined nudged elastic band - based molecular dynamics simulations, Markov state models, temporal communication network analysis, site - directed mutagenesis, and conformational biosensors, to explore the intricate mechanisms underlying NTSR1 activation and bias ed signal ing . Our study reveal s a dynamic stepwise transition mechanism and activat ed transmission network associated with NTSR1 activation. It also yield s valuable insights into the complex interplay between the unique polar network, non - conserved ion locks, and aromatic clusters in NTSR1 signaling. Moreover, we identif ied a cryptic allosteric site located in the intracellular r egion of the receptor that exists in an intermediate state within the activation pathway. Collectively, these findings contribute to a more profound understanding of NTSR1 activation and biased signal ing at the atomic level, thereby providing a potential strateg y for the development of NTSR1 allosteric modulators in the realm of G protein - coupled receptor biology, biophysics, and medicine.
Decentralized Time Series Classification with ROCKET Features
Casella, Bruno, Jakobs, Matthias, Aldinucci, Marco, Buschjรคger, Sebastian
Time series classification (TSC) is a critical task with applications in various domains, including healthcare, finance, and industrial monitoring. Due to privacy concerns and data regulations, Federated Learning has emerged as a promising approach for learning from distributed time series data without centralizing raw information. However, most FL solutions rely on a client-server architecture, which introduces robustness and confidentiality risks related to the distinguished role of the server, which is a single point of failure and can observe knowledge extracted from clients. To address these challenges, we propose DROCKS, a fully decentralized FL framework for TSC that leverages ROCKET (Ran-dOm Convolutional KErnel Transform) features. In DROCKS, the global model is trained by sequentially traversing a structured path across federation nodes, where each node refines the model and selects the most effective local kernels before passing them to the successor. Extensive experiments on the UCR archive demonstrate that DROCKS outperforms state-of-the-art client-server FL approaches while being more resilient to node failures and malicious attacks.
Interpretable non-linear dimensionality reduction using gaussian weighted linear transformation
Dimensionality reduction techniques are fundamental for analyzing and visualizing high-dimensional data. With established methods like t-SNE and PCA presenting a trade-off between representational power and interpretability. This paper introduces a novel approach that bridges this gap by combining the interpretability of linear methods with the expressiveness of non-linear transformations. The proposed algorithm constructs a non-linear mapping between high-dimensional and low-dimensional spaces through a combination of linear transformations, each weighted by Gaussian functions. This architecture enables complex non-linear transformations while preserving the interpretability advantages of linear methods, as each transformation can be analyzed independently. The resulting model provides both powerful dimensionality reduction and transparent insights into the transformed space. Techniques for interpreting the learned transformations are presented, including methods for identifying suppressed dimensions and how space is expanded and contracted. These tools enable practitioners to understand how the algorithm preserves and modifies geometric relationships during dimensionality reduction. To ensure the practical utility of this algorithm, the creation of user-friendly software packages is emphasized, facilitating its adoption in both academia and industry.
Enhanced Sample Selection with Confidence Tracking: Identifying Correctly Labeled yet Hard-to-Learn Samples in Noisy Data
Pan, Weiran, Wei, Wei, Zhu, Feida, Deng, Yong
We propose a novel sample selection method for image classification in the presence of noisy labels. Existing methods typically consider small-loss samples as correctly labeled. However, some correctly labeled samples are inherently difficult for the model to learn and can exhibit high loss similar to mislabeled samples in the early stages of training. Consequently, setting a threshold on per-sample loss to select correct labels results in a trade-off between precision and recall in sample selection: a lower threshold may miss many correctly labeled hard-to-learn samples (low recall), while a higher threshold may include many mislabeled samples (low precision). To address this issue, our goal is to accurately distinguish correctly labeled yet hard-to-learn samples from mislabeled ones, thus alleviating the trade-off dilemma. We achieve this by considering the trends in model prediction confidence rather than relying solely on loss values. Empirical observations show that only for correctly labeled samples, the model's prediction confidence for the annotated labels typically increases faster than for any other classes. Based on this insight, we propose tracking the confidence gaps between the annotated labels and other classes during training and evaluating their trends using the Mann-Kendall Test. A sample is considered potentially correctly labeled if all its confidence gaps tend to increase. Our method functions as a plug-and-play component that can be seamlessly integrated into existing sample selection techniques. Experiments on several standard benchmarks and real-world datasets demonstrate that our method enhances the performance of existing methods for learning with noisy labels.
CHASe: Client Heterogeneity-Aware Data Selection for Effective Federated Active Learning
Zhang, Jun, Wang, Jue, Li, Huan, Xie, Zhongle, Chen, Ke, Shou, Lidan
Active learning (AL) reduces human annotation costs for machine learning systems by strategically selecting the most informative unlabeled data for annotation, but performing it individually may still be insufficient due to restricted data diversity and annotation budget. Federated Active Learning (FAL) addresses this by facilitating collaborative data selection and model training, while preserving the confidentiality of raw data samples. Yet, existing FAL methods fail to account for the heterogeneity of data distribution across clients and the associated fluctuations in global and local model parameters, adversely affecting model accuracy. To overcome these challenges, we propose CHASe (Client Heterogeneity-Aware Data Selection), specifically designed for FAL. CHASe focuses on identifying those unlabeled samples with high epistemic variations (EVs), which notably oscillate around the decision boundaries during training. To achieve both effectiveness and efficiency, \model{} encompasses techniques for 1) tracking EVs by analyzing inference inconsistencies across training epochs, 2) calibrating decision boundaries of inaccurate models with a new alignment loss, and 3) enhancing data selection efficiency via a data freeze and awaken mechanism with subset sampling. Experiments show that CHASe surpasses various established baselines in terms of effectiveness and efficiency, validated across diverse datasets, model complexities, and heterogeneous federation settings.
Doubly Adaptive Social Learning
Carpentiero, Marco, Bordignon, Virginia, Matta, Vincenzo, Sayed, Ali H.
In social learning, a network of agents assigns probability scores (beliefs) to some hypotheses of interest, which rule the generation of local streaming data observed by each agent. Belief formation takes place by means of an iterative two-step procedure where: i) the agents update locally their beliefs by using some likelihood model; and ii) the updated beliefs are combined with the beliefs of the neighboring agents, using a pooling rule. This procedure can fail to perform well in the presence of dynamic drifts, leading the agents to incorrect decision making. Here, we focus on the fully online setting where both the true hypothesis and the likelihood models can change over time. This goal is achieved by exploiting two adaptation stages: i) a stochastic gradient descent update to learn and track the drifts in the decision model; ii) and an adaptive belief update to track the true hypothesis changing over time. These stages are controlled by two adaptation parameters that govern the evolution of the error probability for each agent. We show that all agents learn consistently for sufficiently small adaptation parameters, in the sense that they ultimately place all their belief mass on the true hypothesis. Index T erms Social learning, belief formation, decision making, distributed optimization, online leaerning, opinion diffusion over graphs. Marco Carpentiero and Vincenzo Matta are with the Department of Information and Electrical Engineering and Applied Mathematics (DIEM), University of Salerno, via Giovanni Paolo II, I-84084, Fisciano (SA), Italy, and Vincenzo Matta is also with the National Inter-University Consortium for Telecommunications (CNIT), Italy (e-mails: { mcarpentiero, vmatta }@unisa.it). Matta was partially supported by the European Union under the Italian National Recovery and Resilience Plan (NRRP) of NextGenerationEU, partnership on "Telecommunications of the Future" (PE00000001 - program "REST ART"). This work was produced while Virginia Bordignon was a post-doc with the Ecole Polytechnique F ed erale de Lausanne EPFL, School of Engineering, CH-1015 Lausanne, Switzerland (e-mail: virginia.bordignon@alumni.epfl.ch).
ExOSITO: Explainable Off-Policy Learning with Side Information for Intensive Care Unit Blood Test Orders
Ji, Zongliang, Amaral, Andre Carlos Kajdacsy-Balla, Goldenberg, Anna, Krishnan, Rahul G.
Ordering a minimal subset of lab tests for patients in the intensive care unit (ICU) can be challenging. Care teams must balance between ensuring the availability of the right information and reducing the clinical burden and costs associated with each lab test order. Most in-patient settings experience frequent over-ordering of lab tests, but are now aiming to reduce this burden on both hospital resources and the environment. This paper develops a novel method that combines off-policy learning with privileged information to identify the optimal set of ICU lab tests to order. Our approach, EXplainable Off-policy learning with Side Information for ICU blood Test Orders (ExOSITO) creates an interpretable assistive tool for clinicians to order lab tests by considering both the observed and predicted future status of each patient. We pose this problem as a causal bandit trained using offline data and a reward function derived from clinically-approved rules; we introduce a novel learning framework that integrates clinical knowledge with observational data to bridge the gap between the optimal and logging policies. The learned policy function provides interpretable clinical information and reduces costs without omitting any vital lab orders, outperforming both a physician's policy and prior approaches to this practical problem.
Multi-Modal Traffic Analysis: Integrating Time-Series Forecasting, Accident Prediction, and Image Classification
M, Nivedita, S, Yasmeen Shajitha
--This paper presents a comprehensive framework that integrates multiple machine learning techniques for advanced traffic analysis. Our approach combines (1) an ARIMA(2,0,1) model for time-series forecasting, achieving a Mean Absolute Error (MAE) of 2.1; (2) an XGBoost classifier for accident severity prediction with 100% accuracy on balanced datasets; and (3) a Convolutional Neural Network (CNN) architecture for traffic image classification, achieving 92% accuracy. These methods were rigorously tested on heterogeneous datasets, demonstrating significant improvements over baseline models. Feature importance analysis revealed key contributing factors, such as weather conditions and road infrastructure, to accident severity. This research lays the groundwork for future advancements in intelligent transportation systems. Urban traffic management is a critical challenge in modern cities, where growing populations and increasing vehicle densities exacerbate congestion and safety issues.
Robotic Grinding Skills Learning Based on Geodesic Length Dynamic Motion Primitives
Ke, Shuai, Zhao, Huan, Li, Xiangfei, Wei, Zhiao, Yin, Yecan, Ding, Han
--Learning grinding skills from human craftsmen by imitation learning has emerged as a prominent research topic in the field of robotic machining. Given their robust trajectory generalization ability and resilience to various external disturbances and environmental changes, Dynamical Movement Primitives (DMPs) provide a promising skills learning solution for the robotic grinding. However, challenges arise when directly applying DMPs to grinding tasks, including low orientation accuracy, inaccurate synchronization of position, orientation, and force, and the inability to generalize surface trajectories. T o address these issues, this paper proposes a robotic grinding skills learning method based on geodesic length DMPs (Geo-DMPs). First, a normalized two-dimensional weighted Gaussian kernel function and intrinsic mean clustering algorithm are proposed to extract surface geometric features from multiple demonstration trajectories. Then, an orientation manifold distance metric is introduced to exclude the time factor from the classical orientation DMPs, thereby constructing Geo-DMPs for the orientation learning to improve the orientation trajectory generation accuracy. On this basis, a synchronization encoding framework for position, orientation, and force skills is established, using a phase function related to geodesic length. This framework enables the generation of robotic grinding actions between any two points on the surface. Finally, experiments on robotic chamfer grinding and free-form surface grinding demonstrate that the proposed method exhibits high geometric accuracy and good generalization capabilities in encoding and generating grinding skills. This method holds significant implications for learning and promoting robotic grinding skills. T o the best of our knowledge, this may be the first attempt to use DMPs to generate grinding skills for position, orientation, and force on model-free surfaces, thereby presenting a novel approach to robotic grinding skills learning.