Accuracy
Explanations as Bias Detectors: A Critical Study of Local Post-hoc XAI Methods for Fairness Exploration
Papanikou, Vasiliki, Karidi, Danae Pla, Pitoura, Evaggelia, Panagiotou, Emmanouil, Ntoutsi, Eirini
As Artificial Intelligence (AI) is increasingly used in areas that significantly impact human lives, concerns about fairness and transparency have grown, especially regarding their impact on protected groups. Recently, the intersection of explainability and fairness has emerged as an important area to promote responsible AI systems. This paper explores how explainability methods can be leveraged to detect and interpret unfairness. We propose a pipeline that integrates local post-hoc explanation methods to derive fairness-related insights. During the pipeline design, we identify and address critical questions arising from the use of explanations as bias detectors such as the relationship between distributive and procedural fairness, the effect of removing the protected attribute, the consistency and quality of results across different explanation methods, the impact of various aggregation strategies of local explanations on group fairness evaluations, and the overall trustworthiness of explanations as bias detectors. Our results show the potential of explanation methods used for fairness while highlighting the need to carefully consider the aforementioned critical aspects.
Responsive DNN Adaptation for Video Analytics against Environment Shift via Hierarchical Mobile-Cloud Collaborations
Zhao, Maozhe, Liu, Shengzhong, Wu, Fan, Chen, Guihai
Mobile video analysis systems often encounter various deploying environments, where environment shifts present greater demands for responsiveness in adaptations of deployed "expert DNN models". Existing model adaptation frameworks primarily operate in a cloud-centric way, exhibiting degraded performance during adaptation and delayed reactions to environment shifts. Instead, this paper proposes MOCHA, a novel framework optimizing the responsiveness of continuous model adaptation through hierarchical collaborations between mobile and cloud resources. Specifically, MOCHA (1) reduces adaptation response delays by performing on-device model reuse and fast fine-tuning before requesting cloud model retrieval and end-to-end retraining; (2) accelerates history expert model retrieval by organizing them into a structured taxonomy utilizing domain semantics analyzed by a cloud foundation model as indices; (3) enables efficient local model reuse by maintaining onboard expert model caches for frequent scenes, which proactively prefetch model weights from the cloud model database. Extensive evaluations with real-world videos on three DNN tasks show MOCHA improves the model accuracy during adaptation by up to 6.8% while saving the response delay and retraining time by up to 35.5x and 3.0x respectively.
Bayes-Optimal Fair Classification with Multiple Sensitive Features
Yang, Yi, Huang, Yinghui, Chang, Xiangyu
Existing theoretical work on Bayes-optimal fair classifiers usually considers a single (binary) sensitive feature. In practice, individuals are often defined by multiple sensitive features. In this paper, we characterize the Bayes-optimal fair classifier for multiple sensitive features under general approximate fairness measures, including mean difference and mean ratio. We show that these approximate measures for existing group fairness notions, including Demographic Parity, Equal Opportunity, Predictive Equality, and Accuracy Parity, are linear transformations of selection rates for specific groups defined by both labels and sensitive features. We then characterize that Bayes-optimal fair classifiers for multiple sensitive features become instance-dependent thresholding rules that rely on a weighted sum of these group membership probabilities. Our framework applies to both attribute-aware and attribute-blind settings and can accommodate composite fairness notions like Equalized Odds. Building on this, we propose two practical algorithms for Bayes-optimal fair classification via in-processing and post-processing. We show empirically that our methods compare favorably to existing methods.
CICADA: Cross-Domain Interpretable Coding for Anomaly Detection and Adaptation in Multivariate Time Series
Lan, Tian, Gao, Yifei, Lu, Yimeng, Zhang, Chen
Unsupervised Time series anomaly detection plays a crucial role in applications across industries. However, existing methods face significant challenges due to data distributional shifts across different domains, which are exacerbated by the non-stationarity of time series over time. Existing models fail to generalize under multiple heterogeneous source domains and emerging unseen new target domains. To fill the research gap, we introduce CICADA (Cross-domain Interpretable Coding for Anomaly Detection and Adaptation), with four key innovations: (1) a mixture of experts (MOE) framework that captures domain-agnostic anomaly features with high flexibility and interpretability; (2) a novel selective meta-learning mechanism to prevent negative transfer between dissimilar domains, (3) an adaptive expansion algorithm for emerging heterogeneous domain expansion, and (4) a hierarchical attention structure that quantifies expert contributions during fusion to enhance interpretability further.Extensive experiments on synthetic and real-world industrial datasets demonstrate that CICADA outperforms state-of-the-art methods in both cross-domain detection performance and interpretability.
Enhancing Security and Strengthening Defenses in Automated Short-Answer Grading Systems
Yarmohammadtoosky, Sahar, Zhou, Yiyun, Yaneva, Victoria, Baldwin, Peter, Rezayi, Saed, Clauser, Brian, Harikeo, Polina
This study examines vulnerabilities in transformer-based automated short-answer grading systems used in medical education, with a focus on how these systems can be manipulated through adversarial gaming strategies. Our research identifies three main types of gaming strategies that exploit the system's weaknesses, potentially leading to false positives. To counteract these vulnerabilities, we implement several adversarial training methods designed to enhance the systems' robustness. Our results indicate that these methods significantly reduce the susceptibility of grading systems to such manipulations, especially when combined with ensemble techniques like majority voting and ridge regression, which further improve the system's defense against sophisticated adversarial inputs. Additionally, employing large language models such as GPT-4 with varied prompting techniques has shown promise in recognizing and scoring gaming strategies effectively. The findings underscore the importance of continuous improvements in AI-driven educational tools to ensure their reliability and fairness in high-stakes settings.
Can a Quantum Support Vector Machine algorithm be utilized to identify Key Biomarkers from Multi-Omics data of COVID19 patients?
Choi, Junggu, Yu, Chansu, Jung, Kyle L., Foo, Suan-Sin, Chen, Weiqiang, Comhair, Suzy AA, Erzurum, Serpil C., Jehi, Lara, Jung, Jae U.
The unprecedented global COVID - 19 pandemic has prompted researchers to investigate both the biochemical changes associated with acute infection and the long - term effects of COVID - 19, with the goal of elucidating underlying mechanisms [ 1 4 ]. Among the diverse biochemical alterations observed in COVID - 19, change s in metabolomic and proteomic profiles have drawn particular attention due to their roles in fundamental biological processes, including protein expression and metabolic pathways [5, 6]. Early in the pandemic, several studies highlighted the significance of certain biomarkers for diagnosing COVID - 19 and assessing disease severity [7, 8]. These initial finding s reveal ed that specific biomarkers are involved in COVID - 19 pathogenesis and correlate with disease severity. S ubsequent research into post - acute sequelae of COVID - 19 (PASC, or long COVID) has further shown that variations in these biomarkers are associated with neurological and respiratory complications [9, 10]. Collectively, these studie s highlight the importance of identifying key biomarkers to support both acute COVID - 19 detection and the understanding of long COVID.
Manifold-Constrained Sentence Embeddings via Triplet Loss: Projecting Semantics onto Spheres, Tori, and Mรถbius Strips
Recent advances in representation learning have emphasized the role of embedding geometry in capturing semantic structure. Traditional sentence embeddings typically reside in unconstrained Euclidean spaces, which may limit their ability to reflect complex relationships in language. In this work, we introduce a novel framework that constrains sentence embeddings to lie on continuous manifolds -- specifically the unit sphere, torus, and Mรถbius strip -- using triplet loss as the core training objective. By enforcing differential geometric constraints on the output space, our approach encourages the learning of embeddings that are both discriminative and topologically structured. We evaluate our method on benchmark datasets (AG News and MBTI) and compare it to classical baselines including TF-IDF, Word2Vec, and unconstrained Keras-derived embeddings. Our results demonstrate that manifold-constrained embeddings, particularly those projected onto spheres and Mรถbius strips, significantly outperform traditional approaches in both clustering quality (Silhouette Score) and classification performance (Accuracy). These findings highlight the value of embedding in manifold space -- where topological structure complements semantic separation -- offering a new and mathematically grounded direction for geometric representation learning in NLP.
Efficient IoT Intrusion Detection with an Improved Attention-Based CNN-BiLSTM Architecture
Naeem, Amna, Khan, Muazzam A., Alasbali, Nada, Ahmad, Jawad, Khattak, Aizaz Ahmad, Khan, Muhammad Shahbaz
The ever-increasing security vulnerabilities in the Internet-of-Things (IoT) systems require improved threat detection approaches. This paper presents a compact and efficient approach to detect botnet attacks by employing an integrated approach that consists of traffic pattern analysis, temporal support learning, and focused feature extraction. The proposed attention-based model benefits from a hybrid CNN-BiLSTM architecture and achieves 99% classification accuracy in detecting botnet attacks utilizing the N-BaIoT dataset, while maintaining high precision and recall across various scenarios. The proposed model's performance is further validated by key parameters, such as Mathews Correlation Coefficient and Cohen's kappa Correlation Coefficient. The close-to-ideal results for these parameters demonstrate the proposed model's ability to detect botnet attacks accurately and efficiently in practical settings and on unseen data. The proposed model proved to be a powerful defence mechanism for IoT networks to face emerging security challenges.
Uncertainty, bias and the institution bootstrapping problem
Anagnou, Stavros, Salge, Christoph, Lewis, Peter R.
Institutions play a critical role in enabling communities to manage common-pool resources and avert tragedies of the commons. However, a fundamental issue arises: Individuals typically perceive participation as advantageous only after an institution is established, creating a paradox: How can institutions form if no one will join before a critical mass exists? We term this conundrum the institution bootstrapping problem and propose that misperception, specifically, agents' erroneous belief that an institution already exists, could resolve this paradox. By integrating well-documented psychological phenomena, including cognitive biases, probability distortion, and perceptual noise, into a game-theoretic framework, we demonstrate how these factors collectively mitigate the bootstrapping problem. Notably, unbiased perceptual noise (e.g., noise arising from agents' heterogeneous physical or social contexts) drastically reduces the critical mass of cooperators required for institutional emergence. This effect intensifies with greater diversity of perceptions. We explain this counter-intuitive result through asymmetric boundary conditions: proportional underestimation of low-probability sanctions produces distinct outcomes compared to equivalent overestimation. Furthermore, the type of perceptual distortion, proportional versus absolute, yields qualitatively different evolutionary pathways. These findings challenge conventional assumptions about rationality in institutional design, highlighting how "noisy" cognition can paradoxically enhance cooperation. Finally, we contextualize these insights within broader discussions of multi-agent system design and collective action. Our analysis underscores the importance of incorporating human-like cognitive constraints, not just idealized rationality, into models of institutional emergence and resilience.
MPEC: Manifold-Preserved EEG Classification via an Ensemble of Clustering-Based Classifiers
Shahbazi, Shermin, Nasiri, Mohammad-Reza, Ramezani, Majid
ORCID: 0000 - 0003 - 0886 - 7023 Abstract -- Accurate classification of EEG signals is crucial for brain - computer interfaces (BCIs) and neuroprosthetic applications, yet many existing methods fail to account for the non - Euclidean, manifold structure of EEG data, resulting in suboptimal performance. Preserving this manifold information is essential to capture the true geometry of EEG signals, but tradition al classification techniques largely overlook this need. To this end, w e propose MPEC (Manifold - Preserved EEG Classification via an Ensemble of Clus tering - Based Classifiers), that introduces two key innovations: (1) a feature engineering phase that combines covariance matrices and Radial Basis Function (RBF) kernels to capture both linear and non - linear relationships among EEG channels, and (2) a clustering phase that employs a modified K - means al gorithm tailored for the Riemannian manifold space, ensuring local geometric sensitivity. Ensembling multiple clustering - based classifiers, MPEC achieves superior results, validated by significant improvements on the BCI Competition IV dataset 2a. Keywords -- brain - computer interfaces (BCIs), EEG signal classification, ensemble modeling, clustering - based classification. EEG signal classification is essential in brain - computer interfaces (BCIs) and neuroprosthetics, where precise interpretation supports real - time control and cognitive applications. However, traditional techniques often overlook the non - Euclidean, manifold structure of EEG data, leading to suboptimal results [1] . We propose Manifold - Preserved EEG Classification via an Ensemble of Clustering - Based Classifiers (MPEC), a novel method that enhances classification accuracy by preserving the intrinsic manifold structure of EEG signals.