Goto

Collaborating Authors

 Performance Analysis


An Explainable AI Model for Predicting the Recurrence of Differentiated Thyroid Cancer

arXiv.org Artificial Intelligence

Thyroid carcinoma, a significant yet often controllable cancer, has seen a rise in cases, largely due to advancements in diagnostic methods. Differentiated thyroid cancer (DTC), which includes papillary and follicular varieties, is typically associated with a positive prognosis in academic circles. Nevertheless, there are still some individuals who may experience a recurrence. This study employs machine learning, particularly deep learning models, to predict the recurrence of DTC, with the goal of improving patient care through personalized treatment approaches. By analysing a dataset containing clinicopathological features of patients, the model achieved remarkable accuracy rates of 98% during training and 96% during testing. To improve the model's interpretability, we used techniques like LIME and Morris Sensitivity Analysis. These methods gave us valuable insights into how the model makes decisions. The results suggest that combining deep learning models with interpretability techniques can be extremely useful in quickly identifying the recurrence of thyroid cancer in patients. This can help in making informed therapeutic choices and customizing treatment approaches for individual patients.


A Holistic Weakly Supervised Approach for Liver Tumor Segmentation with Clinical Knowledge-Informed Label Smoothing

arXiv.org Artificial Intelligence

Liver is also a common destination for metastatic cancer cells originating from various abdominal organs, including the colon, rectum, pancreas, as well as distant organs such as the breast and lung. Consequently, a thorough examination of the liver and its lesions is critical to comprehensive tumor staging and management strategies. Standard tumor assessment protocols, such as the Response Evaluation Criteria in Solid Tumor (RECIST), require precise measurement of the diameter of the largest target lesion (Eisenhauer et al., 2009). Thus, accurate localization and precise segmentation of liver tumors within CT scans are essential for effective diagnosis, treatment planning, and monitoring of therapeutic response in patients with liver cancer (Shiina et al., 2018; Terranova & Venkatakrishnan, 2024; Virdis et al., 2019). Manual delineation of target lesions in CT scans is fraught with challenges, being both time-consuming and prone to poor reproducibility and operator-dependent variability (Gul et al., 2022). Automated liver tumor segmentation can provide clinicians with rapid and consistent tumor delineation, thereby improving patient outcomes and reducing healthcare costs. Recently, deep learning algorithms have shown promise for producing automated liver and tumor segmentation (Gul et al., 2022). While many algorithms achieved exceptional performance in liver segmentation, with dice scores ranging from 0.90 to 0.96, enhancing liver tumor segmentation remains a challenge, currently standing at dice scores from 0.41 to 0.67 according to a recent Liver Tumor Segmentation Benchmark (Bilic et al., 2023). Liver tumor segmentation is an inherently challenging task because tumors vary significantly in size, shape, and location across different patients, which leads to a broad spectrum of tumor characteristics and hinders model generalization (Sabir et al., 2022).


Single Ground Truth Is Not Enough: Add Linguistic Variability to Aspect-based Sentiment Analysis Evaluation

arXiv.org Artificial Intelligence

Aspect-based sentiment analysis (ABSA) is the challenging task of extracting sentiment along with its corresponding aspects and opinions from human language. Due to the inherent variability of natural language, aspect and opinion terms can be expressed in various surface forms, making their accurate identification complex. Current evaluation methods for this task often restrict answers to a single ground truth, penalizing semantically equivalent predictions that differ in surface form. To address this limitation, we propose a novel, fully automated pipeline that augments existing test sets with alternative valid responses for aspect and opinion terms. This approach enables a fairer assessment of language models by accommodating linguistic diversity, resulting in higher human agreement than single-answer test sets (up to 10%p improvement in Kendall's Tau score). Our experimental results demonstrate that Large Language Models (LLMs) show substantial performance improvements over T5 models when evaluated using our augmented test set, suggesting that LLMs' capabilities in ABSA tasks may have been underestimated. This work contributes to a more comprehensive evaluation framework for ABSA, potentially leading to more accurate assessments of model performance in information extraction tasks, particularly those involving span extraction.


Improving Academic Skills Assessment with NLP and Ensemble Learning

arXiv.org Artificial Intelligence

This study addresses the critical challenges of assessing foundational academic skills by leveraging advancements in natural language processing (NLP). Traditional assessment methods often struggle to provide timely and comprehensive feedback on key cognitive and linguistic aspects, such as coherence, syntax, and analytical reasoning. Our approach integrates multiple state-of-the-art NLP models, including BERT, RoBERTa, BART, DeBERTa, and T5, within an ensemble learning framework. These models are combined through stacking techniques using LightGBM and Ridge regression to enhance predictive accuracy. The methodology involves detailed data preprocessing, feature extraction, and pseudo-label learning to optimize model performance. By incorporating sophisticated NLP techniques and ensemble learning, this study significantly improves the accuracy and efficiency of assessments, offering a robust solution that surpasses traditional methods and opens new avenues for educational technology research focused on enhancing core academic competencies.


fastHDMI: Fast Mutual Information Estimation for High-Dimensional Data

arXiv.org Machine Learning

In this paper, we introduce fastHDMI, a Python package designed for efficient variable screening in high-dimensional datasets, particularly neuroimaging data. This work pioneers the application of three mutual information estimation methods for neuroimaging variable selection, a novel approach implemented via fastHDMI. These advancements enhance our ability to analyze the complex structures of neuroimaging datasets, providing improved tools for variable selection in high-dimensional spaces. Using the preprocessed ABIDE dataset, we evaluate the performance of these methods through extensive simulations. The tests cover a range of conditions, including linear and nonlinear associations, as well as continuous and binary outcomes. Our results highlight the superiority of the FFTKDE-based mutual information estimation for feature screening in continuous nonlinear outcomes, while binning-based methods outperform others for binary outcomes with nonlinear probability preimages. For linear simulations, both Pearson correlation and FFTKDE-based methods show comparable performance for continuous outcomes, while Pearson excels in binary outcomes with linear probability preimages. A comprehensive case study using the ABIDE dataset further demonstrates fastHDMI's practical utility, showcasing the predictive power of models built from variables selected using our screening techniques. This research affirms the computational efficiency and methodological strength of fastHDMI, significantly enriching the toolkit available for neuroimaging analysis.


Structure of Artificial Neural Networks -- Empirical Investigations

arXiv.org Artificial Intelligence

Within one decade, Deep Learning overtook the dominating solution methods of countless problems of artificial intelligence. ``Deep'' refers to the deep architectures with operations in manifolds of which there are no immediate observations. For these deep architectures some kind of structure is pre-defined -- but what is this structure? With a formal definition for structures of neural networks, neural architecture search problems and solution methods can be formulated under a common framework. Both practical and theoretical questions arise from closing the gap between applied neural architecture search and learning theory. Does structure make a difference or can it be chosen arbitrarily? This work is concerned with deep structures of artificial neural networks and examines automatic construction methods under empirical principles to shed light on to the so called ``black-box models''. Our contributions include a formulation of graph-induced neural networks that is used to pose optimisation problems for neural architecture. We analyse structural properties for different neural network objectives such as correctness, robustness or energy consumption and discuss how structure affects them. Selected automation methods for neural architecture optimisation problems are discussed and empirically analysed. With the insights gained from formalising graph-induced neural networks, analysing structural properties and comparing the applicability of neural architecture search methods qualitatively and quantitatively we advance these methods in two ways. First, new predictive models are presented for replacing computationally expensive evaluation schemes, and second, new generative models for informed sampling during neural architecture search are analysed and discussed.


Text Classification using Graph Convolutional Networks: A Comprehensive Survey

arXiv.org Artificial Intelligence

Text classification is a quintessential and practical problem in natural language processing with applications in diverse domains such as sentiment analysis, fake news detection, medical diagnosis, and document classification. A sizable body of recent works exists where researchers have studied and tackled text classification from different angles with varying degrees of success. Graph convolution network (GCN)-based approaches have gained a lot of traction in this domain over the last decade with many implementations achieving state-of-the-art performance in more recent literature and thus, warranting the need for an updated survey. This work aims to summarize and categorize various GCN-based Text Classification approaches with regard to the architecture and mode of supervision. It identifies their strengths and limitations and compares their performance on various benchmark datasets. We also discuss future research directions and the challenges that exist in this domain.


Improving the accuracy of food security predictions by integrating conflict data

arXiv.org Artificial Intelligence

Food security (FS) is a complex and multifaceted problem, influenced by several factors such as weather events, economic shocks, and natural disasters. Understanding the dynamics of food security is crucial for effective policymaking and humanitarian efforts. While conflicts and violent events increasingly stand out as key drivers of food crises[1], the depth of their impact remains largely underexplored. Examining the quantitative aspects of this impact is essential for developing more targeted interventions and strategies to address the complex interplay between conflict and food security. Existing research tends to be qualitative in nature (Kemmerling et al.2022; Brown et al. 2020; Brown et al. 2021), leaving a significant gap in understanding the quantitative aspects of how conflicts impact FS levels. By delving into quantitative analyses, we can not only enhance our comprehension of the magnitude of the problem but also pave the way for evidence-based decision-making in efforts to alleviate food insecurity in conflict-affected regions. Regarding the qualitative study of conflicts and FS, Kemmerling et al.(2022)[2] provided a comprehensive explanation on how violence and armed conflicts impact FS through destruction, displacement, financing of conflicts and food being used as a weapon. The authors call for better conflict data collection, and an increase in focus on the study of conflicts early warnings.


Use of What-if Scenarios to Help Explain Artificial Intelligence Models for Neonatal Health

arXiv.org Artificial Intelligence

Early detection of intrapartum risk enables interventions to potentially prevent or mitigate adverse labor outcomes such as cerebral palsy. Currently, there is no accurate automated system to predict such events to assist with clinical decision-making. To fill this gap, we propose "Artificial Intelligence (AI) for Modeling and Explaining Neonatal Health" (AIMEN), a deep learning framework that not only predicts adverse labor outcomes from maternal, fetal, obstetrical, and intrapartum risk factors but also provides the model's reasoning behind the predictions made. The latter can provide insights into what modifications in the input variables of the model could have changed the predicted outcome. We address the challenges of imbalance and small datasets by synthesizing additional training data using Adaptive Synthetic Sampling (ADASYN) and Conditional Tabular Generative Adversarial Networks (CTGAN). AIMEN uses an ensemble of fully-connected neural networks as the backbone for its classification with the data augmentation supported by either ADASYN or CTGAN. AIMEN, supported by CTGAN, outperforms AIMEN supported by ADASYN in classification. AIMEN can predict a high risk for adverse labor outcomes with an average F1 score of 0.784. It also provides counterfactual explanations that can be achieved by changing 2 to 3 attributes on average. Resources available: https://github.com/ab9mamun/AIMEN.


C-Adapter: Adapting Deep Classifiers for Efficient Conformal Prediction Sets

arXiv.org Artificial Intelligence

Conformal prediction, as an emerging uncertainty quantification technique, typically functions as post-hoc processing for the outputs of trained classifiers. To optimize the classifier for maximum predictive efficiency, Conformal Training rectifies the training objective with a regularization that minimizes the average prediction set size at a specific error rate. However, the regularization term inevitably deteriorates the classification accuracy and leads to suboptimal efficiency of conformal predictors. To address this issue, we introduce \textbf{Conformal Adapter} (C-Adapter), an adapter-based tuning method to enhance the efficiency of conformal predictors without sacrificing accuracy. In particular, we implement the adapter as a class of intra order-preserving functions and tune it with our proposed loss that maximizes the discriminability of non-conformity scores between correctly and randomly matched data-label pairs. Using C-Adapter, the model tends to produce extremely high non-conformity scores for incorrect labels, thereby enhancing the efficiency of prediction sets across different coverage rates. Extensive experiments demonstrate that C-Adapter can effectively adapt various classifiers for efficient prediction sets, as well as enhance the conformal training method.