Africa
Inspecting the Geographical Representativeness of Images from Text-to-Image Models
Basu, Abhipsa, Babu, R. Venkatesh, Pruthi, Danish
Recent progress in generative models has resulted in models that produce both realistic as well as relevant images for most textual inputs. These models are being used to generate millions of images everyday, and hold the potential to drastically impact areas such as generative art, digital marketing and data augmentation. Given their outsized impact, it is important to ensure that the generated content reflects the artifacts and surroundings across the globe, rather than over-representing certain parts of the world. In this paper, we measure the geographical representativeness of common nouns (e.g., a house) generated through DALL.E 2 and Stable Diffusion models using a crowdsourced study comprising 540 participants across 27 countries. For deliberately underspecified inputs without country names, the generated images most reflect the surroundings of the United States followed by India, and the top generations rarely reflect surroundings from all other countries (average score less than 3 out of 5). Specifying the country names in the input increases the representativeness by 1.44 points on average for DALL.E 2 and 0.75 for Stable Diffusion, however, the overall scores for many countries still remain low, highlighting the need for future models to be more geographically inclusive. Lastly, we examine the feasibility of quantifying the geographical representativeness of generated images without conducting user studies.
AIwriting: Relations Between Image Generation and Digital Writing
Rettberg, Scott, Memmott, Talan, Rettberg, Jill Walker, Nelson, Jason, Lichty, Patrick
During 2022, both transformer-based AI text generation sys-tems such as GPT-3 and AI text-to-image generation systems such as DALL-E 2 and Stable Diffusion made exponential leaps forward and are unquestionably altering the fields of digital art and electronic literature. In this panel a group of electronic literature authors and theorists consider new oppor-tunities for human creativity presented by these systems and present new works have produced during the past year that specifically address these systems as environments for literary expressions that are translated through iterative interlocutive processes into visual representations. The premise that binds these presentations is that these systems and the works gener-ated must be considered from a literary perspective, as they originate in human writing. In works ranging from a visual memoir of the personal experience of a health crisis, to interac-tive web comics, to architectures based on abstract poetic language, to political satire, four artists explore the capabili-ties of these writing environments for new genres of literary artist practice, while a digital culture theorist considers the origins and effects of the particular training datasets of human language and images on which these new hybrid forms are based.
Improving Fairness in AI Models on Electronic Health Records: The Case for Federated Learning Methods
Poulain, Raphael, Tarek, Mirza Farhan Bin, Beheshti, Rahmatollah
Developing AI tools that preserve fairness is of critical importance, specifically in high-stakes applications such as those in healthcare. However, health AI models' overall prediction performance is often prioritized over the possible biases such models could have. In this study, we show one possible approach to mitigate bias concerns by having healthcare institutions collaborate through a federated learning paradigm (FL; which is a popular choice in healthcare settings). While FL methods with an emphasis on fairness have been previously proposed, their underlying model and local implementation techniques, as well as their possible applications to the healthcare domain remain widely underinvestigated. Therefore, we propose a comprehensive FL approach with adversarial debiasing and a fair aggregation method, suitable to various fairness metrics, in the healthcare domain where electronic health records are used. Not only our approach explicitly mitigates bias as part of the optimization process, but an FL-based paradigm would also implicitly help with addressing data imbalance and increasing the data size, offering a practical solution for healthcare applications. We empirically demonstrate our method's superior performance on multiple experiments simulating large-scale real-world scenarios and compare it to several baselines. Our method has achieved promising fairness performance with the lowest impact on overall discrimination performance (accuracy).
MD3: The Multi-Dialect Dataset of Dialogues
Eisenstein, Jacob, Prabhakaran, Vinodkumar, Rivera, Clara, Demszky, Dorottya, Sharma, Devyani
We introduce a new dataset of conversational speech representing English from India, Nigeria, and the United States. The Multi-Dialect Dataset of Dialogues (MD3) strikes a new balance between open-ended conversational speech and task-oriented dialogue by prompting participants to perform a series of short information-sharing tasks. This facilitates quantitative cross-dialectal comparison, while avoiding the imposition of a restrictive task structure that might inhibit the expression of dialect features. Preliminary analysis of the dataset reveals significant differences in syntax and in the use of discourse markers. The dataset, which will be made publicly available with the publication of this paper, includes more than 20 hours of audio and more than 200,000 orthographically-transcribed tokens.
Simulation of a Variational Quantum Perceptron using Grover's Algorithm
Innan, Nouhaila, Bennai, Mohamed
Recently, there has been an increasing number of studies to combine the disciplines of quantum information and machine learning, and a variety of theories to merge these fields have consistently been put forward since machine learning is under pressure due to a lack of processing power of the increased amount of data in the world, and quantum computing offers these super computational capabilities. The combination of these two fields invariably leads to a massive interest in innovative information processing mechanisms that open up a new and improved range of solutions for various domains of applications, and the first concept was the research on quantum models of neural networks; it was essentially biologically inspired, in the hope of finding explanations for brain function within the framework of quantum theory [1]. In 2013, this combination got the name quantum machine learning by Lloyd et al. [2] as a definition of an area of research that explores the combination of quantum information and ML principles. However, the development of potential quantum machine learning algorithms has made some progress; several famous classical ML algorithms already have quantum analogs, such as the quantum support vector machine (QSVM), quantum k-means clustering, quantum Boltzmann machine (QBM), and the quantum perceptron (QP) which there have been some papers that mainly overview methods and algorithms of this model. Zhou et al. [3] developed a quantum perceptron approach based on the quantum phase capable of computing the XOR function using only one neuron, then Siomau et al. [4] introduced an autonomous quantum perceptron based on calculating a set of positive valued operators and valued measurements (POVM), after that Sagheer and Zidane [5] proposed a quantum perceptron based on Siomau method capable of constructing its own set of activation operators to be applied widely in both quantum and classical applications to overcome the linearity limitation of the classical perceptron In 2018, a multidimensional input quantum perceptron (MDIQP) was proposed by Yamamoto et al. [6]; their model had an arbitrary number of inputs with different synaptic weights, being able to form large quantum artificial neural networks (QANNs).
Neural Network Entropy (NNetEn): Entropy-Based EEG Signal and Chaotic Time Series Classification, Python Package for NNetEn Calculation
Velichko, Andrei, Belyaev, Maksim, Izotov, Yuriy, Murugappan, Murugappan, Heidari, Hanif
Entropy measures are effective features for time series classification problems. Traditional entropy measures, such as Shannon entropy, use probability distribution function. However, for the effective separation of time series, new entropy estimation methods are required to characterize the chaotic dynamic of the system. Our concept of Neural Network Entropy (NNetEn) is based on the classification of special datasets in relation to the entropy of the time series recorded in the reservoir of the neural network. NNetEn estimates the chaotic dynamics of time series in an original way and does not take into account probability distribution functions. We propose two new classification metrics: R2 Efficiency and Pearson Efficiency. The efficiency of NNetEn is verified on separation of two chaotic time series of sine mapping using dispersion analysis. For two close dynamic time series (r = 1.1918 and r = 1.2243), the F-ratio has reached the value of 124 and reflects high efficiency of the introduced method in classification problems. The electroenceph-alography signal classification for healthy persons and patients with Alzheimer disease illustrates the practical application of the NNetEn features. Our computations demonstrate the synergistic effect of increasing classification accuracy when applying traditional entropy measures and the NNetEn concept conjointly. An implementation of the algorithms in Python is presented.
Less is More! A slim architecture for optimal language translation
Herranz-Celotti, Luca, Rrapaj, Ermal
The softmax attention mechanism has emerged as a noteworthy development in the field of Artificial Intelligence research, building on the successes of Transformer-based architectures. However, their ever increasing sizes necessitate ever increasing computational memory, that limits their usage. We propose KgV, a sigmoid gating mechanism that, in conjunction with softmax attention, significantly boosts performance without increasing architecture size. To amend the size requirements, we leverage Tensor Chains to identify and prune the excess parameters. We find that such excess resides primarily within the embedding layer, and not in the output linear layer. To further improve embedding and significantly reduce parameters, we introduce H-SoftPOS, a hierarchical embedding layer which simultaneously enhances performance. Remarkably, on the WMT14 English-German validation set, our approach yields a threefold reduction in perplexity, surpassing the current state-of-the-art, while reducing parameter counts also by a factor of 3. When we further reduce the number of parameters up to sevenfold, we can still achieve a 21\% decrease in perplexity with respect to the baseline Transformer. To understand generalization capabilities, we conduct experiments on the 7 language pairs of the WMT17 dataset. Our method outperforms existing techniques in terms of test loss while simultaneously halving the number of parameters. Moreover, we observe a 70 times reduction in variance with respect to the prior state-of-the-art. In conclusion, our proposed method yields significant improvements in performance and much lower memory cost. We call the resulting architecture Anthe.
Machine Learning Recommendation System For Health Insurance Decision Making In Nigeria
Owoyemi, Ayomide, Nnaemeka, Emmanuel, Benson, Temitope O., Ikpe, Ronald, Nwachukwu, Blessing, Isedowo, Temitope
Ensuring financial protection and access to needed healthcare is integral to achieving Universal Health coverage (UHC) which is integral to the achievement of Sustainable Development Goal (SDG) 3. The uptake of health insurance has been poor in Nigeria, and this has been due to a lot of challenges which include access to healthcare facilities, beliefs, low level of awareness about health insurance, policy challenges, poverty, and where to get required information (2-4). A significant step to improving this includes improved awareness, access to information and tools to support decision making (5). Recommender systems are designed to assist individuals to deal with a vast array of choices, it takes advantage of several sources of information to predict options and preferences around specific items (6-8). Recommender systems enhance the user experience by giving fast and coherent suggestions. Artificial intelligence (AI) based recommender systems have gained popularity in helping individuals find movies, books, music and different types of products on the internet including diverse applications in healthcare (9-12). It has also been used in the insurance industry to support decision making on insurance products (13). Recommender systems are in three main categories which include: collaborative filtering, content-based and hybrid filtering (9). Collaborative filtering method uses the data from other users rating of items to make recommendation for a user for those items.
TAPIR: Learning Adaptive Revision for Incremental Natural Language Understanding with a Two-Pass Model
Kahardipraja, Patrick, Madureira, Brielen, Schlangen, David
Language is by its very nature incremental in how it is produced and processed. This property can be exploited by NLP systems to produce fast responses, which has been shown to be beneficial for real-time interactive applications. Recent neural network-based approaches for incremental processing mainly use RNNs or Transformers. RNNs are fast but monotonic (cannot correct earlier output, which can be necessary in incremental processing). Transformers, on the other hand, consume whole sequences, and hence are by nature non-incremental. A restart-incremental interface that repeatedly passes longer input prefixes can be used to obtain partial outputs, while providing the ability to revise. However, this method becomes costly as the sentence grows longer. In this work, we propose the Two-pass model for AdaPtIve Revision (TAPIR) and introduce a method to obtain an incremental supervision signal for learning an adaptive revision policy. Experimental results on sequence labelling show that our model has better incremental performance and faster inference speed compared to restart-incremental Transformers, while showing little degradation on full sequences.
At-Admission Prediction of Mortality and Pulmonary Embolism in COVID-19 Patients Using Statistical and Machine Learning Methods: An International Cohort Study
Mesinovic, Munib, Wong, Xin Ci, Rajahram, Giri Shan, Citarella, Barbara Wanjiru, Peariasamy, Kalaiarasu M., Greve, Frank van Someren, Olliaro, Piero, Merson, Laura, Clifton, Lei, Kartsonaki, Christiana, Group, ISARIC Characterisation
By September, 2022, more than 600 million cases of SARS-CoV-2 infection have been reported globally, resulting in over 6.5 million deaths. COVID-19 mortality risk estimators are often, however, developed with small unrepresentative samples and with methodological limitations. It is highly important to develop predictive tools for pulmonary embolism (PE) in COVID-19 patients as one of the most severe preventable complications of COVID-19. Using a dataset of more than 800,000 COVID-19 patients from an international cohort, we propose a cost-sensitive gradient-boosted machine learning model that predicts occurrence of PE and death at admission. Logistic regression, Cox proportional hazards models, and Shapley values were used to identify key predictors for PE and death. Our prediction model had a test AUROC of 75.9% and 74.2%, and sensitivities of 67.5% and 72.7% for PE and all-cause mortality respectively on a highly diverse and held-out test set. The PE prediction model was also evaluated on patients in UK and Spain separately with test results of 74.5% AUROC, 63.5% sensitivity and 78.9% AUROC, 95.7% sensitivity. Age, sex, region of admission, comorbidities (chronic cardiac and pulmonary disease, dementia, diabetes, hypertension, cancer, obesity, smoking), and symptoms (any, confusion, chest pain, fatigue, headache, fever, muscle or joint pain, shortness of breath) were the most important clinical predictors at admission. Our machine learning model developed from an international cohort can serve to better regulate hospital risk prioritisation of at-risk patients.