South America
Gaussian Processes for Survival Analysis
We introduce a semi-parametric Bayesian model for survival analysis. The model is centred on a parametric baseline hazard, and uses a Gaussian process to model variations away from it nonparametrically, as well as dependence on covariates. As opposed to many other methods in survival analysis, our framework does not impose unnecessary constraints in the hazard rate or in the survival function. Furthermore, our model handles left, right and interval censoring mechanisms common in survival analysis. We propose a MCMC algorithm to perform inference and an approximation scheme based on random Fourier features to make computations faster. We report experimental results on synthetic and real data, showing that our model performs better than competing models such as Cox proportional hazards, ANOVA-DDP and random survival forests.
An urn model for majority voting in classification ensembles
In this work we analyze the class prediction of parallel randomized ensembles by majority voting as an urn model. For a given test instance, the ensemble can be viewed as an urn of marbles of different colors. A marble represents an individual classifier. Its color represents the class label prediction of the corresponding classifier. The sequential querying of classifiers in the ensemble can be seen as draws without replacement from the urn.
Estimating the Size of a Large Network and its Communities from a Random Sample Lin Chen
Most real-world networks are too large to be measured or studied directly and there is substantial interest in estimating global network properties from smaller sub-samples. One of the most important global properties is the number of vertices/nodes in the network. Estimating the number of vertices in a large network is a major challenge in computer science, epidemiology, demography, and intelligence analysis. In this paper we consider a population random graph G = (V, E) from the stochastic block model (SBM) with K communities/blocks. A sample is obtained by randomly choosing a subset W V and letting G(W) be the induced subgraph in G of the vertices in W. In addition to G(W), we observe the total degree of each sampled vertex and its block membership.
Generalized Correspondence-LDA Models (GC-LDA) for Identifying Functional Regions in the Brain
This paper presents Generalized Correspondence-LDA (GC-LDA), a generalization of the Correspondence-LDA model that allows for variable spatial representations to be associated with topics, and increased flexibility in terms of the strength of the correspondence between data types induced by the model. We present three variants of GC-LDA, each of which associates topics with a different spatial representation, and apply them to a corpus of neuroimaging data. In the context of this dataset, each topic corresponds to a functional brain region, where the region's spatial extent is captured by a probability distribution over neural activity, and the region's cognitive function is captured by a probability distribution over linguistic terms. We illustrate the qualitative improvements offered by GC-LDA in terms of the types of topics extracted with alternative spatial representations, as well as the model's ability to incorporate a-priori knowledge from the neuroimaging literature. We furthermore demonstrate that the novel features of GC-LDA improve predictions for missing data.
Pruning Random Forests for Prediction on a Budget
We propose to prune a random forest (RF) for resource-constrained prediction. We first construct a RF and then prune it to optimize expected feature cost & accuracy. We pose pruning RFs as a novel 0-1 integer program with linear constraints that encourages feature re-use. We establish total unimodularity of the constraint set to prove that the corresponding LP relaxation solves the original integer program. We then exploit connections to combinatorial optimization and develop an efficient primal-dual algorithm, scalable to large datasets. In contrast to our bottom-up approach, which benefits from good RF initialization, conventional methods are top-down acquiring features based on their utility value and is generally intractable, requiring heuristics. Empirically, our pruning algorithm outperforms existing state-of-the-art resource-constrained algorithms.
Split LBI: An Iterative Regularization Path with Structural Sparsity Chendi Huang
An iterative regularization path with structural sparsity is proposed in this paper based on variable splitting and the Linearized Bregman Iteration, hence called Split LBI. Despite its simplicity, Split LBI outperforms the popular generalized Lasso in both theory and experiments. A theory of path consistency is presented that equipped with a proper early stopping, Split LBI may achieve model selection consistency under a family of Irrepresentable Conditions which can be weaker than the necessary and sufficient condition for generalized Lasso.
Automatic Speech Recognition (ASR) for the Diagnosis of pronunciation of Speech Sound Disorders in Korean children
Ahn, Taekyung, Hong, Yeonjung, Im, Younggon, Kim, Do Hyung, Kang, Dayoung, Jeong, Joo Won, Kim, Jae Won, Kim, Min Jung, Cho, Ah-ra, Jang, Dae-Hyun, Nam, Hosung
Generally, children with speech sound disorders (SSDs) are clinically diagnosed by speech-language pathologists who transcribe the child's speech and manually analyse pronunciation errors. Although there have been several attempts to automatically analyse pronunciation errors in child SSD speech [1, 2], traditional automatic speech recognition (ASR) training methods were unable to achieve the desired recognition performance to replace human annotations. Training traditional ASR models requires a substantial amount of accurately annotated speech data. In addition, traditional ASR models require a pronunciation dictionary called a lexicon for combining in an acoustic model with learned speech features via phonetic symbols. A language model (LM) that has computed the probability of word chains based on correct grammar and vocabulary is also required [3]. For child SSD speech data, it is difficult and timeconsuming not only to gather a transcribed speech but also to build hand-designed pronunciation dictionaries with several pronunciations having the same spelling. However, over a few short years, the development of the end-to-end-based (e2e-based) model training method generated new possibilities in the spectrum of ASR [4, 5].
generAItor: Tree-in-the-Loop Text Generation for Language Model Explainability and Adaptation
Spinner, Thilo, Kehlbeck, Rebecca, Sevastjanova, Rita, Stähle, Tobias, Keim, Daniel A., Deussen, Oliver, El-Assady, Mennatallah
Large language models (LLMs) are widely deployed in various downstream tasks, e.g., auto-completion, aided writing, or chat-based text generation. However, the considered output candidates of the underlying search algorithm are under-explored and under-explained. We tackle this shortcoming by proposing a tree-in-the-loop approach, where a visual representation of the beam search tree is the central component for analyzing, explaining, and adapting the generated outputs. To support these tasks, we present generAItor, a visual analytics technique, augmenting the central beam search tree with various task-specific widgets, providing targeted visualizations and interaction possibilities. Our approach allows interactions on multiple levels and offers an iterative pipeline that encompasses generating, exploring, and comparing output candidates, as well as fine-tuning the model based on adapted data. Our case study shows that our tool generates new insights in gender bias analysis beyond state-of-the-art template-based methods. Additionally, we demonstrate the applicability of our approach in a qualitative user study. Finally, we quantitatively evaluate the adaptability of the model to few samples, as occurring in text-generation use cases.
Stress index strategy enhanced with financial news sentiment analysis for the equity markets
Lefort, Baptiste, Benhamou, Eric, Ohana, Jean-Jacques, Saltiel, David, Guez, Beatrice, Jacquot, Thomas
Recent advancements in Natural Language Processing (NLP) with Large Language Models (LLMs) have made the sentiment analysis of financial news by machines a practical achievement and no longer just a dream. More precisely, Large Language Models (LLMs) have marked a major step forward in processing large contexts, exhibiting human-level performance on various professional and academic benchmarks, although they still have limitations such as reliability issues and limited context windows [OpenAI, 2023]. Their ability to process more context has shown particularly interesting applications in many business areas [George and George, 2023]. Hence exploring the potential to extract either weak or strong signals from financial news to enhance a risk-on risk-off investment strategy becomes highly pertinent. Indeed, extracting sentiment from financial news is not new [Tetlock, 2007, Schumaker and Chen, 2009], and finance has a longstanding tradition of exploiting textual data [Kearney and Liu, 2014].
Annotations on a Budget: Leveraging Geo-Data Similarity to Balance Model Performance and Annotation Cost
Ignat, Oana, Bai, Longju, Nwatu, Joan, Mihalcea, Rada
Current foundation models have shown impressive performance across various tasks. However, several studies have revealed that these models are not effective for everyone due to the imbalanced geographical and economic representation of the data used in the training process. Most of this data comes from Western countries, leading to poor results for underrepresented countries. To address this issue, more data needs to be collected from these countries, but the cost of annotation can be a significant bottleneck. In this paper, we propose methods to identify the data to be annotated to balance model performance and annotation costs. Our approach first involves finding the countries with images of topics (objects and actions) most visually distinct from those already in the training datasets used by current large vision-language foundation models. Next, we identify countries with higher visual similarity for these topics and show that using data from these countries to supplement the training data improves model performance and reduces annotation costs.