Building and analysing knowledge graphs (KGs) to aid drug discovery is a topical area of research. A salient feature of KGs is their ability to combine many heterogeneous data sources in a format that facilitates discovering connections. The utility of KGs has been exemplified in areas such as drug repurposing, with insights made through manual exploration and modelling of the data. In this article, we discuss promises and pitfalls of using natural language processing (NLP) to mine'unstructured text' - typically from scientific literature - as a data source for KGs. This draws on our experience of initially parsing'structured' data sources - such as ChEMBL - as the basis for data within a KG, and then enriching or expanding upon them using NLP. The fundamental promise of NLP for KGs is the automated extraction of data from millions of documents - a task practically impossible to do via human curation alone. However, there are many potential pitfalls in NLP-KG pipelines - such as incorrect named entity recognition and ontology linking - all of which could ultimately lead to erroneous inferences and conclusions.

We study the ability of state-of-the art models to answer constraint satisfaction queries for information retrieval (e.g., 'a list of ice cream shops in San Diego'). In the past, such queries were considered to be tasks that could only be solved via web-search or knowledge bases. More recently, large language models (LLMs) have demonstrated initial emergent abilities in this task. However, many current retrieval benchmarks are either saturated or do not measure constraint satisfaction. Motivated by rising concerns around factual incorrectness and hallucinations of LLMs, we present KITAB, a new dataset for measuring constraint satisfaction abilities of language models. KITAB consists of book-related data across more than 600 authors and 13,000 queries, and also offers an associated dynamic data collection and constraint verification approach for acquiring similar test data for other authors. Our extended experiments on GPT4 and GPT3.5 characterize and decouple common failure modes across dimensions such as information popularity, constraint types, and context availability. Results show that in the absence of context, models exhibit severe limitations as measured by irrelevant information, factual errors, and incompleteness, many of which exacerbate as information popularity decreases. While context availability mitigates irrelevant information, it is not helpful for satisfying constraints, identifying fundamental barriers to constraint satisfaction. We open source our contributions to foster further research on improving constraint satisfaction abilities of future models.

To increase the internet content of Indian Languages in different domains India is home to a multitude of languages of which 22 languages are recognised by the Indian Constitution as official. As part of the Speech Consortium of the NLTM-R&D Building speech based applications for the Indian population which is led by Indian Institute of Technology Madras is a difficult problem owing to limited data and the number (IITM), SPRING Lab of IITM has collected and is collecting of languages and accents to accommodate. To encourage the legally sourced and manually transcribed speech corpus in language technology community to build speech based applications various Indian languages such as Tamil, Hindi, Indian English, in Indian languages, we are open sourcing SPRING-Marathi, Bengali, Malayalam, Telugu, Assamese, Kannada, INX data which has about 2000 hours of legally sourced and Gujarati, Odia, Punjabi. Bodo and Manipuri through manually transcribed speech data for ASR system building speech data collection agencies identified using a tendering in Assamese, Bengali, Gujarati, Hindi, Kannada, Malayalam, process. The data collected has been carefully evaluated by Marathi, Odia, Punjabi and Tamil. This endeavor is by the Speech Quality Control (SQC) team led by KL University. SPRING Lab, Indian Institute of Technology Madras and is We are releasing the first set of valuable data amounting a part of National Language Translation Mission (NLTM), to 2000 hours (both Audio and corresponding manually transcribed funded by the Indian Ministry of Electronics and Information transcriptions) which was collected, cleaned and prepared Technology (MeitY), Government of India. We describe the for ASR system building in 10 Indian languages such data collection and data cleaning process along with the data as Assamese, Bengali, Gujarati, Hindi, Kannada, Malayalam, statistics in this paper.

Natural language processing (NLP) has made significant progress for well-resourced languages such as English but lagged behind for low-resource languages like Setswana. This paper addresses this gap by presenting PuoBERTa, a customised masked language model trained specifically for Setswana. We cover how we collected, curated, and prepared diverse monolingual texts to generate a high-quality corpus for PuoBERTa's training. Building upon previous efforts in creating monolingual resources for Setswana, we evaluated PuoBERTa across several NLP tasks, including part-of-speech (POS) tagging, named entity recognition (NER), and news categorisation. Additionally, we introduced a new Setswana news categorisation dataset and provided the initial benchmarks using PuoBERTa. Our work demonstrates the efficacy of PuoBERTa in fostering NLP capabilities for understudied languages like Setswana and paves the way for future research directions.

Automated text simplification, a technique useful for making text more accessible to people such as children and emergent bilinguals, is often thought of as a monolingual translation task from complex sentences to simplified sentences using encoder-decoder models. This view fails to account for elaborative simplification, where new information is added into the simplified text. This paper proposes to view elaborative simplification through the lens of the Question Under Discussion (QUD) framework, providing a robust way to investigate what writers elaborate upon, how they elaborate, and how elaborations fit into the discourse context by viewing elaborations as explicit answers to implicit questions. We introduce ElabQUD, consisting of 1.3K elaborations accompanied with implicit QUDs, to study these phenomena. We show that explicitly modeling QUD (via question generation) not only provides essential understanding of elaborative simplification and how the elaborations connect with the rest of the discourse, but also substantially improves the quality of elaboration generation.

The tremendous growth of social media users interacting in online conversations has led to significant growth in hate speech, affecting people from various demographics. Most of the prior works focus on detecting explicit hate speech, which is overt and leverages hateful phrases, with very little work focusing on detecting hate speech that is implicit or denotes hatred through indirect or coded language. In this paper, we present CoSyn, a context-synergized neural network that explicitly incorporates user- and conversational context for detecting implicit hate speech in online conversations. CoSyn introduces novel ways to encode these external contexts and employs a novel context interaction mechanism that clearly captures the interplay between them, making independent assessments of the amounts of information to be retrieved from these noisy contexts. Additionally, it carries out all these operations in the hyperbolic space to account for the scale-free dynamics of social media. We demonstrate the effectiveness of CoSyn on 6 hate speech datasets and show that CoSyn outperforms all our baselines in detecting implicit hate speech with absolute improvements in the range of 1.24% - 57.8%.

Performing inference on large volumes of samples with large language models (LLMs) can be computationally and financially costly in industry and real-world use. We propose batch prompting, a simple yet effective prompting approach that enables the LLM to run inference in batches, instead of one sample at a time. Our method reduces both token and time costs while retaining downstream performance. We theoretically demonstrate that under a few-shot in-context learning setting, the inference costs decrease almost inverse linearly with the number of samples in each batch. We extensively validate the effectiveness of batch prompting on ten datasets across commonsense QA, arithmetic reasoning, and NLI/NLU: batch prompting significantly~(up to 5x with six samples in batch) reduces the LLM (Codex) inference token and time costs while achieving better or comparable performance. For state-of-the-art Chat-based LLMs, e.g., GPT-3.5 and GPT-4, we show the benefits of batch prompting also hold. Further analysis shows that the number of samples in each batch and the complexity of tasks affect its performance. Moreover, batch prompting can be applied across different reasoning methods using LLMs. Our code can be found at the site https://github.com/xlang-ai/batch-prompting.

Despite the state-of-the-art performance of deep convolutional neural networks, they are susceptible to bias and malfunction in unseen situations. Moreover, the complex computation behind their reasoning is not human-understandable to develop trust. External explainer methods have tried to interpret network decisions in a human-understandable way, but they are accused of fallacies due to their assumptions and simplifications. On the other side, the inherent self-interpretability of models, while being more robust to the mentioned fallacies, cannot be applied to the already trained models. In this work, we propose a new attentionbased pooling layer, called Local Attention Pooling (LAP), that accomplishes self-interpretability and the possibility for knowledge injection without performance loss. The module is easily pluggable into any convolutional neural network, even the already trained ones. We have defined a weakly supervised training scheme to learn the distinguishing features in decision-making without depending on experts' annotations. We verified our claims by evaluating several LAP-extended models on two datasets, including ImageNet. The proposed framework offers more valid human-understandable and faithful-to-the-model interpretations than the commonly used white-box explainer methods. Nowadays, Artificial Intelligence (AI) has entered into real-life applications like clinical computer-aided decision systems, medical diagnosis, and autonomous car driving. These critical applications are concerned about whether AI models are trustable and whether their decisions are valid [41]. Deep Neural Networks (DNNs), one of the most successful AI models, make decisions using complex computations humans do not understand. They are trained end-to-end and are susceptible to learning detours and biases of the dataset rather than the actual concepts and reasons. Since AI has become responsible for making decisions in areas interfering with human rights and ethics, governments have started to make laws about its usage. For example, the European Union has adopted new regulations that enable users to demand an explanation of an algorithmic decision that has affected them [14]. This has strengthened the urge for DNNs to explain themselves. Explaining DNNs has other virtues besides verifying decisions, bias detection, developing trust, and compliance to legislation [5]; it can help diagnose the model. Also, knowledge can be discovered from the models with superior-than-human performance to enrich human knowledge [9]. In recent years, there have been many attempts to explain and interpret DNNs' decisions.

Recently developed survival analysis methods improve upon existing approaches by predicting the probability of event occurrence in each of a number pre-specified (discrete) time intervals. By avoiding placing strong parametric assumptions on the event density, this approach tends to improve prediction performance, particularly when data are plentiful. However, in clinical settings with limited available data, it is often preferable to judiciously partition the event time space into a limited number of intervals well suited to the prediction task at hand. In this work, we develop a method to learn from data a set of cut points defining such a partition. We show that in two simulated datasets, we are able to recover intervals that match the underlying generative model. We then demonstrate improved prediction performance on three real-world observational datasets, including a large, newly harmonized stroke risk prediction dataset. Finally, we argue that our approach facilitates clinical decision-making by suggesting time intervals that are most appropriate for each task, in the sense that they facilitate more accurate risk prediction.

Anyone who has ever had to navigate the NHS as a patient or carer will no doubt know the frustration and fear often caused by this vast organisation's woeful inability to communicate within itself. Your medical records are mislaid, an appointment wasn't made -- or you weren't told about it; clinics use phone numbers and addresses you've moved on from years ago. Or clinicians don't seem to know about the outcomes of previous appointments with other care teams. But could the NHS's left hand finally soon know what its right hand is doing? Early next month, NHS England is to sign a £480 million contract to build a master data-controlling system, linking up all the computer systems used across hospitals, GP practices and admin departments so they can'talk' to each other.