Goto

Collaborating Authors

 Instructional Material


Health Text Simplification: An Annotated Corpus for Digestive Cancer Education and Novel Strategies for Reinforcement Learning

arXiv.org Artificial Intelligence

Objective: The reading level of health educational materials significantly influences information understandability and accessibility, particularly for minoritized populations. Many patient educational resources surpass the reading level and complexity of widely accepted standards. There is a critical need for high-performing text simplification models in health information to enhance dissemination and literacy. This need is particularly acute in cancer education, where effective prevention and screening education can substantially reduce morbidity and mortality. Methods: We introduce Simplified Digestive Cancer (SimpleDC), a parallel corpus of cancer education materials tailored for health text simplification research. Utilizing SimpleDC alongside the existing Med-EASi corpus, we explore Large Language Model (LLM)-based simplification methods, including fine-tuning, reinforcement learning (RL), reinforcement learning with human feedback (RLHF), domain adaptation, and prompt-based approaches. Our experimentation encompasses Llama 2 and GPT-4. A novel RLHF reward function is introduced, featuring a lightweight model adept at distinguishing between original and simplified texts, thereby enhancing the model's effectiveness with unlabeled data. Results: Fine-tuned Llama 2 models demonstrated high performance across various metrics. Our innovative RLHF reward function surpassed existing RL text simplification reward functions in effectiveness. The results underscore that RL/RLHF can augment fine-tuning, facilitating model training on unlabeled text and improving performance. Additionally, these methods effectively adapt out-of-domain text simplification models to targeted domains.


1st AI4GOV Training Workshop: Bias In AI

VideoLectures.NET

The 1st AI4GOV training workshop titled Bias in AI (focused on fundamentals) is the first organized training workshop with others to follow within the scope of the Horizon Europe project AI4GOV- Trusted AI for Transparent Public Governance fostering Democratic Values. High scores have been a primary focus of competitive players, with numerous tournaments and competitions held worldwide.


1st European Summer School on Artificial Intelligence (ESSAI) & 20th Advanced Course on Artificial Intelligence (ACAI)

VideoLectures.NET

We are very excited to announce that 1st European Summer School on Artificial Intelligence (ESSAI) & 20th Advanced Course on Artificial Intelligence (ACAI) videos are now online you are cordially invited to check them out! The rules of video chat conversation with unknown girls are quite different from the rules of meeting with known people. So we have put together a list of some important video chat rules for random video chat and communication. Ikaria Slim Reviews:- Beyond immediate weight loss, Atlantis Nutrition Keto set the stage for enduring triumph by cultivating lasting lifestyle enhancements. These gummies pave the way for sustainable accomplishments, inspiring constructive shifts in daily routines.


Design Principles for Generative AI Applications

arXiv.org Artificial Intelligence

Generative AI applications present unique design challenges. As generative AI technologies are increasingly being incorporated into mainstream applications, there is an urgent need for guidance on how to design user experiences that foster effective and safe use. We present six principles for the design of generative AI applications that address unique characteristics of generative AI UX and offer new interpretations and extensions of known issues in the design of AI applications. Each principle is coupled with a set of design strategies for implementing that principle via UX capabilities or through the design process. The principles and strategies were developed through an iterative process involving literature review, feedback from design practitioners, validation against real-world generative AI applications, and incorporation into the design process of two generative AI applications. We anticipate the principles to usefully inform the design of generative AI applications by driving actionable design recommendations.


Trust model of privacy-concerned, emotionally-aware agents in a cooperative logistics problem

arXiv.org Artificial Intelligence

In this paper we propose a trust model to be used into a hypothetical mixed environment where humans and unmanned vehicles cooperate. We address the inclusion of emotions inside a trust model in a coherent way to the practical approaches to the current psychology theories. The most innovative contribution is how privacy issues play a role in the cooperation decisions of the emotional trust model. Both, emotions and trust have been cognitively modeled and managed with the Beliefs, Desires and Intentions (BDI) paradigm into autonomous agents implemented in GAML (the programming language of GAMA agent platform) that communicates using the IEEE FIPA standard. The trusting behaviour of these emotional agents is tested in a cooperative logistics problem where: agents have to move objects to destinations and some of the objects and places have privacy issues. The execution of simulations of this logistic problem shows how emotions and trust contribute to improve the performance of agents in terms of both, time savings and privacy protection


Advancing Abductive Reasoning in Knowledge Graphs through Complex Logical Hypothesis Generation

arXiv.org Artificial Intelligence

Abductive reasoning is the process of making educated guesses to provide explanations for observations. Although many applications require the use of knowledge for explanations, the utilization of abductive reasoning in conjunction with structured knowledge, such as a knowledge graph, remains largely unexplored. To fill this gap, this paper introduces the task of complex logical hypothesis generation, as an initial step towards abductive logical reasoning with KG. In this task, we aim to generate a complex logical hypothesis so that it can explain a set of observations. We find that the supervised trained generative model can generate logical hypotheses that are structurally closer to the reference hypothesis. However, when generalized to unseen observations, this training objective does not guarantee better hypothesis generation. To address this, we introduce the Reinforcement Learning from Knowledge Graph (RLF-KG) method, which minimizes differences between observations and conclusions drawn from generated hypotheses according to the KG. Experiments show that, with RLF-KG's assistance, the generated hypotheses provide better explanations, and achieve state-of-the-art results on three widely used KGs.


A Survey of Reasoning with Foundation Models

arXiv.org Artificial Intelligence

Reasoning, a crucial ability for complex problem-solving, plays a pivotal role in various real-world settings such as negotiation, medical diagnosis, and criminal investigation. It serves as a fundamental methodology in the field of Artificial General Intelligence (AGI). With the ongoing development of foundation models, e.g., Large Language Models (LLMs), there is a growing interest in exploring their abilities in reasoning tasks. In this paper, we introduce seminal foundation models proposed or adaptable for reasoning, highlighting the latest advancements in various reasoning tasks, methods, and benchmarks. We then delve into the potential future directions behind the emergence of reasoning abilities within foundation models. We also discuss the relevance of multimodal learning, autonomous agents, and super alignment in the context of reasoning. By discussing these future research directions, we hope to inspire researchers in their exploration of this field, stimulate further advancements in reasoning with foundation models, and contribute to the development of AGI.


CultureBERT: Measuring Corporate Culture With Transformer-Based Language Models

arXiv.org Artificial Intelligence

This paper introduces transformer-based language models to the literature measuring corporate culture from text documents. We compile a unique data set of employee reviews that were labeled by human evaluators with respect to the information the reviews reveal about the firms' corporate culture. Using this data set, we fine-tune state-of-the-art transformer-based language models to perform the same classification task. In out-of-sample predictions, our language models classify 17 to 30 percentage points more of employee reviews in line with human evaluators than traditional approaches of text classification. We make our models publicly available.


A Lagrange-Newton Approach to Smoothing-and-Mapping

arXiv.org Artificial Intelligence

Smoothing-and-mapping (SAM) is a fairly modern approach to building graph-based maps of the environment; a tutorial is given by Grisetti et al. (2010) (see also the tutorial on Newton-type methods with applications in graph-based SLAM by Toussaint (2017)). Following the tutorial by Grisetti et al. (2010), the SAM problem (1) is solved in a Gauss-Newton framework and (2) involves transformations between manifolds for the rotational components. In the Gauss-Newton framework, error vectors (between true and expected measurements) are approximated to first order by a Taylor expansion, thus the resulting scalar error terms are second-order equations. A Newton descent is then performed based on the approximated Hessian (computed from the Jacobian) in these equations. However, while the Gauss-Newton framework allows for straightforward derivations, it suffers from a drawback with respect to rotational cost functions: In the quadratic approximation of the scalar error functions, the cyclic character of angular terms is lost. Therefore, to handle rotational components (e.g.


The Definitive Guide to Policy Gradients in Deep Reinforcement Learning: Theory, Algorithms and Implementations

arXiv.org Artificial Intelligence

In recent years, various powerful policy gradient algorithms have been proposed in deep reinforcement learning. While all these algorithms build on the Policy Gradient Theorem, the specific design choices differ significantly across algorithms. We provide a holistic overview of on-policy policy gradient algorithms to facilitate the understanding of both their theoretical foundations and their practical implementations. In this overview, we include a detailed proof of the continuous version of the Policy Gradient Theorem, convergence results and a comprehensive discussion of practical algorithms. We compare the most prominent algorithms on continuous control environments and provide insights on the benefits of regularization. All code is available at https://github.com/Matt00n/PolicyGradientsJax.