Rule-Based Reasoning
ChartReader: A Unified Framework for Chart Derendering and Comprehension without Heuristic Rules
Cheng, Zhi-Qi, Dai, Qi, Li, Siyao, Sun, Jingdong, Mitamura, Teruko, Hauptmann, Alexander G.
Charts are a powerful tool for visually conveying complex data, but their comprehension poses a challenge due to the diverse chart types and intricate components. Existing chart comprehension methods suffer from either heuristic rules or an over-reliance on OCR systems, resulting in suboptimal performance. To address these issues, we present ChartReader, a unified framework that seamlessly integrates chart derendering and comprehension tasks. Our approach includes a transformer-based chart component detection module and an extended pre-trained vision-language model for chart-to-X tasks. By learning the rules of charts automatically from annotated datasets, our approach eliminates the need for manual rule-making, reducing effort and enhancing accuracy.~We also introduce a data variable replacement technique and extend the input and position embeddings of the pre-trained model for cross-task training. We evaluate ChartReader on Chart-to-Table, ChartQA, and Chart-to-Text tasks, demonstrating its superiority over existing methods. Our proposed framework can significantly reduce the manual effort involved in chart analysis, providing a step towards a universal chart understanding model. Moreover, our approach offers opportunities for plug-and-play integration with mainstream LLMs such as T5 and TaPas, extending their capability to chart comprehension tasks. The code is available at https://github.com/zhiqic/ChartReader.
Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusion
Rempe, Davis, Luo, Zhengyi, Peng, Xue Bin, Yuan, Ye, Kitani, Kris, Kreis, Karsten, Fidler, Sanja, Litany, Or
We introduce a method for generating realistic pedestrian trajectories and full-body animations that can be controlled to meet user-defined goals. We draw on recent advances in guided diffusion modeling to achieve test-time controllability of trajectories, which is normally only associated with rule-based systems. Our guided diffusion model allows users to constrain trajectories through target waypoints, speed, and specified social groups while accounting for the surrounding environment context. This trajectory diffusion model is integrated with a novel physics-based humanoid controller to form a closed-loop, full-body pedestrian animation system capable of placing large crowds in a simulated environment with varying terrains. We further propose utilizing the value function learned during RL training of the animation controller to guide diffusion to produce trajectories better suited for particular scenarios such as collision avoidance and traversing uneven terrain. Video results are available on the project page at https://nv-tlabs.github.io/trace-pace .
Ukraine decries 'symbolic blow' as Russia assumes UN presidency
Ukraine has branded Russia's presidency of the UN Security Council for the month of April "a symbolic blow," joining a chorus of outrage from Western countries. Moscow assumes the presidency as part of its monthly rotation between the Security Council's 15 member states, with ties with the West at their lowest point since the Cold War over Russia's invasion of Ukraine. Andriy Yermak, the Ukrainian president's chief of staff, said Russia's tenure was a "symbolic blow." It is another symbolic blow to the rules-based system of international relations," he wrote on Twitter. Ukraine's Foreign Minister Dmytro Kuleba said Russia assuming the presidency was "a slap in the face to the international community". "I urge the current UNSC members to thwart any Russian attempts to abuse its presidency," he wrote on Twitter on Saturday, calling Russia "an outlaw on the UNSC". Moscow last chaired the council in February 2022, the same month it invaded Ukraine โ prompting Kyiv to call for Russia's removal from the council. Russia will hold little influence on decisions but will be in charge of the agenda. Moscow has said Foreign Minister Sergey Lavrov is planning to chair a UN Security Council meeting this month on "effective multilateralism". Russian foreign ministry spokeswoman Maria Zakharova also said that Lavrov would lead a debate on the Middle East on April 25. The Kremlin said on Friday it planned to "exercise all its rights" in the role. The White House urged Russia to "conduct itself professionally" when it assumes the role, saying there was no means to block Moscow from the post. "A country that flagrantly violates the UN Charter and invades its neighbour has no place on the UN Security Council," White House spokesperson Karine Jean-Pierre said on Friday. "Unfortunately, Russia is a permanent member of the Security Council and no feasible international legal pathway exists to change that reality," she added, calling the presidency "a largely ceremonial position". The Baltic states also expressed their concern. Estonia's UN envoy Rein Tammsaar, speaking also on behalf of Latvia and Lithuania, warned the Security Council Friday as it met to discuss Russia's plans to deploy tactical nuclear weapons in neighbouring Belarus. "Isn't it telling that tomorrow, on the anniversary of the Bucha killings, Russia will assume the Presidency of the UN Security Council?
Dataset and Baseline System for Multi-lingual Extraction and Normalization of Temporal and Numerical Expressions
Chen, Sanxing, Chen, Yongqiang, Karlsson, Bรถrje F.
Temporal and numerical expression understanding is of great importance in many downstream Natural Language Processing (NLP) and Information Retrieval (IR) tasks. However, much previous work covers only a few sub-types and focuses only on entity extraction, which severely limits the usability of identified mentions. In order for such entities to be useful in downstream scenarios, coverage and granularity of sub-types are important; and, even more so, providing resolution into concrete values that can be manipulated. Furthermore, most previous work addresses only a handful of languages. Here we describe a multi-lingual evaluation dataset - NTX - covering diverse temporal and numerical expressions across 14 languages and covering extraction, normalization, and resolution. Along with the dataset we provide a robust rule-based system as a strong baseline for comparisons against other models to be evaluated in this dataset. Data and code are available at \url{https://aka.ms/NTX}.
Text revision in Scientific Writing Assistance: An Overview
Jourdan, Lรฉane, Boudin, Florian, Dufour, Richard, Hernandez, Nicolas
Writing a scientific article is a challenging task as it is a highly codified genre. Good writing skills are essential to properly convey ideas and results of research work. Since the majority of scientific articles are currently written in English, this exercise is all the more difficult for non-native English speakers as they additionally have to face language issues. This article aims to provide an overview of text revision in writing assistance in the scientific domain. We will examine the specificities of scientific writing, including the format and conventions commonly used in research articles. Additionally, this overview will explore the various types of writing assistance tools available for text revision. Despite the evolution of the technology behind these tools through the years, from rule-based approaches to deep neural-based ones, challenges still exist (tools' accessibility, limited consideration of the context, inexplicit use of discursive information, etc.)
An active inference model of car following: Advantages and applications
Wei, Ran, McDonald, Anthony D., Garcia, Alfredo, Markkula, Gustav, Engstrom, Johan, O'Kelly, Matthew
Driver process models play a central role in the testing, verification, and development of automated and autonomous vehicle technologies. Prior models developed from control theory and physics-based rules are limited in automated vehicle applications due to their restricted behavioral repertoire. Data-driven machine learning models are more capable than rule-based models but are limited by the need for large training datasets and their lack of interpretability, i.e., an understandable link between input data and output behaviors. We propose a novel car following modeling approach using active inference, which has comparable behavioral flexibility to data-driven models while maintaining interpretability. We assessed the proposed model, the Active Inference Driving Agent (AIDA), through a benchmark analysis against the rule-based Intelligent Driver Model, and two neural network Behavior Cloning models. The models were trained and tested on a real-world driving dataset using a consistent process. The testing results showed that the AIDA predicted driving controls significantly better than the rule-based Intelligent Driver Model and had similar accuracy to the data-driven neural network models in three out of four evaluations. Subsequent interpretability analyses illustrated that the AIDA's learned distributions were consistent with driver behavior theory and that visualizations of the distributions could be used to directly comprehend the model's decision making process and correct model errors attributable to limited training data. The results indicate that the AIDA is a promising alternative to black-box data-driven models and suggest a need for further research focused on modeling driving style and model training with more diverse datasets.
Evolution of artificial intelligence(AI)
Since its inception in the 1950s, artificial intelligence (AI) has made significant advancements. Because of improvements in processing power, machine learning methods, and the accessibility of massive data, the discipline has developed quickly. This essay will examine the development of AI and how it has altered our environment. Rule-based systems, where computers were programmed to make judgments based on a set of established rules, were the main focus of AI research in its early years. The only problems these systems could resolve were those that were specifically put into them, limiting their possibilities.
HRDoc: Dataset and Baseline Method Toward Hierarchical Reconstruction of Document Structures
Ma, Jiefeng, Du, Jun, Hu, Pengfei, Zhang, Zhenrong, Zhang, Jianshu, Zhu, Huihui, Liu, Cong
The problem of document structure reconstruction refers to converting digital or scanned documents into corresponding semantic structures. Most existing works mainly focus on splitting the boundary of each element in a single document page, neglecting the reconstruction of semantic structure in multi-page documents. This paper introduces hierarchical reconstruction of document structures as a novel task suitable for NLP and CV fields. To better evaluate the system performance on the new task, we built a large-scale dataset named HRDoc, which consists of 2,500 multi-page documents with nearly 2 million semantic units. Every document in HRDoc (a) Multi-page documents (b) Line-level classification has line-level annotations including categories and relations obtained from rule-based extractors and human annotators. Moreover, we proposed an encoder-decoder-based hierarchical document structure parsing system (DSPS) to tackle this problem. By adopting a multi-modal bidirectional encoder and a structure-aware GRU decoder with soft-mask operation, the DSPS model surpass the baseline method by a large margin.
Enhancing Embedding Representations of Biomedical Data using Logic Knowledge
Diligenti, Michelangelo, Giannini, Francesco, Fioravanti, Stefano, Graziani, Caterina, Falaschi, Moreno, Marra, Giuseppe
Knowledge Graph Embeddings (KGE) have become a quite popular class of models specifically devised to deal with ontologies and graph structure data, as they can implicitly encode statistical dependencies between entities and relations in a latent space. KGE techniques are particularly effective for the biomedical domain, where it is quite common to deal with large knowledge graphs underlying complex interactions between biological and chemical objects. Recently in the literature, the PharmKG dataset has been proposed as one of the most challenging knowledge graph biomedical benchmark, with hundreds of thousands of relational facts between genes, diseases and chemicals. Despite KGEs can scale to very large relational domains, they generally fail at representing more complex relational dependencies between facts, like logic rules, which may be fundamental in complex experimental settings. In this paper, we exploit logic rules to enhance the embedding representations of KGEs on the PharmKG dataset. To this end, we adopt Relational Reasoning Network (R2N), a recently proposed neural-symbolic approach showing promising results on knowledge graph completion tasks. An R2N uses the available logic rules to build a neural architecture that reasons over KGE latent representations. In the experiments, we show that our approach is able to significantly improve the current state-of-the-art on the PharmKG dataset. Finally, we provide an ablation study to experimentally compare the effect of alternative sets of rules according to different selection criteria and varying the number of considered rules.
Extended High Utility Pattern Mining: An Answer Set Programming Based Framework and Applications
Cauteruccio, Francesco, Terracina, Giorgio
Detecting sets of relevant patterns from a given dataset is an important challenge in data mining. The relevance of a pattern, also called utility in the literature, is a subjective measure and can be actually assessed from very different points of view. Rule-based languages like Answer Set Programming (ASP) seem well suited for specifying user-provided criteria to assess pattern utility in a form of constraints; moreover, declarativity of ASP allows for a very easy switch between several criteria in order to analyze the dataset from different points of view. In this paper, we make steps toward extending the notion of High Utility Pattern Mining (HUPM); in particular we introduce a new framework that allows for new classes of utility criteria not considered in the previous literature. We also show how recent extensions of ASP with external functions can support a fast and effective encoding and testing of the new framework. To demonstrate the potential of the proposed framework, we exploit it as a building block for the definition of an innovative method for predicting ICU admission for COVID-19 patients. Finally, an extensive experimental activity demonstrates both from a quantitative and a qualitative point of view the effectiveness of the proposed approach.