Rule-Based Reasoning
Computing Rule-Based Explanations of Machine Learning Classifiers using Knowledge Graphs
Dervakos, Edmund, Menis-Mastromichalakis, Orfeas, Chortaras, Alexandros, Stamou, Giorgos
The use of symbolic knowledge representation and reasoning as a way to resolve the lack of transparency of machine learning classifiers is a research area that lately attracts many researchers. In this work, we use knowledge graphs as the underlying framework providing the terminology for representing explanations for the operation of a machine learning classifier. In particular, given a description of the application domain of the classifier in the form of a knowledge graph, we introduce a novel method for extracting and representing black-box explanations of its operation, in the form of first-order logic rules expressed in the terminology of the knowledge graph.
Combining Deep Learning and Reasoning for Address Detection in Unstructured Text Documents
Engelbach, Matthias, Klau, Dennis, Drawehn, Jens, Kintz, Maximilien
Extracting information from unstructured text documents is a demanding task, since these documents can have a broad variety of different layouts and a non-trivial reading order, like it is the case for multi-column documents or nested tables. Additionally, many business documents are received in paper form, meaning that the textual contents need to be digitized before further analysis. Nonetheless, automatic detection and capturing of crucial document information like the sender address would boost many companies' processing efficiency. In this work we propose a hybrid approach that combines deep learning with reasoning for finding and extracting addresses from unstructured text documents. We use a visual deep learning model to detect the boundaries of possible address regions on the scanned document images and validate these results by analyzing the containing text using domain knowledge represented as a rule based system.
Declarative AI 2022 - Call for Papers
RuleML RR 2022 aims to bring together rigorous researchers and inventive practitioners, interested in the foundations and applications of rules and reasoning. It provides a forum for stimulating cooperation and cross-fertilization between different communities focused on the research, development, and applications of rule-based systems. We are looking for high-quality papers related to theoretical advances, novel technologies, and artificial intelligence applications that involve rule-based representation and reasoning.
Separating Rule Discovery and Global Solution Composition in a Learning Classifier System
Heider, Michael, Stegherr, Helena, Wurth, Jonathan, Sraj, Roman, Hรคhner, Jรถrg
The utilization of digital agents to support crucial decision making is increasing in many industrial scenarios. However, trust in suggestions made by these agents is hard to achieve, though essential for profiting from their application, resulting in a need for explanations for both the decision making process as well as the model itself. For many systems, such as common deep learning black-box models, achieving at least some explainability requires complex post-processing, while other systems profit from being, to a reasonable extent, inherently interpretable. In this paper we propose an easily interpretable rule-based learning system specifically designed and thus especially suited for these scenarios and compare it on a set of regression problems against XCSF, a prominent rule-based learning system with a long research history. One key advantage of our system is that the rules' conditions and which rules compose a solution to the problem are evolved separately. We utilise independent rule fitnesses which allows users to specifically tailor their model structure to fit the given requirements for explainability. We find that the results of SupRB2's evaluation are comparable to XCSF's while allowing easier control of model structure and showing a substantially smaller sensitivity to random seeds and data splits. This increased control aids in subsequently providing explanations for both the training and the final structure of the model.
Correcting diacritics and typos with ByT5 transformer model
Stankeviฤius, Lukas, Lukoลกeviฤius, Mantas, Kapoฤiลซtฤ-Dzikienฤ, Jurgita, Briedienฤ, Monika, Krilaviฤius, Tomas
Due to the fast pace of life and online communications, the prevalence of English and the QWERTY keyboard, people tend to forgo using diacritics, make typographical errors (typos) when typing. Restoring diacritics and correcting spelling is important for proper language use and disambiguation of texts for both humans and downstream algorithms. However, both of these problems are typically addressed separately, i.e., state-of-the-art diacritics restoration methods do not tolerate other typos. In this work, we tackle both problems at once by employing newly-developed ByT5 byte-level transformer models. Our simultaneous diacritics restoration and typos correction approach demonstrates near state-of-the-art performance in 13 languages, reaching >96% of the alpha-word accuracy. We also perform diacritics restoration alone on 12 benchmark datasets with the additional one for the Lithuanian language. The experimental investigation proves that our approach is able to achieve comparable results (>98%) to previously reported despite being trained on fewer data. Our approach is also able to restore diacritics in words not seen during training with >76% accuracy. We also show the accuracies to further improve with longer training. All this shows a great real-world application potential of our suggested methods to more data, languages, and error classes.
A Safety-Critical Decision Making and Control Framework Combining Machine Learning and Rule-based Algorithms
Aksjonov, Andrei, Kyrki, Ville
While artificial-intelligence-based methods suffer from lack of transparency, rule-based methods dominate in safety-critical systems. Yet, the latter cannot compete with the first ones in robustness to multiple requirements, for instance, simultaneously addressing safety, comfort, and efficiency. Hence, to benefit from both methods they must be joined in a single system. This paper proposes a decision making and control framework, which profits from advantages of both the rule- and machine-learning-based techniques while compensating for their disadvantages. The proposed method embodies two controllers operating in parallel, called Safety and Learned. A rule-based switching logic selects one of the actions transmitted from both controllers. The Safety controller is prioritized every time, when the Learned one does not meet the safety constraint, and also directly participates in the safe Learned controller training. Decision making and control in autonomous driving is chosen as the system case study, where an autonomous vehicle learns a multi-task policy to safely cross an unprotected intersection. Multiple requirements (i.e., safety, efficiency, and comfort) are set for vehicle operation. A numerical simulation is performed for the proposed framework validation, where its ability to satisfy the requirements and robustness to changing environment is successfully demonstrated.
Underrated Apriori Algorithm Based Unsupervised Machine Learning
This article was published as a part of the Data Science Blogathon. I hope everyone is doing well. This pandemic provides us with more opportunities to learn new topics through the work-from-home concept, allowing us to devote more time to doing so. This prompted me to consider some mundane but intriguing topics. Yes, we will learn about Unsupervised Machine Learning algorithms in this article, specifically the Associated Rule-based โ Apriori algorithm.
The Immovable Role of Rules in Natural Language Generation - AnalyticsWeek
By now, the average business user has been deluged with the term Artificial Intelligence so much that he or she likely knows it frequently involves machine learning for enterprise applications of Conversational AI, intelligent search, or Natural Language Generation. With the general population still captivated by the hype around deep learning, neural networks, and predictive models, it's easy to consider rules-based systems for these applications as passรฉ, or perhaps worse, outdated approaches to the suite of natural language technologies. According to Arria NLG CTO Neil Burnett, however, nothing could be further from reality. "Using rules is a better approach than just a [pure] machine learning approach," Burnett revealed. "We still do a good amount of rules-based generation. It's a little more elaborate than you might imagine. It's kind of a rules based approach mixed in with a little bit of ML as well."
Problife: a Probabilistic Game of Life
Vandevelde, Simon, Vennekens, Joost
This paper presents a probabilistic extension of the well-known cellular automaton, Game of Life. In Game of Life, cells are placed in a grid and then watched as they evolve throughout subsequent generations, as dictated by the rules of the game. In our extension, called ProbLife, these rules now have probabilities associated with them. Instead of cells being either dead or alive, they are denoted by their chance to live. After presenting the rules of ProbLife and its underlying characteristics, we show a concrete implementation in ProbLog, a probabilistic logic programming system. We use this to generate different images, as a form of rule-based generative art.
Out-of-control Congress and Fed need binding rules
Fox Business Flash top headlines are here. Check out what's clicking on FoxBusiness.com. "May you live in interesting times," goes the old Chinese curse. When it comes to economics, "interesting" usually means the sky is falling. Inflation reached seven percent at the end of 2021, a rate not seen in forty years.