Rule-Based Reasoning
MAIRE -- A Model-Agnostic Interpretable Rule Extraction Procedure for Explaining Classifiers
Sharma, Rajat, Reddy, Nikhil, Kamakshi, Vidhya, Krishnan, Narayanan C, Jain, Shweta
The paper introduces a novel framework for extracting model-agnostic human interpretable rules to explain a classifier's output. The human interpretable rule is defined as an axis-aligned hyper-cuboid containing the instance for which the classification decision has to be explained. The proposed procedure finds the largest (high \textit{coverage}) axis-aligned hyper-cuboid such that a high percentage of the instances in the hyper-cuboid have the same class label as the instance being explained (high \textit{precision}). Novel approximations to the coverage and precision measures in terms of the parameters of the hyper-cuboid are defined. They are maximized using gradient-based optimizers. The quality of the approximations is rigorously analyzed theoretically and experimentally. Heuristics for simplifying the generated explanations for achieving better interpretability and a greedy selection algorithm that combines the local explanations for creating global explanations for the model covering a large part of the instance space are also proposed. The framework is model agnostic, can be applied to any arbitrary classifier, and all types of attributes (including continuous, ordered, and unordered discrete). The wide-scale applicability of the framework is validated on a variety of synthetic and real-world datasets from different domains (tabular, text, and image).
Machine Learning is Conquering Explicit Programming
Before we proceed further to this post let us first understand what is a binary classification. So let's understand this by a very simple instance. You are at home and it's lunchtime, your mom comes to you and asks if you are hungry and want to have your lunch, your answer will be either "yes" or "no". You only have two options to reply i.e. binary options. Let's take another example of a student who has just received his result of grade 12 the result will be "passed" or "failed".
Beware the 80% Trap: Avoid the "Big Bucket o' Rules" Approach to BRMS - Decision Management Solutions
One of the classic tools for decision automation is a business rules management system, or BRMS. While these systems are powerful and effective when used correctly, many companies fail to apply best practices when using them. Here's one of our favorite horror stories about a well-intentioned BRMS implementation gone awry. Some years ago, we got a call from a company asking for our help with their business rules project. They said that they had hit a milestone in their rules analysis--it was 80% complete, or so they thought.
Beyond Individualized Recourse: Interpretable and Interactive Summaries of Actionable Recourses
Rawal, Kaivalya, Lakkaraju, Himabindu
As predictive models are increasingly being deployed in high-stakes decision-making, there has been a lot of interest in developing algorithms which can provide recourses to affected individuals. While developing such tools is important, it is even more critical to analyse and interpret a predictive model, and vet it thoroughly to ensure that the recourses it offers are meaningful and non-discriminatory before it is deployed in the real world. To this end, we propose a novel model agnostic framework called Actionable Recourse Summaries (AReS) to construct global counterfactual explanations which provide an interpretable and accurate summary of recourses for the entire population. We formulate a novel objective which simultaneously optimizes for correctness of the recourses and interpretability of the explanations, while minimizing overall recourse costs across the entire population. More specifically, our objective enables us to learn, with optimality guarantees on recourse correctness, a small number of compact rule sets each of which capture recourses for well defined subpopulations within the data. We also demonstrate theoretically that several of the prior approaches proposed to generate recourses for individuals are special cases of our framework. Experimental evaluation with real world datasets and user studies demonstrate that our framework can provide decision makers with a comprehensive overview of recourses corresponding to any black box model, and consequently help detect undesirable model biases and discrimination.
A Benchmark Corpus and Neural Approach for Sanskrit Derivative Nouns Analysis
Singh, Arun Kumar, Dave, Sushant, P., Prathosh A., Lall, Brejesh, Mehta, Shresth
This paper presents first benchmark corpus of Sanskrit Pratyaya (suffix) and inflectional words (padas) formed due to suffixes along with neural network based approaches to process the formation and splitting of inflectional words. Inflectional words spans the primary and secondary derivative nouns as the scope of current work. Pratyayas are an important dimension of morphological analysis of Sanskrit texts. There have been Sanskrit Computational Linguistics tools for processing and analyzing Sanskrit texts. Unfortunately there has not been any work to standardize & validate these tools specifically for derivative nouns analysis. In this work, we prepared a Sanskrit suffix benchmark corpus called Pratyaya-Kosh to evaluate the performance of tools. We also present our own neural approach for derivative nouns analysis while evaluating the same on most prominent Sanskrit Morphological Analysis tools. This benchmark will be freely dedicated and available to researchers worldwide and we hope it will motivate all to improve morphological analysis in Sanskrit Language.
Applications of AI in CAD Technology
A new feature to be found in modern CAD software releases is KBE (Knowledge Based Engineering) to support diagnosis, selection, and monitoring of tasks. KBE relies on capturing and storing experiential knowledge which includes proprietary design and manufacturing practices exercised during a product development cycle. KBE helps engineering companies to retain and preserve in-house knowledge and intellectual information. A related technology which could significantly augment problem solving capabilities in CAD software is AI (Artificial Intelligence), which was introduced in the mid-1980s. The purpose of AI is to learn and replicate human problem solving capabilities.
Understanding Semantic web technologies
In Alex Garland's 2014 sci-fi thriller, when Caleb the plot's anti-hero first meets Ava, an AI-driven humanoid, the first thing he does to test her intelligence is to engage her in a conversation. "So we need to break the ice. Do you know what I mean by that?", he asks. He tests her further, "what do I mean?". "Overcome initial social awkwardness", she quips.
Measuring Systematic Generalization in Neural Proof Generation with Transformers
Gontier, Nicolas, Sinha, Koustuv, Reddy, Siva, Pal, Christopher
We are interested in understanding how well Transformer language models (TLMs) can perform reasoning tasks when trained on knowledge encoded in the form of natural language. We investigate their systematic generalization abilities on a logical reasoning task in natural language, which involves reasoning over relationships between entities grounded in first-order logical proofs. Specifically, we perform soft theorem-proving by leveraging TLMs to generate natural language proofs. We test the generated proofs for logical consistency, along with the accuracy of the final inference. We observe length-generalization issues when evaluated on longer-than-trained sequences. However, we observe TLMs improve their generalization performance after being exposed to longer, exhaustive proofs. In addition, we discover that TLMs are able to generalize better using backward-chaining proofs compared to their forward-chaining counterparts, while they find it easier to generate forward chaining proofs. We observe that models that are not trained to generate proofs are better at generalizing to problems based on longer proofs. This suggests that Transformers have efficient internal reasoning strategies that are harder to interpret. These results highlight the systematic generalization behavior of TLMs in the context of logical reasoning, and we believe this work motivates deeper inspection of their underlying reasoning strategies.
Optimal Decision Lists using SAT
Yu, Jinqiang, Ignatiev, Alexey, Bodic, Pierre Le, Stuckey, Peter J.
Decision lists are one of the most easily explainable machine learning models. Given the renewed emphasis on explainable machine learning decisions, this machine learning model is increasingly attractive, combining small size and clear explainability. In this paper, we show for the first time how to construct optimal "perfect" decision lists which are perfectly accurate on the training data, and minimal in size, making use of modern SAT solving technology. We also give a new method for determining optimal sparse decision lists, which trade off size and accuracy. We contrast the size and test accuracy of optimal decisions lists versus optimal decision sets, as well as other state-of-the-art methods for determining optimal decision lists. We also examine the size of average explanations generated by decision sets and decision lists.