Rule-Based Reasoning
A Reactive Autonomous Camera System for the RAVEN II Surgical Robot
Hutchinson, Kay, Yasar, Mohammad Samin, Bhatia, Harshneet, Alemzadeh, Homa
The endoscopic camera of a surgical robot provides surgeons with a magnified 3D view of the surgical field, but repositioning it increases mental workload and operation time. Poor camera placement contributes to safety-critical events when surgical tools move out of the view of the camera. This paper presents a proof of concept of an autonomous camera system for the Raven II surgical robot that aims to reduce surgeon workload and improve safety by providing an optimal view of the workspace showing all objects of interest. This system uses transfer learning to localize and classify objects of interest within the view of a stereoscopic camera. The positions and centroid of the objects are estimated and a set of control rules determines the movement of the camera towards a more desired view. Our perception module had an accuracy of 61.21% overall for identifying objects of interest and was able to localize both graspers and multiple blocks in the environment. Comparison of the commands proposed by our system with the desired commands from a survey of 13 participants indicates that the autonomous camera system proposes appropriate movements for the tilt and pan of the camera.
Association rules over time
Fister, Iztok Jr., Fister, Iztok
Decisions made nowadays by Artificial Intelligence powered systems are usually hard for users to understand. One of the more important issues faced by developers is exposed as how to create more explainable Machine Learning models. In line with this, more explainable techniques need to be developed, where visual explanation also plays a more important role. This technique could also be applied successfully for explaining the results of Association Rule Mining.This Chapter focuses on two issues: (1) How to discover the relevant association rules, and (2) How to express relations between more attributes visually. For the solution of the first issue, the proposed method uses Differential Evolution, while Sankey diagrams are adopted to solve the second one. This method was applied to a transaction database containing data generated by an amateur cyclist in past seasons, using a mobile device worn during the realization of training sessions that is divided into four time periods. The results of visualization showed that a trend in improving performance of an athlete can be indicated by changing the attributes appearing in the selected association rules in different time periods.
RNNLogic: Learning Logic Rules for Reasoning on Knowledge Graphs
Qu, Meng, Chen, Junkun, Xhonneux, Louis-Pascal, Bengio, Yoshua, Tang, Jian
This paper studies learning logic rules for reasoning on knowledge graphs. Logic rules provide interpretable explanations when used for prediction as well as being able to generalize to other tasks, and hence are critical to learn. Existing methods either suffer from the problem of searching in a large search space (e.g., neural logic programming) or ineffective optimization due to sparse rewards (e.g., techniques based on reinforcement learning). To address these limitations, this paper proposes a probabilistic model called RNNLogic. RNNLogic treats logic rules as a latent variable, and simultaneously trains a rule generator as well as a reasoning predictor with logic rules. We develop an EM-based algorithm for optimization. In each iteration, the reasoning predictor is first updated to explore some generated logic rules for reasoning. Then in the E-step, we select a set of high-quality rules from all generated rules with both the rule generator and reasoning predictor via posterior inference; and in the M-step, the rule generator is updated with the rules selected in the E-step. Experiments on four datasets prove the effectiveness of RNNLogic.
Model-Based Diagnosis under Real-World Constraints
I report on my experience over the past few years in introducing automated, model-based diagnostic technologies into industrial settings. In partic-ular, I discuss the competition that this technology has been receiving from handcrafted, rule-based diagnostic systems that has set some high standards that must be met by model-based systems before they can be viewed as viable alternatives. The battle between model-based and rule-based approaches to diagnosis has been over in the academic literature for many years, but the situation is different in industry where rule-based systems are dominant and appear to be attractive given the considerations of efficiency, embeddability, and cost effectiveness. My goal in this article is to provide a perspective on this competition and discuss a diagnostic tool, called DTOOL/CNETS, that I have been developing over the years as I tried to address the major challenges posed by rule-based systems. In particular, I discuss three major features of the developed tool that were either adopted, designed, or innovated to address these challenges: (1) its compositional modeling approach, (2) its structure-based computational approach, and (3) its ability to synthesize embeddable diagnostic systems for a variety of software and hardware platforms.
Custom DU: A Web-Based Business User-Driven Automated Underwriting System
Custom DU is an automated underwriting system that enables mortgage lenders to build their own business rules that facilitate assessing borrower eligibility for different mortgage products. Developed by Fannie Mae, Custom DU has been used since 2004 by several lenders to automate the underwriting of numerous mortgage products. Custom DU uses rule specification language techniques and a web-based, user-friendly interface for implementing business rules that represent business policy. By means of the user interface, lenders can also customize their underwriting findings reports, test the rules that they have defined, and publish changes to business rules on a real-time basis, all without any software modifications. The user interface enforces structure and consistency, enabling business users to focus on their underwriting guidelines when converting their business policy to rules.
PRover: Proof Generation for Interpretable Reasoning over Rules
Saha, Swarnadeep, Ghosh, Sayan, Srivastava, Shashank, Bansal, Mohit
Recent work by Clark et al. (2020) shows that transformers can act as 'soft theorem provers' by answering questions over explicitly provided knowledge in natural language. In our work, we take a step closer to emulating formal theorem provers, by proposing PROVER, an interpretable transformer-based model that jointly answers binary questions over rule-bases and generates the corresponding proofs. Our model learns to predict nodes and edges corresponding to proof graphs in an efficient constrained training paradigm. During inference, a valid proof, satisfying a set of global constraints is generated. We conduct experiments on synthetic, hand-authored, and human-paraphrased rule-bases to show promising results for QA and proof generation, with strong generalization performance. First, PROVER generates proofs with an accuracy of 87%, while retaining or improving performance on the QA task, compared to RuleTakers (up to 6% improvement on zero-shot evaluation). Second, when trained on questions requiring lower depths of reasoning, it generalizes significantly better to higher depths (up to 15% improvement). Third, PROVER obtains near perfect QA accuracy of 98% using only 40% of the training data. However, generating proofs for questions requiring higher depths of reasoning becomes challenging, and the accuracy drops to 65% for 'depth 5', indicating significant scope for future work. Our code and models are publicly available at https://github.com/swarnaHub/PRover
MCMH: Learning Multi-Chain Multi-Hop Rules for Knowledge Graph Reasoning
Zhang, Lu, Yu, Mo, Gao, Tian, Yu, Yue
Multi-hop reasoning approaches over knowledge graphs infer a missing relationship between entities with a multi-hop rule, which corresponds to a chain of relationships. We extend existing works to consider a generalized form of multi-hop rules, where each rule is a set of relation chains. To learn such generalized rules efficiently, we propose a two-step approach that first selects a small set of relation chains as a rule and then evaluates the confidence of the target relationship by jointly scoring the selected chains. A game-theoretical framework is proposed to this end to simultaneously optimize the rule selection and prediction steps. Empirical results show that our multi-chain multi-hop (MCMH) rules result in superior results compared to the standard single-chain approaches, justifying both our formulation of generalized rules and the effectiveness of the proposed learning framework.
Hey BERT, do you recognize any requirements? โ Qualicen
Does scanning for your relevant requirements in massive documents sound familiar? Requirement documents contain a lot of information. Not all of this information is relevant to every stakeholder. System and Test Engineers for instance only really care for the requirements that are somewhere in that pile of information. Hence for those engineers it would be great if a document containing just the requirements would exist. If we want to create, preferably automatically, such a document we first of all need to know which parts of the text are requirements and which aren't.
Top 5 data mining technique in Machine Learning (ML)
Data mining is a popular term used by machine learning developers. The technique refers to extracting meaningful information from the massive dataset. For the aspiring data scientists, it is important to be familiar with data mining techniques. Here are the top data mining techniques that are used by Data Science and Machine Learning experts. Association rule learning is a standard rule-based ML technique used to discover the relationship between variables in datasets.
Hybrid AI through data, space, time, and industrial applications: Beyond Limits scores $113M Series C to scale up
For a hitherto relative unknown, scoring a $113 million Series C at this time is bound to get some attention. The amount of attention is bound to grow upon learning that the company is backed by, and works with, the likes of Bp, its AI technology is based on IP from NASA and Caltech, and it looks like the closest thing to the vision for AI in the real world today. Beyond Limits, an industrial and enterprise-grade AI technology company active in energy, utilities, and healthcare, today announced a milestone Series C funding round with $113 million closed and another approximately $20 million committed. This round is led by Group 42, a prominent AI and cloud computing company, and Bp ventures, an existing two-time investor and customer of the company. ZDNet caught up with Beyond Limits CEO and Founder AJ Abdallat to discuss business, technology, and applications.