Rule-Based Reasoning
Hybrid Decision Making: When Interpretable Models Collaborate With Black-Box Models
Interpretable machine learning models have received increasing interest in recent years, especially in domains where humans are involved in the decision-making process. However, the possible loss of the task performance for gaining interpretability is often inevitable. This performance downgrade puts practitioners in a dilemma of choosing between a top-performing black-box model with no explanations and an interpretable model with unsatisfying task performance. In this work, we propose a novel framework for building a Hybrid Decision Model that integrates an interpretable model with any black-box model to introduce explanations in the decision making process while preserving or possibly improving the predictive accuracy. We propose a novel metric, explainability, to measure the percentage of data that are sent to the interpretable model for decision. We also design a principled objective function that considers predictive accuracy, model interpretability, and data explainability. Under this framework, we develop Collaborative Black-box and RUle Set Hybrid (CoBRUSH) model that combines logic rules and any black-box model into a joint decision model. An input instance is first sent to the rules for decision. If a rule is satisfied, a decision will be directly generated. Otherwise, the black-box model is activated to decide on the instance. To train a hybrid model, we design an efficient search algorithm that exploits theoretically grounded strategies to reduce computation. Experiments show that CoBRUSH models are able to achieve same or better accuracy than their black-box collaborator working alone while gaining explainability. They also have smaller model complexity than interpretable baselines.
Stream Reasoning in Temporal Datalog
Ronca, Alessandro (University of Oxford) | Kaminski, Mark (University of Oxford) | Grau, Bernardo Cuenca (University of Oxford) | Motik, Boris (University of Oxford) | Horrocks, Ian (University of Oxford)
Consider a number of wind turbines scattered throughout the North Sea. Each turbine is equipped with a Query processing over data streams is a key aspect of Big sensor, which continuously records temperature levels of key Data applications. For instance, algorithmic trading relies on devices within the turbine and sends those readings to a data real-time analysis of stock tickers and financial news items centre monitoring the functioning of the turbines. Temperature (Nuti et al. 2011); oil and gas companies continuously monitor levels are streamed by sensors using a ternary predicate and analyse data coming from their wellsites in order Temp, whose arguments identify the device, the temperature to detect equipment malfunction and predict maintenance level, and the time of the reading. A monitoring task in the needs (Cosad et al. 2009); network providers perform realtime data centre is to track the activation of cooling measures in analysis of network flow data to identify traffic anomalies each turbine, record temperature-induced malfunctions and and DoS attacks (Münz and Carle 2007).
Forgetting and Unfolding for Existential Rules
Wang, Zhe (Griffith University) | Wang, Kewen (Griffith University) | Zhang, Xiaowang (Tianjin University)
Existential rules, a family of expressive ontology languages, inherit desired expressive and reasoning properties from both description logics and logic programming. On the other hand, forgetting is a well studied operation for ontology reuse, obfuscation and analysis. Yet it is challenging to establish a theory of forgetting for existential rules. In this paper, we lay the foundation for a theory of forgetting for existential rules by developing a novel notion of unfolding. In particular, we introduce a definition of forgetting for existential rules in terms of query answering and provide a characterisation of forgetting by the unfolding. A result of forgetting may not be expressible in existential rules, and we then capture the expressibility of forgetting by a variant of boundedness. While the expressibility is undecidable in general, we identify a decidable fragment. Finally, we provide an algorithm for forgetting in this fragment.
Anchors: High-Precision Model-Agnostic Explanations
Ribeiro, Marco Tulio (University of Washington) | Singh, Sameer (University of California, Irvine) | Guestrin, Carlos (University of Washington)
We introduce a novel model-agnostic system that explains the behavior of complex models with high-precision rules called anchors, representing local, "sufficient" conditions for predictions. We propose an algorithm to efficiently compute these explanations for any black-box model with high-probability guarantees. We demonstrate the flexibility of anchors by explaining a myriad of different models for different domains and tasks. In a user study, we show that anchors enable users to predict how a model would behave on unseen instances with less effort and higher precision, as compared to existing linear explanations or no explanations.
Approximate and Exact Enumeration of Rule Models
Hara, Satoshi (Osaka University) | Ishihata, Masakazu (Hokkaido University)
In machine learning, rule models are one of the most popular choices when model interpretability is the primary concern. Ordinary, a single model is obtained by solving an optimization problem, and the resulting model is interpreted as the one that best explains the data. In this study, instead of finding a single rule model, we propose algorithms for enumerating multiple rule models. Model enumeration is useful in practice when (i) users want to choose a model that is particularly suited to their task knowledge, or (ii) users want to obtain several possible mechanisms that could be underlying the data to use as hypotheses for further scientific studies. To this end, we propose two enumeration algorithms: an approximate algorithm and an exact algorithm. We prove that these algorithms can enumerate models in a descending order of their objective function values approximately and exactly. We then confirm our theoretical results through experiments on real-world data. We also show that, by using the proposed enumeration algorithms, we can find several different models of almost equal quality.
Fraud detection and machine learning: What you need to know
All things change, and you must adapt over time. Ongoing monitoring of machine learning fraud detection systems is imperative for success. As populations and the underlying data shift, expected system inputs degrade and therefore have an impact on overall performance. This isn't unique to machine learning systems; rule-based systems have the same challenge. But newer machine learning methods can adapt to new and unidentified patterns as underlying changes occur. This eliminates some, but not all, of the machine learning retraining and evaluation steps.
Where AI is headed in 2018 – Becoming Human: Artificial Intelligence Magazine
Stephen Hawking said, "The development of full artificial intelligence could spell the end of the human race….It would take off on its own, and re-design itself at an ever increasing rate. Humans, who are limited by slow biological evolution, couldn't compete, and would be superseded." Ever since its genesis, there have been conflicting views and concerns on the potential enhancement or doom that it can cause to human civilization. While some experts believe that this technology will advance and augment our intelligence, some like Bill Gates have expressed concerns on how a machine's intelligence becomes strong enough to be a concern. For now, let's take a look at the current trends of AI and where it is headed to in 2018: If 2017 was the year where the warnings from Elon Musk and Stephen Hawking about the potential evil from AI clashed with predictions from Mark Zuckerberg and Bill Gates on its potential good, 2018 will be the year when the debate shifts to its practical utility.
Demystifying Information Security Using Data Science
When you search for security data science on the internet, it's difficult to find resources with crisp and clear information about the use cases, methods and limitations in Information Security (hereby referred to as InfoSec). There's usually always some marketing material attached to it. So, I thought of summarising my knowledge and InfoSec experience in this article. When the attackers are within the enterprise network, they first need to figure out where they are. Once they accomplish this, they move towards their targets, and carry out the attack.
Successful Artificial Intelligence is Going to Take a Lot of Work – and Data
If you want to see data being put hard at work, look no further than artificial intelligence and machine learning – never before has timely, accurate data been so critical. A recent survey released by Narrative Science finds 61 percent of enterprises have already implemented AI within their businesses. At least 71 percent said AI was part of their enterprises' innovation strategies. At the same time, 90 percent of respondents in the business intelligence function reported that they would be interested in incorporating AI to make their data and analytics tools smarter. At the same time, AI and machine learning are not overnight projects in themselves – they take considerable time and expertise to get rolling, and constantly need refreshing and updating.
Machine Learning in Finance - Present and Future Applications
Machine learning has had fruitful applications in finance well before the advent of mobile banking apps, proficient chat bots, or search engines. Given high volume, accurate historical records, and quantitative nature of the finance world, few industries are better suited for artificial intelligence. There are more uses cases of machine learning in finance than ever before, a trend perpetuated by more accessible computing power and more accessible machine learning tools (such as Google's Tensorflow). Today, machine learning has come to play an integral role in many phases of the financial ecosystem, from approving loans, to managing assets, to assessing risks. Yet, few technically-savvy professionals have an accurate view of just how many ways machine learning finds its way into their daily financial lives.