Expert Systems
Pre-trained language models as knowledge bases for Automotive Complaint Analysis
Viellieber, V. D., Aßenmacher, M.
Recently researchers developed some interest in the knowledge stored in the large pre-trained models. Petroni et al. (2019) investigated BERT (Devlin et al., 2018) and other architectures with respect to their ability of storing commonsense factual knowledge. As the stored knowledge depends heavily on the pre-training corpus, we are curious about whether one can "teach" these kinds of models further knowledge by exposing them to texts from specific domains, like customer complaints in the automotive industry. Especially for product-driven organizations as car manufacturers, customer feedback provides a precious source of information for product improvements, e.g. in terms of potential security risks identified and mentioned by customers. However, the structured use of this data is an open problem in industry, despite numerous investigations with advanced NLP methods (Choe et al., 2013; Lee et al., 2015; Akella et al., 2017; Liang et al., 2017; Joung et al., 2019). Handling this fuzzy data and satisfying the demand for detailed information extraction in an intelligent manner remains challenging. The recent developments in NLP lead us to the idea of evaluating the ability of pre-trained language models to act as a domain-specific knowledge base. We investigate if a language model, further pre-trained on customer feedback, is able to store customer opinions about products, features, and services as knowledge in model parameters.
Explainable AI for Interpretable Credit Scoring
Demajo, Lara Marie, Vella, Vince, Dingli, Alexiei
With the ever-growing achievements in Artificial Intelligence (AI) and the recent boosted enthusiasm in Financial Technology (FinTech), applications such as credit scoring have gained substantial academic interest. Credit scoring helps financial experts make better decisions regarding whether or not to accept a loan application, such that loans with a high probability of default are not accepted. Apart from the noisy and highly imbalanced data challenges faced by such credit scoring models, recent regulations such as the right to explanation' introduced by the General Data Protection Regulation (GDPR) and the Equal Credit Opportunity Act (ECOA) have added the need for model interpretability to ensure that algorithmic decisions are understandable and coherent. An interesting concept that has been recently introduced is eXplainable AI (XAI), which focuses on making black-box models more interpretable. In this work, we present a credit scoring model that is both accurate and interpretable. For classification, state-of-the-art performance on the Home Equity Line of Credit (HELOC) and Lending Club (LC) Datasets is achieved using the Extreme Gradient Boosting (XGBoost) model. The model is then further enhanced with a 360-degree explanation framework, which provides different explanations (i.e. Evaluation through the use of functionallygrounded, application-grounded and human-grounded analysis show that the explanations provided are simple, consistent as well as satisfy the six predetermined hypotheses testing for correctness, effectiveness, easy understanding, detail sufficiency and trustworthiness. Credit scoring models are decision models that help lenders decide whether or not to accept a loan application based on the model's expectation of the applicant being capable or not of repaying the financial obligations [1]. Such models are beneficial since they reduce the time needed for the loan approval process, allow loan officers to concentrate on only a percentage of the applications, lead to cost savings, reduce human subjectivity and decrease default risk [2]. There has been a lot of research on this problem, with various Machine Learning (ML) and Artificial Intelligence (AI) techniques proposed. Such techniques might be exceptional in predictive power but are also known as black-box methods since they provide no explanations behind their decisions, making humans unable to interpret them [3]. Therefore, it is highly unlikely that any financial expert is ready to trust the predictions of a model without any sort of justification [4]. With regards to credit scoring, lenders will need to understand the model's predictions to ensure that decisions are made for the correct reasons.
A Data-Driven Study of Commonsense Knowledge using the ConceptNet Knowledge Base
Acquiring commonsense knowledge and reasoning is recognized as an important frontier in achieving general Artificial Intelligence (AI). Recent research in the Natural Language Processing (NLP) community has demonstrated significant progress in this problem setting. Despite this progress, which is mainly on multiple-choice question answering tasks in limited settings, there is still a lack of understanding (especially at scale) of the nature of commonsense knowledge itself. In this paper, we propose and conduct a systematic study to enable a deeper understanding of commonsense knowledge by doing an empirical and structural analysis of the ConceptNet knowledge base. ConceptNet is a freely available knowledge base containing millions of commonsense assertions presented in natural language.
Branches in Artificial Intelligence to Transform Your Business!
On May 8, 2018, Google I/O was held at Shoreline Amphitheatre in Mountain View, California. If you are wondering what Google I/O is, don't worry, I've got your back. "Google I/O brings together developers from around the globe annually for talks, hands-on learning with Google experts, and the first look at Google's latest developer products." In the Keynote, Sundar Pichai, the CEO of Alphabet Inc. (Google's parent company), shared the then-latest developments that Google had been working on. One of the projects that he spoke about was something that maybe no one saw coming; an application of Artificial Intelligence (AI), soon to be on our own smartphones, that left the world in awe.
A Data-Driven Study of Commonsense Knowledge using the ConceptNet Knowledge Base
Acquiring commonsense knowledge and reasoning is recognized as an important frontier in achieving general Artificial Intelligence (AI). Recent research in the Natural Language Processing (NLP) community has demonstrated significant progress in this problem setting. Despite this progress, which is mainly on multiple-choice question answering tasks in limited settings, there is still a lack of understanding (especially at scale) of the nature of commonsense knowledge itself. In this paper, we propose and conduct a systematic study to enable a deeper understanding of commonsense knowledge by doing an empirical and structural analysis of the ConceptNet knowledge base. ConceptNet is a freely available knowledge base containing millions of commonsense assertions presented in natural language. Detailed experimental results on three carefully designed research questions, using state-of-the-art unsupervised graph representation learning ('embedding') and clustering techniques, reveal deep substructures in ConceptNet relations, allowing us to make data-driven and computational claims about the meaning of phenomena such as 'context' that are traditionally discussed only in qualitative terms. Furthermore, our methodology provides a case study in how to use data-science and computational methodologies for understanding the nature of an everyday (yet complex) psychological phenomenon that is an essential feature of human intelligence.
Teaching the Machine to Explain Itself using Domain Knowledge
Balayan, Vladimir, Saleiro, Pedro, Belém, Catarina, Krippahl, Ludwig, Bizarro, Pedro
Machine Learning (ML) has been increasingly used to aid humans to make better and faster decisions. However, non-technical humans-in-the-loop struggle to comprehend the rationale behind model predictions, hindering trust in algorithmic decision-making systems. Considerable research work on AI explainability attempts to win back trust in AI systems by developing explanation methods but there is still no major breakthrough. At the same time, popular explanation methods (e.g., LIME, and SHAP) produce explanations that are very hard to understand for non-data scientist persona. To address this, we present JOEL, a neural network-based framework to jointly learn a decision-making task and associated explanations that convey domain knowledge. JOEL is tailored to human-in-the-loop domain experts that lack deep technical ML knowledge, providing high-level insights about the model's predictions that very much resemble the experts' own reasoning. Moreover, we collect the domain feedback from a pool of certified experts and use it to ameliorate the model (human teaching), hence promoting seamless and better suited explanations. Lastly, we resort to semantic mappings between legacy expert systems and domain taxonomies to automatically annotate a bootstrap training set, overcoming the absence of concept-based human annotations. We validate JOEL empirically on a real-world fraud detection dataset. We show that JOEL can generalize the explanations from the bootstrap dataset. Furthermore, obtained results indicate that human teaching can further improve the explanations prediction quality by approximately $13.57\%$.
Combination of interval-valued belief structures based on belief entropy
Its application involves a wide range of area including expert systems[3][4][5], information fusion[6], pattern classfication[7][8][9], risk evaluation [10,11] [12], image recognition [13], classification[14,15] and data mining [16] etc. The original DS theory requires deterministic belie degrees and belief structures. However, in practical situations, evidence coming from multiple sources may be influenced by unexpected extraneous factors. The lack of information, linguistic ambiguity or vagueness and cognitive bias all contribute to the uncertain evidence obtained in practical situations. For example, during risk assessment, expert may be unable to provide a precise assessment if he/she is not 100% sure.
OrgMining 2.0: A Novel Framework for Organizational Model Mining from Event Logs
Yang, Jing, Ouyang, Chun, van der Aalst, Wil M. P., ter Hofstede, Arthur H. M., Yu, Yang
Providing appropriate structures around human resources can streamline operations and thus facilitate the competitiveness of an organization. To achieve this goal, modern organizations need to acquire an accurate and timely understanding of human resource grouping while faced with an ever-changing environment. The use of process mining offers a promising way to help address the need through utilizing event log data stored in information systems. By extracting knowledge about the actual behavior of resources participating in business processes from event logs, organizational models can be constructed, which facilitate the analysis of the de facto grouping of human resources relevant to process execution. Nevertheless, open research gaps remain to be addressed when applying the state-of-the-art process mining to analyze resource grouping. For one, the discovery of organizational models has only limited connections with the context of process execution. For another, a rigorous solution that evaluates organizational models against event log data is yet to be proposed. In this paper, we aim to tackle these research challenges by developing a novel framework built upon a richer definition of organizational models coupling resource grouping with process execution knowledge. By introducing notions of conformance checking for organizational models, the framework allows effective evaluation of organizational models, and therefore provides a foundation for analyzing and improving resource grouping based on event logs. We demonstrate the feasibility of this framework by proposing an approach underpinned by the framework for organizational model discovery, and also conduct experiments on real-life event logs to discover and evaluate organizational models.
The Evolution of Concept-Acquisition based on Developmental Psychology
A conceptual system with rich connotation is key to improving the performance of knowledge-based artificial intelligence systems. While a conceptual system, which has abundant concepts and rich semantic relationships, and is developable, evolvable, and adaptable to multi-task environments, its actual construction is not only one of the major challenges of knowledge engineering, but also the fundamental goal of research on knowledge and conceptualization. Finding a new method to represent concepts and construct a conceptual system will therefore greatly improve the performance of many intelligent systems. Fortunately the core of human cognition is a system with relatively complete concepts and a mechanism that ensures the establishment and development of the system. The human conceptual system can not be achieved immediately, but rather must develop gradually. Developmental psychology carefully observes the process of concept acquisition in humans at the behavioral level, and along with cognitive psychology has proposed some rough explanations of those observations. However, due to the lack of research in aspects such as representation, systematic models, algorithm details and realization, many of the results of developmental psychology have not been applied directly to the building of artificial conceptual systems. For example, Karmiloff-Smith's Representation Redescription (RR) supposition reflects a concept-acquisition process that re-describes a lower level representation of a concept to a higher one. This paper is inspired by this developmental psychology viewpoint. We use an object-oriented approach to re-explain and materialize RR supposition from the formal semantic perspective, because the OO paradigm is a natural way to describe the outside world, and it also has strict grammar regulations.
Enhancing Humans with AI bots - discover.bot
Artificial intelligence (AI) has both surpassed and replaced humans in many fields. Will AI overpower humanity in the near or distant future? Will AI control humans and replace governments? Or will AI remain a tool that humans will use to improve their performances? Research on brain-computer interface (BCI) has begun and suggests that we implant chips or connect devices to our brain to increase computing power.