Goto

Collaborating Authors

 cbr system


Optimizing Case-Based Reasoning System for Functional Test Script Generation with Large Language Models

Guo, Siyuan, Liu, Huiwu, Chen, Xiaolong, Xie, Yuming, Zhang, Liang, Han, Tao, Chen, Hechang, Chang, Yi, Wang, Jun

arXiv.org Artificial Intelligence

In this work, we explore the potential of large language models (LLMs) for generating functional test scripts, which necessitates understanding the dynamically evolving code structure of the target software. To achieve this, we propose a case-based reasoning (CBR) system utilizing a 4R cycle (i.e., retrieve, reuse, revise, and retain), which maintains and leverages a case bank of test intent descriptions and corresponding test scripts to facilitate LLMs for test script generation. To improve user experience further, we introduce Re4, an optimization method for the CBR system, comprising reranking-based retrieval finetuning and reinforced reuse finetuning. Specifically, we first identify positive examples with high semantic and script similarity, providing reliable pseudo-labels for finetuning the retriever model without costly labeling. Then, we apply supervised finetuning, followed by a reinforcement learning finetuning stage, to align LLMs with our production scenarios, ensuring the faithful reuse of retrieved cases. Extensive experimental results on two product development units from Huawei Datacom demonstrate the superiority of the proposed CBR+Re4. Notably, we also show that the proposed Re4 method can help alleviate the repetitive generation issues with LLMs.


A Data-driven Case-based Reasoning in Bankruptcy Prediction

Li, Wei, Härdle, Wolfgang Karl, Lessmann, Stefan

arXiv.org Artificial Intelligence

There has been intensive research regarding machine learning models for predicting bankruptcy in recent years. However, the lack of interpretability limits their growth and practical implementation. This study proposes a data-driven explainable case-based reasoning (CBR) system for bankruptcy prediction. Empirical results from a comparative study show that the proposed approach performs superior to existing, alternative CBR systems and is competitive with state-of-the-art machine learning models. We also demonstrate that the asymmetrical feature similarity comparison mechanism in the proposed CBR system can effectively capture the asymmetrically distributed nature of financial attributes, such as a few companies controlling more cash than the majority, hence improving both the accuracy and explainability of predictions. In addition, we delicately examine the explainability of the CBR system in the decision-making process of bankruptcy prediction. While much research suggests a trade-off between improving prediction accuracy and explainability, our findings show a prospective research avenue in which an explainable model that thoroughly incorporates data attributes by design can reconcile the dilemma.


Case-Based Reasoning (CBR) for the Self-Improving Help Desk

#artificialintelligence

In the AI-driven era, customer service has evolved to be more efficient and self-learning. AI systems help companies in a variety of ways including improving customer satisfaction ratings, reducing operational costs, and increasing revenue. AI has many other advantages for customer service that human agents cannot compete with -- it is always available, 24/7 and never gets tired or distracted. One of the leading AI systems in this area is CBR Systems' machine learning help desk system. Case Based Reasoning (CBR) is an AI technique that is increasingly used by customer service departments to improve their performance and help desk software providers to offer even more intelligent solutions for their customers.


Bach

AAAI Conferences

During the early stages of developing Case-Based Reasoning (CBR) systems the definition of similarity measures is challenging since this task requires to transfer implicit knowledge of domain experts into knowledge representations. While an entire CBR system is very explanatory, the similarity measure determines the ranking but do not necessarily show which features contribute to high (or low) rankings. In this paper we will present our work on opening the knowledge engineering process for similarity modelling. We will present how we transfer implicit knowledge from experts as well as a data-driven approach into case and similarity representations for CBR systems. The work present is a result of interdisciplinary research collaborations between AI and medical researchers developing e-Health applications.


Applying the Case Difference Heuristic to Learn Adaptations from Deep Network Features

Ye, Xiaomeng, Zhao, Ziwei, Leake, David, Wang, Xizi, Crandall, David

arXiv.org Artificial Intelligence

The case difference heuristic (CDH) approach is a knowledge-light method for learning case adaptation knowledge from the case base of a case-based reasoning system. Given a pair of cases, the CDH approach attributes the difference in their solutions to the difference in the problems they solve, and generates adaptation rules to adjust solutions accordingly when a retrieved case and new query have similar problem differences. As an alternative to learning adaptation rules, several researchers have applied neural networks to learn to predict solution differences from problem differences. Previous work on such approaches has assumed that the feature set describing problems is predefined. This paper investigates a two-phase process combining deep learning for feature extraction and neural network based adaptation learning from extracted features. Its performance is demonstrated in a regression task on an image data: predicting age given the image of a face. Results show that the combined process can successfully learn adaptation knowledge applicable to nonsymbolic differences in cases. The CBR system achieves slightly lower performance overall than a baseline deep network regressor, but better performance than the baseline on novel queries.


On the Explanation of Similarity for Developing and Deploying CBR Systems

Bach, Kerstin, Mork, Paul Jarle

arXiv.org Artificial Intelligence

During the early stages of developing Case-Based Reasoning (CBR) systems the definition of similarity measures is challenging since this task requires transferring implicit knowledge of domain experts into knowledge representations. While an entire CBR system is very explanatory, the similarity measure determines the ranking but do not necessarily show which features contribute to high (or low) rankings. In this paper we present our work on opening the knowledge engineering process for similarity modelling. This work present is a result of an interdisciplinary research collaboration between AI and public health researchers developing e-Health applications. During this work explainability and transparency of the development process is crucial to allow in-depth quality assurance of the by the domain experts.


A Methodological Approach to Model CBR-based Systems

Oliveira, Eliseu M., Reale, Rafael F., Martins, Joberto S. B.

arXiv.org Artificial Intelligence

MLassisted applications are a trend, and many researchers and developers are rushing to apply ML and recover their inherent potential benefits [2] [3]. However, using ML techniques to solve any problem do require some previous background and expertise. For example, it is vital to choose the ML technique that better suits the target application in terms of available computational capability and expected target results. In sequence to an adequate ML technique choice, it is typically necessary to model the problem under the premises of the chosen technique. The modeling process may include, as an example, an MDP-based markovian process (Markov Decision Process) like Q-Learning or SARSA formulation for Reinforcement Learning or the definition of a neural network structure for Neural Networks (NN) [4] [5].


The Twin-System Approach as One Generic Solution for XAI: An Overview of ANN-CBR Twins for Explaining Deep Learning

Keane, Mark T., Kenny, Eoin M.

arXiv.org Artificial Intelligence

The notion of twin systems is proposed to address the eXplainable AI (XAI) problem, where an uninterpretable black-box system is mapped to a white-box 'twin' that is more interpretable. In this short paper, we overview very recent work that advances a generic solution to the XAI problem, the so called twin system approach. The most popular twinning in the literature is that between an Artificial Neural Networks (ANN ) as a black box and Case Based Reasoning (CBR) system as a white-box, where the latter acts as an interpretable proxy for the former. We outline how recent work reviving this idea has applied it to deep learning methods. Furthermore, we detail the many fruitful directions in which this work may be taken; such as, determining the most (i) accurate feature-weighting methods to be used, (ii) appropriate deployments for explanatory cases, (iii) useful cases of explanatory value to users.


How Case Based Reasoning Explained Neural Networks: An XAI Survey of Post-Hoc Explanation-by-Example in ANN-CBR Twins

Keane, Mark T, Kenny, Eoin M

arXiv.org Artificial Intelligence

This paper proposes a theoretical analysis of one approach to the eXplainable AI (XAI) problem, using post-hoc explanation-by-example, that relies on the twinning of artificial neural networks (ANNs) with case-based reasoning (CBR) systems; so-called ANN-CBR twins. It surveys these systems to advance a new theoretical interpretation of previous work and define a road map for CBR's further role in XAI. A systematic survey of 1102 papers was conducted to identify a fragmented literature on this topic and trace its influence to more recent work involving deep neural networks (DNNs). The twin-system approach is advanced as one possible coherent, generic solution to the XAI problem. The paper concludes by road-mapping future directions for this XAI solution, considering (i) further tests of feature-weighting techniques, (ii) how explanatory cases might be deployed (e.g., in counterfactuals, a fortori cases), and (iii) the unwelcome, much-ignored issue of user evaluation.


Case Representation and Similarity Modeling for Non-Specific Musculoskeletal Disorders - a Case-Based Reasoning Approach

Jaiswal, Amar (Norwegian University of Science and Technology) | Bach, Kerstin (Norwegian University of Science and Technology) | Meisingset, Ingebrigt (Norwegian University of Science and Technology) | Vasseljen, Ottar (Norwegian University of Science and Technology)

AAAI Conferences

This paper presents a case-based reasoning (CBR) application for discovering similar patients with non-specific musculoskeletal disorders (MSDs) and recommending treatment plans using previous experiences. From a medical perspective, MSD is a complex disorder as its cause is often bounded to a combination of physiological and psychological factors. Likewise, the features describing the condition and outcome measures vary throughout studies. However, healthcare professionals in the field work in an experience-based way, therefore we chose CBR as the core methodology for developing a decision support system for physiotherapists which would assist them in the process of their co-decision making and treatment planning. In this paper, we focus on case representation and similarity modeling for the non-specific MSD patient data as well as we conducted initial experiments on comparing patient profiles.