prioritisation
Reward Prediction Error Prioritisation in Experience Replay: The RPE-PER Method
Yamani, Hoda, Xing, Yuning, Ong, Lee Violet C., MacDonald, Bruce A., Williams, Henry
Reinforcement Learning algorithms aim to learn optimal control strategies through iterative interactions with an environment. A critical element in this process is the experience replay buffer, which stores past experiences, allowing the algorithm to learn from a diverse range of interactions rather than just the most recent ones. This buffer is especially essential in dynamic environments with limited experiences. However, efficiently selecting high-value experiences to accelerate training remains a challenge. Drawing inspiration from the role of reward prediction errors (RPEs) in biological systems, where they are essential for adaptive behaviour and learning, we introduce Reward Predictive Error Prioritised Experience Replay (RPE-PER). This novel approach prioritises experiences in the buffer based on RPEs. Our method employs a critic network, EMCN, that predicts rewards in addition to the Q-values produced by standard critic networks. The discrepancy between these predicted and actual rewards is computed as RPE and utilised as a signal for experience prioritisation. Experimental evaluations across various continuous control tasks demonstrate RPE-PER's effectiveness in enhancing the learning speed and performance of off-policy actor-critic algorithms compared to baseline approaches.
Towards Explainable Test Case Prioritisation with Learning-to-Rank Models
Ramírez, Aurora, Berrios, Mario, Romero, José Raúl, Feldt, Robert
Test case prioritisation (TCP) is a critical task in regression testing to ensure quality as software evolves. Machine learning has become a common way to achieve it. In particular, learning-to-rank (LTR) algorithms provide an effective method of ordering and prioritising test cases. However, their use poses a challenge in terms of explainability, both globally at the model level and locally for particular results. Here, we present and discuss scenarios that require different explanations and how the particularities of TCP (multiple builds over time, test case and test suite variations, etc.) could influence them. We include a preliminary experiment to analyse the similarity of explanations, showing that they do not only vary depending on test case-specific predictions, but also on the relative ranks.
- Europe > Sweden > Vaestra Goetaland > Gothenburg (0.04)
- Europe > Spain > Andalusia > Córdoba Province > Córdoba (0.04)
Resolving Ethics Trade-offs in Implementing Responsible AI
Sanderson, Conrad, Schleiger, Emma, Douglas, David, Kuhnert, Petra, Lu, Qinghua
While the operationalisation of high-level AI ethics principles into practical AI/ML systems has made progress, there is still a theory-practice gap in managing tensions between the underlying AI ethics aspects. We cover five approaches for addressing the tensions via trade-offs, ranging from rudimentary to complex. The approaches differ in the types of considered context, scope, methods for measuring contexts, and degree of justification. None of the approaches is likely to be appropriate for all organisations, systems, or applications. To address this, we propose a framework which consists of: (i) proactive identification of tensions, (ii) prioritisation and weighting of ethics aspects, (iii) justification and documentation of trade-off decisions. The proposed framework aims to facilitate the implementation of well-rounded AI/ML systems that are appropriate for potential regulatory requirements.
- Oceania > Australia (0.29)
- Europe > United Kingdom > England > Oxfordshire > Oxford (0.04)
- Asia (0.04)
- Law (1.00)
- Information Technology > Security & Privacy (1.00)
- Government > Regional Government (0.68)
AI for Agile development: a Meta-Analysis
This study explores the benefits and challenges of integrating Artificial Intelligence with Agile software development methodologies, focusing on improving continuous integration and delivery. A systematic literature review and longitudinal meta-analysis of the retrieved studies was conducted to analyse the role of Artificial Intelligence and it's future applications within Agile software development. The review helped identify critical challenges, such as the need for specialised socio-technical expertise. While Artificial Intelligence holds promise for improved software development practices, further research is needed to better understand its impact on processes and practitioners, and to address the indirect challenges associated with its implementation.
- North America > United States > New York > New York County > New York City (0.05)
- Europe > Sweden > Vaestra Goetaland > Gothenburg (0.05)
- Europe > Netherlands (0.04)
- Information Technology > Software Engineering (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (0.69)
- Information Technology > Artificial Intelligence > Issues > Social & Ethical Issues (0.68)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.47)
Neural Rankers for Effective Screening Prioritisation in Medical Systematic Review Literature Search
Wang, Shuai, Scells, Harrisen, Koopman, Bevan, Zuccon, Guido
Medical systematic reviews typically require assessing all the documents retrieved by a search. The reason is two-fold: the task aims for ``total recall''; and documents retrieved using Boolean search are an unordered set, and thus it is unclear how an assessor could examine only a subset. Screening prioritisation is the process of ranking the (unordered) set of retrieved documents, allowing assessors to begin the downstream processes of the systematic review creation earlier, leading to earlier completion of the review, or even avoiding screening documents ranked least relevant. Screening prioritisation requires highly effective ranking methods. Pre-trained language models are state-of-the-art on many IR tasks but have yet to be applied to systematic review screening prioritisation. In this paper, we apply several pre-trained language models to the systematic review document ranking task, both directly and fine-tuned. An empirical analysis compares how effective neural methods compare to traditional methods for this task. We also investigate different types of document representations for neural methods and their impact on ranking performance. Our results show that BERT-based rankers outperform the current state-of-the-art screening prioritisation methods. However, BERT rankers and existing methods can actually be complementary, and thus, further improvements may be achieved if used in conjunction.
- Oceania > Australia > South Australia > Adelaide (0.05)
- Oceania > Australia > Queensland > Brisbane (0.04)
- North America > United States > New York > New York County > New York City (0.04)
- (2 more...)
In-flight Novelty Detection with Convolutional Neural Networks
Hartwell, Adam, Montana, Felipe, Jacobs, Will, Kadirkamanathan, Visakan, Mills, Andrew R, Clark, Tom
Gas turbine engines are complex machines that typically generate a vast amount of data, and require careful monitoring to allow for cost-effective preventative maintenance. In aerospace applications, returning all measured data to ground is prohibitively expensive, often causing useful, high value, data to be discarded. The ability to detect, prioritise, and return useful data in real-time is therefore vital. This paper proposes that system output measurements, described by a convolutional neural network model of normality, are prioritised in real-time for the attention of preventative maintenance decision makers. Due to the complexity of gas turbine engine time-varying behaviours, deriving accurate physical models is difficult, and often leads to models with low prediction accuracy and incompatibility with real-time execution. Data-driven modelling is a desirable alternative producing high accuracy, asset specific models without the need for derivation from first principles. We present a data-driven system for online detection and prioritisation of anomalous data. Biased data assessment deriving from novel operating conditions is avoided by uncertainty management integrated into the deep neural predictive model. Testing is performed on real and synthetic data, showing sensitivity to both real and synthetic faults. The system is capable of running in real-time on low-power embedded hardware and is currently in deployment on the Rolls-Royce Pearl 15 engine flight trials.
- North America > United States > New York > New York County > New York City (0.04)
- North America > United States > Montana (0.04)
- North America > United States > California > San Diego County > Poway (0.04)
- (4 more...)
- Transportation > Air (1.00)
- Aerospace & Defense > Aircraft (1.00)
Using Machine Intelligence to Prioritise Code Review Requests
Saini, Nishrith, Britto, Ricardo
Modern Code Review (MCR) is the process of reviewing new code changes that need to be merged with an existing codebase. As a developer, one may receive many code review requests every day, i.e., the review requests need to be prioritised. Manually prioritising review requests is a challenging and time-consuming process. To address the above problem, we conducted an industrial case study at Ericsson aiming at developing a tool called Pineapple, which uses a Bayesian Network to prioritise code review requests. To validate our approach/tool, we deployed it in a live software development project at Ericsson, wherein more than 150 developers develop a telecommunication product. We focused on evaluating the predictive performance, feasibility, and usefulness of our approach. The results indicate that Pineapple has competent predictive performance (RMSE = 0.21 and MAE = 0.15). Furthermore, around 82.6% of Pineapple's users believe the tool can support code review request prioritisation by providing reliable results, and around 56.5% of the users believe it helps reducing code review lead time. As future work, we plan to evaluate Pineapple's predictive performance, usefulness, and feasibility through a longitudinal investigation.
- Europe > Sweden (0.04)
- South America > Brazil (0.04)
- North America > United States > New York > New York County > New York City (0.04)
- Asia > India (0.04)
- Questionnaire & Opinion Survey (1.00)
- Research Report > New Finding (0.68)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Uncertainty > Bayesian Inference (0.52)
- Information Technology > Artificial Intelligence > Machine Learning > Learning Graphical Models > Directed Networks > Bayesian Learning (0.52)
- Information Technology > Artificial Intelligence > Machine Learning > Statistical Learning (0.47)
Facebook using artificial intelligence to prioritise reported content
NEW DELHI: Facebook on Tuesday said it has stepped up the use of artificial intelligence (AI) to " prioritise reported content", a move that will help the social media giant take action faster on harmful and violative content. Facebook, which has 1.82 billion daily users globally, has drawn flak in the past for its handling of hate speech on the platform in India, which is among its biggest markets. Facebook Product Manager (Community Integrity) Ryan Barnes said the company is using AI to prioritise reported content, and that this prioritisation is important to help its over 15,000 reviewers. She explained that the prioritisation is important for four reasons -- not all harmful content is equal, some enforcement decisions are complex, people do not always report harmful content and the reports aren't always accurate. Speaking to reporters in a virtual briefing, she said the company has moved from relying on user reports alone to add use of technology to help aid the process.
Facebook using artificial intelligence to priorities reported content
Facebook using artificial intelligence to priorities reported content. Facebook on Tuesday said it has stepped up the use of artificial intelligence (AI) to "prioritise reported content", a move that will help the social media giant take action faster on harmful and violative content. Facebook, which has 1.82 billion daily users globally, has drawn flak in the past for its handling of hate speech on the platform in India, which is among its biggest markets. Facebook Product Manager (Community Integrity) Ryan Barnes said the company is using AI to prioritise reported content, and that this prioritisation is important to help its over 15,000 reviewers. She explained that the prioritisation is important for four reasons -- not all harmful content is equal, some enforcement decisions are complex, people do not always report harmful content and the reports aren't always accurate.
EdgeTier says customer care is ripe for digital disruption
Founded in 2015 by Bart Lehane, Ciaran Tobin and Shane Lynn, EdgeTier recently raised €1.5m in a funding round led by Episode 1, ACT Venture Capital and Enterprise Ireland. The Dublin start-up delivers high-quality analytics products and services to clients in the areas of customer service, customer simulation, and analytics services. The company also recently won Enterprise Ireland's Digital Disruptor award. "EdgeTier builds products to make customer contact centres more intelligent, more efficient, and more effective," explained CEO Shane Lynn. "EdgeTier uses artificial intelligence and machine learning techniques to enable contact centres to provide higher-quality customer experience at incredible levels of efficiency."
- Europe > Ireland (0.48)
- Europe > United Kingdom (0.05)