Oceania
Hierarchical Few-Shot Imitation with Skill Transition Models
Hakhamaneshi, Kourosh, Zhao, Ruihan, Zhan, Albert, Abbeel, Pieter, Laskin, Michael
A desirable property of autonomous agents is the ability to both solve long-horizon problems and generalize to unseen tasks. Recent advances in data-driven skill learning have shown that extracting behavioral priors from offline data can enable agents to solve challenging long-horizon tasks with reinforcement learning. However, generalization to tasks unseen during behavioral prior training remains an outstanding challenge. To this end, we present Few-shot Imitation with Skill Transition Models (FIST), an algorithm that extracts skills from offline data and utilizes them to generalize to unseen tasks given a few downstream demonstrations. FIST learns an inverse skill dynamics model, a distance function, and utilizes a semi-parametric approach for imitation. We show that FIST is capable of generalizing to new tasks and substantially outperforms prior baselines in navigation experiments requiring traversing unseen parts of a large maze and 7-DoF robotic arm experiments requiring manipulating previously unseen objects in a kitchen.
Interpreting Process Predictions using a Milestone-Aware Counterfactual Approach
Hsieh, Chihcheng, Moreira, Catarina, Ouyang, Chun
Predictive process analytics often apply machine learning to predict the future states of a running business process. However, the internal mechanisms of many existing predictive algorithms are opaque and a human decision-maker is unable to understand \emph{why} a certain activity was predicted. Recently, counterfactuals have been proposed in the literature to derive human-understandable explanations from predictive models. Current counterfactual approaches consist of finding the minimum feature change that can make a certain prediction flip its outcome. Although many algorithms have been proposed, their application to the sequence and multi-dimensional data like event logs has not been explored in the literature. In this paper, we explore the use of a recent, popular model-agnostic counterfactual algorithm, DiCE, in the context of predictive process analytics. The analysis reveals that the algorithm is limited when being applied to derive explanations of process predictions, due to (1) process domain knowledge not being taken into account, (2) long traces that often tend to be less understandable, and (3) difficulties in optimising the counterfactual search with categorical variables. We design an extension of DiCE that can generate counterfactuals for process predictions, and propose an approach that supports deriving milestone-aware counterfactuals at different stages of a trace to promote interpretability. We apply our approach to BPIC2012 event log and the analysis results demonstrate the effectiveness of the proposed approach.
Top 50 Offshore Software Development Companies
Are you searching for a trustworthy technology partner for your business? Don't worry, you have hit the right place. We did our ground research and came up with the 50 top-performing offshore software development companies. These companies have a splendid history and help you build strong solutions assisting businesses manage their jobs more efficiently and effectively. After reading this post, you will definitely find a partner for your business fitting all your requirements. With a hefty focus on mobile and web development, it also offers enterprise software, CMS solutions, EMC systems, and portals for the marketing, manufacturing, healthcare, financial, and telecommunication industries. It has been assisting fast-growing tech companies and startups with a talent pool of 2700 experienced senior-level, dedicated teams of developers. Their clients grow and make successful and scalable products that users love. They work across almost every corner of the map to nail their upcoming project. The main focus of their dedicated developers is'YOURS'. It has partnerships with Adobe, SVB, Google Cloud, and AWS. They are best known for guiding their clients from an idea to its technical application. Skelia is an international BPO and ICT services company established in 2008 by Belgian entrepreneurs.
How AI Can Spot Wildfires Faster Than Humans
I explain Artificial Intelligence terms and news to non-experts. Wildfires are more and more present in modern society, mainly caused by heat waves, lightning, droughts, climate change, or even human actions like car fires, or cigarette butts. We've seen it everywhere recently Brazil, Australia, United States, Canada, etc., destroying plant, human, and animal life, property damage, and contributing to global warming through the high amount of CO2 produced. But thanks to AI, we may be able to spot these fires much sooner and take action sooner. Here's how artificial intelligence can be used to reduce fire detection time from an average of 40 minutes to less than five minutes!
Probabilistic Verification of Neural Networks Against Group Fairness
Sun, Bing, Sun, Jun, Dai, Ting, Zhang, Lijun
Fairness is crucial for neural networks which are used in applications with important societal implication. Recently, there have been multiple attempts on improving fairness of neural networks, with a focus on fairness testing (e.g., generating individual discriminatory instances) and fairness training (e.g., enhancing fairness through augmented training). In this work, we propose an approach to formally verify neural networks against fairness, with a focus on independence-based fairness such as group fairness. Our method is built upon an approach for learning Markov Chains from a user-provided neural network (i.e., a feed-forward neural network or a recurrent neural network) which is guaranteed to facilitate sound analysis. The learned Markov Chain not only allows us to verify (with Probably Approximate Correctness guarantee) whether the neural network is fair or not, but also facilities sensitivity analysis which helps to understand why fairness is violated. We demonstrate that with our analysis results, the neural weights can be optimized to improve fairness. Our approach has been evaluated with multiple models trained on benchmark datasets and the experiment results show that our approach is effective and efficient.
FEBR: Expert-Based Recommendation Framework for beneficial and personalized content
Lechiakh, Mohamed, Maurer, Alexandre
So far, most research on recommender systems focused on maintaining long-term user engagement and satisfaction, by promoting relevant and personalized content. However, it is still very challenging to evaluate the quality and the reliability of this content. In this paper, we propose FEBR (Expert-Based Recommendation Framework), an apprenticeship learning framework to assess the quality of the recommended content on online platforms. The framework exploits the demonstrated trajectories of an expert (assumed to be reliable) in a recommendation evaluation environment, to recover an unknown utility function. This function is used to learn an optimal policy describing the expert's behavior, which is then used in the framework to provide high-quality and personalized recommendations. We evaluate the performance of our solution through a user interest simulation environment (using RecSim). We simulate interactions under the aforementioned expert policy for videos recommendation, and compare its efficiency with standard recommendation methods. The results show that our approach provides a significant gain in terms of content quality, evaluated by experts and watched by users, while maintaining almost the same watch time as the baseline approaches.
Genetic CFL: Optimization of Hyper-Parameters in Clustered Federated Learning
Agrawal, Shaashwat, Sarkar, Sagnik, Alazab, Mamoun, Maddikunta, Praveen Kumar Reddy, Gadekallu, Thippa Reddy, Pham, Quoc-Viet
Federated learning (FL) is a distributed model for deep learning that integrates client-server architecture, edge computing, and real-time intelligence. FL has the capability of revolutionizing machine learning (ML) but lacks in the practicality of implementation due to technological limitations, communication overhead, non-IID (independent and identically distributed) data, and privacy concerns. Training a ML model over heterogeneous non-IID data highly degrades the convergence rate and performance. The existing traditional and clustered FL algorithms exhibit two main limitations, including inefficient client training and static hyper-parameter utilization. To overcome these limitations, we propose a novel hybrid algorithm, namely genetic clustered FL (Genetic CFL), that clusters edge devices based on the training hyper-parameters and genetically modifies the parameters cluster-wise. Then, we introduce an algorithm that drastically increases the individual cluster accuracy by integrating the density-based clustering and genetic hyper-parameter optimization. The results are bench-marked using MNIST handwritten digit dataset and the CIFAR-10 dataset. The proposed genetic CFL shows significant improvements and works well with realistic cases of non-IID and ambiguous data.
How AI Helps Spotting Wildfires
Wildfires are more and more present in modern society, mainly caused by heat waves, lightning, droughts, climate change, or even human actions like car fires and cigarette butts. We've seen it everywhere recently Brazil, Australia, United States, Canada, etc., destroying plant, human, and animal life, property damage, and contributing to global warming through the high amount of CO2 produced. These countries all have walls of videos like the one below in the county's fire emergency to see if something is going on. The most common problem is that they are spotted too late and already widely spread out. This is because you cannot have somebody staring at that wall all day, waiting to spot smoke or fire.
EU challenges partners to keep up with new ambitious climate measures
Brussels – The European Union is using its strength as a wealthy trade bloc of half a billion consumers to set the global pace of climate change action, challenging others to match the ambitions of its latest carbon cutting plans. In its most ambitious bid yet to hit a goal of cutting net greenhouse gas emissions by 55% from 1990 levels by 2030, the EU on Wednesday laid out proposals that would consign the internal combustion engine to history and raise the cost of emitting carbon for heating, transport and factories. The question now is whether the EU gambit becomes an established benchmark upon which investors and sectors like the auto industry set transition strategies, and how big emitters like the United States and China respond ahead of U.N. climate talks later this year. "Amongst G7 and G20 nations, the EU position is now the explicit global benchmark," said Julian Poulter, Head of Investor Relations at Inevitable Policy Response, a consultancy on environmental economics. "It will exert a new influence on that basis, in other industrialized nations and their financial sectors, and increase pressure on those nations that remain as climate outliers and spoilers," he added.
Active learning for online training in imbalanced data streams under cold start
Barata, Ricardo, Leite, Miguel, Pacheco, Ricardo, Sampaio, Marco O. P., Ascensão, João Tiago, Bizarro, Pedro
Labeled data is essential in modern systems that rely on Machine Learning (ML) for predictive modelling. Such systems may suffer from the cold-start problem: supervised models work well but, initially, there are no labels, which are costly or slow to obtain. This problem is even worse in imbalanced data scenarios. Online financial fraud detection is an example where labeling is: i) expensive, or ii) it suffers from long delays, if relying on victims filing complaints. The latter may not be viable if a model has to be in place immediately, so an option is to ask analysts to label events while minimizing the number of annotations to control costs. We propose an Active Learning (AL) annotation system for datasets with orders of magnitude of class imbalance, in a cold start streaming scenario. We present a computationally efficient Outlier-based Discriminative AL approach (ODAL) and design a novel 3-stage sequence of AL labeling policies where it is used as warm-up. Then, we perform empirical studies in four real world datasets, with various magnitudes of class imbalance. The results show that our method can more quickly reach a high performance model than standard AL policies. Its observed gains over random sampling can reach 80% and be competitive with policies with an unlimited annotation budget or additional historical data (with 1/10 to 1/50 of the labels).