Goto

Collaborating Authors

 Education


MO2: Model-Based Offline Options

arXiv.org Artificial Intelligence

The ability to discover useful behaviours from past experience and transfer them to new tasks is considered a core component of natural embodied intelligence. Inspired by neuroscience, discovering behaviours that switch at bottleneck states have been long sought after for inducing plans of minimum description length across tasks. Prior approaches have either only supported online, on-policy, bottleneck state discovery, limiting sample-efficiency, or discrete state-action domains, restricting applicability. To address this, we introduce Model-Based Offline Options (MO2), an offline hindsight framework supporting sample-efficient bottleneck option discovery over continuous state-action spaces. Once bottleneck options are learnt offline over source domains, they are transferred online to improve exploration and value estimation on the transfer domain. Our experiments show that on complex long-horizon continuous control tasks with sparse, delayed rewards, MO2's properties are essential and lead to performance exceeding recent option learning methods. Additional ablations further demonstrate the impact on option predictability and credit assignment.


Trust in Language Grounding: a new AI challenge for human-robot teams

arXiv.org Artificial Intelligence

The challenge of language grounding is to fully understand natural language by grounding language in real-world referents. While AI techniques are available, the widespread adoption and effectiveness of such technologies for human-robot teams relies critically on user trust. This survey provides three contributions relating to the newly emerging field of trust in language grounding, including a) an overview of language grounding research in terms of AI technologies, data sets, and user interfaces; b) six hypothesised trust factors relevant to language grounding, which are tested empirically on a human-robot cleaning team; and c) future research directions for trust in language grounding.


Modelling continual learning in humans with Hebbian context gating and exponentially decaying task signals

arXiv.org Artificial Intelligence

Humans can learn several tasks in succession with minimal mutual interference but perform more poorly when trained on multiple tasks at once. The opposite is true for standard deep neural networks. Here, we propose novel computational constraints for artificial neural networks, inspired by earlier work on gating in the primate prefrontal cortex, that capture the cost of interleaved training and allow the network to learn two tasks in sequence without forgetting. We augment standard stochastic gradient descent with two algorithmic motifs, so-called "sluggish" task units and a Hebbian training step that strengthens connections between task units and hidden units that encode task-relevant information. We found that the "sluggish" units introduce a switch-cost during training, which biases representations under interleaved training towards a joint representation that ignores the contextual cue, while the Hebbian step promotes the formation of a gating scheme from task units to the hidden layer that produces orthogonal representations which are perfectly guarded against interference. Validating the model on previously published human behavioural data revealed that it matches performance of participants who had been trained on blocked or interleaved curricula, and that these performance differences were driven by misestimation of the true category boundary.


Identifying a Training-Set Attack's Target Using Renormalized Influence Estimation

arXiv.org Artificial Intelligence

Targeted training-set attacks inject malicious instances into the training set to cause a trained model to mislabel one or more specific test instances. This work proposes the task of target identification, which determines whether a specific test instance is the target of a training-set attack. Target identification can be combined with adversarial-instance identification to find (and remove) the attack instances, mitigating the attack with minimal impact on other predictions. Rather than focusing on a single attack method or data modality, we build on influence estimation, which quantifies each training instance's contribution to a model's prediction. We show that existing influence estimators' poor practical performance often derives from their over-reliance on training instances and iterations with large losses. Our renormalized influence estimators fix this weakness; they far outperform the original estimators at identifying influential groups of training examples in both adversarial and non-adversarial settings, even finding up to 100% of adversarial training instances with no clean-data false positives. Target identification then simplifies to detecting test instances with anomalous influence values. We demonstrate our method's effectiveness on backdoor and poisoning attacks across various data domains, including text, vision, and speech, as well as against a gray-box, adaptive attacker that specifically optimizes the adversarial instances to evade our method. Our source code is available at https://github.com/ZaydH/target_identification.


68% companies believe AI in HR raises overall job accuracy, says report

#artificialintelligence

Around 68 per cent of companies surveyed believe that the implementation of Artificial Intelligence in the Human Resource process increases overall job accuracy, according to a report. The report revealed that 72 per cent of respondents agreed that using AI in the HR process boosts productivity and saves time as they believe it can automate many HR-related procedures and boost the effectiveness of the system through chatbots. The report by HR solutions provider Genius Consultants is based on an online survey with over 825 organisations spread across sectors including banking and finance, construction and engineering, education, FMCG, hospitality, HR solutions, IT, ITES and BPO, logistics, manufacturing, media, oil and gas, pharma, among others. It further revealed that over 44 per cent of respondents indicated that AI-based chatbots are currently the preferred tool for initial interactions during the hiring process, which also helps new hires settle into their responsibilities and understand the company's many aspects later. However, 48 per cent said they are skeptical about using chatbots as most people are yet to adapt with the developing technology.


Data Science Prerequisites - Numpy - Pandas- Seaborn - Views Coupon

#artificialintelligence

This is Data Science Prerequisites - Numpy - Pandas- Seaborn course. An excellent choice for both beginners and experts looking to expand their knowledge on one of the most popular Python libraries in the world! If you've spent time in a spreadsheet software like MS Excel or Google Sheets and want to take your data analysis skills to the next level, this course is for you! Pandas is a Python package providing fast, flexible, and expressive data structures designed to make working with "relational" or "labeled" data both easy and intuitive. It aims to be the fundamental high-level building block for doing practical, real-world data analysis in Python.


Machine Learning in Logistics and Tourism

#artificialintelligence

Machine learning in logistics can be responsible for analyzing datasets looking for better ways to deal with operations. That may be improving demand forecasting or accuracy, inventory optimization or responses in procurement. There are innumerous ways an industry can benefit from machine learning in logistics. With the help of algorithms, the patterns in supply chain data often reveal the most influential factors of the operation. With machine learning solutions, the whole process will be more efficient and profitable. Those things combined will ensure growth and better development of your logistics.


Interviewing AI

#artificialintelligence

As you may know, I've been playing around with AI lately. While these are humorous and can sometimes show the model's strengths and weaknesses, I felt the realm of pre-pubescent humor had had its time. I instead wanted to see if I could ask the AI questions and have a conversation-style interaction much like this old program I used to mess around with back in the day called Eliza (example in link). It was supposed to be kind of a therapist and you could ask questions and it would respond. It was super basic but it felt like an early AI to me. Even if it was limited in responses, it was kind of fun to use, sometimes to humorous effect.


Autonomous Cross Domain Adaptation under Extreme Label Scarcity

arXiv.org Artificial Intelligence

A cross domain multistream classification is a challenging problem calling for fast domain adaptations to handle different but related streams in never-ending and rapidly changing environments. Notwithstanding that existing multistream classifiers assume no labelled samples in the target stream, they still incur expensive labelling cost since they require fully labelled samples of the source stream. This paper aims to attack the problem of extreme label shortage in the cross domain multistream classification problems where only very few labelled samples of the source stream are provided before process runs. Our solution, namely Learning Streaming Process from Partial Ground Truth (LEOPARD), is built upon a flexible deep clustering network where its hidden nodes, layers and clusters are added and removed dynamically in respect to varying data distributions. A deep clustering strategy is underpinned by a simultaneous feature learning and clustering technique leading to clustering-friendly latent spaces. A domain adaptation strategy relies on the adversarial domain adaptation technique where a feature extractor is trained to fool a domain classifier classifying source and target streams. Our numerical study demonstrates the efficacy of LEOPARD where it delivers improved performances compared to prominent algorithms in 15 of 24 cases. Source codes of LEOPARD are shared in \url{https://github.com/wengweng001/LEOPARD.git} to enable further study.


Reinforced Continual Learning for Graphs

arXiv.org Artificial Intelligence

Graph Neural Networks (GNNs) have become the backbone for a myriad of tasks pertaining to graphs and similar topological data structures. While many works have been established in domains related to node and graph classification/regression tasks, they mostly deal with a single task. Continual learning on graphs is largely unexplored and existing graph continual learning approaches are limited to the task-incremental learning scenarios. This paper proposes a graph continual learning strategy that combines the architecture-based and memory-based approaches. The structural learning strategy is driven by reinforcement learning, where a controller network is trained in such a way to determine an optimal number of nodes to be added/pruned from the base network when new tasks are observed, thus assuring sufficient network capacities. The parameter learning strategy is underpinned by the concept of Dark Experience replay method to cope with the catastrophic forgetting problem. Our approach is numerically validated with several graph continual learning benchmark problems in both task-incremental learning and class-incremental learning settings. Compared to recently published works, our approach demonstrates improved performance in both the settings. The implementation code can be found at \url{https://github.com/codexhammer/gcl}.