Goto

Collaborating Authors

 South America


Transfer Learning for Relation Extraction via Relation-Gated Adversarial Learning

arXiv.org Machine Learning

Relation extraction aims to extract relational facts from sentences. Previous models mainly rely on manually labeled datasets, seed instances or human-crafted patterns, and distant supervision. However, the human annotation is expensive, while human-crafted patterns suffer from semantic drift and distant supervision samples are usually noisy. Domain adaptation methods enable leveraging labeled data from a different but related domain. However, different domains usually have various textual relation descriptions and different label space (the source label space is usually a superset of the target label space). To solve these problems, we propose a novel model of relation-gated adversarial learning for relation extraction, which extends the adversarial based domain adaptation. Experimental results have shown that the proposed approach outperforms previous domain adaptation methods regarding partial domain adaptation and can improve the accuracy of distance supervised relation extraction through fine-tuning. 1 Introduction Relation extraction (RE) is devoted to extracting relational facts from sentences, which can be applied to many natural language processing (NLP) applications such as knowledge base construction (Wu and Weld, 2010) and question answering (Dai et al., 2016).


LEAP nets for power grid perturbations

arXiv.org Machine Learning

We propose a novel neural network embedding approach to model power transmission grids, in which high voltage lines are disconnected and reconnected with one-another from time to time, either accidentally or willfully. We call our architecture LEAP net, for Latent Encoding of Atypical Perturbation. Our method implements a form of transfer learning, permitting to train on a few source domains, then generalize to new target domains, without learning on any example of that domain. We evaluate the viability of this technique to rapidly assess curative actions that human operators take in emergency situations, using real historical data, from the French high voltage power grid.Figure 1: Electricity is transported from production nodes (top) to consumption nodes (bottom), through lines (green and red edges) connected at substations (black circles), forming a transmission grid of a given topology τ . Injections x ( x 1, x 2, x 3, x 4) (production or consumption) add up to zero.


The double traveling salesman problem with partial last-in-first-out loading constraints

arXiv.org Artificial Intelligence

In this paper, we introduce the Double Traveling Salesman Problem with Partial Last-In-First-Out Loading Constraints (DTSPPL), a pickup-and-delivery single-vehicle routing problem where all pickup operations must be performed before any delivery one because the pickup and delivery areas are geographically separated. The vehicle collects items in the pickup area and loads them into its container, a horizontal stack. After performing all pickup operations, the vehicle begins delivering the items in the delivery area. Loading and unloading operations must obey a partial Last-In-First-Out (LIFO) policy, i.e., a version of the LIFO policy that may be violated within a given reloading depth. The objective of the DTSPPL is to minimize the total cost, which involves the total distance traveled by the vehicle and the number of reloaded items due to violations of the standard LIFO policy. We formally describe the DTSPPL by means of two Integer Linear Programming (ILP) formulations, and propose a heuristic algorithm based on the Biased Random-Key Genetic Algorithm (BRKGA) to find high-quality solutions. The performance of the proposed solution approaches is assessed over a broad set of instances. Computational results have shown that both ILP formulations were able to solve only the smaller instances, whereas the BRKGA obtained better solutions for almost all instances, requiring shorter computational time.


Artificial Intelligence (AI) Stats News: AI Augmentation To Create $2.9 Trillion Of Business Value

#artificialintelligence

The recent surveys, studies, forecasts and other quantitative assessments of the health and progress of AI estimated the impact on productivity of human-machine collaboration, the number of jobs that could be automated in major U.S. cities, and the size of the future AI in retail and healthcare markets; and found AI optimism among the general population, algorithms outperforming (again) pathologists, and that our very limited understanding of how our brains learn may improve machine learning. Do you think securing your devices and personal data will become more or less complicated over the next 12 months? DeepMind has developed a machine learning model that can label most animals at Tanzania's Serengeti National Park at least as well as humans while shortening the process by up to 9 months (it normally takes up to a year for volunteers to return labeled photos) [Engadget] In a simulation, biological learning algorithms outperformed state-of-the-art optimal learning curves in supervised learning of feedforward networks, indicating "the potency of neurobiological mechanisms" and opening "opportunities for developing a superior class of deep learning algorithms" [Scientific Reports] The AI in retail market is estimated to reach $4.3 billion by 2024 [P&S Intelligence] [e.g., Nike acquires Celect, August 6, 2019] The AI in healthcare market is estimated to reach $12.2 billion by 2023 [Market Research Future] [e.g., BlueDot has raised $7 million in Series A funding, August 7, 2019] AI companies funded in the last 3 months: 417 for total funding of $8.7 billion Data is eating the world quote of the week: "Although it is fashionable to say that we are producing more data than ever, the reality is that we always produced data, we just didn't know how to capture it in useful ways"--Subbarao Kambhampati, Arizona State University AI is eating the world quote of the week: "We advocate for a new perspective for designing benchmarks for measuring progress in AI. Unlike past decades where the community constructed a static benchmark dataset to work on for the next decade or two, we propose that future benchmarks should dynamically evolve together with the evolving state-of-the-art"--Keisuke Sakaguchi, Ronan Le Bras, Chandra Bhagavatula, Yejin Choi, Allen Institute for Artificial Intelligence and the University of Washington


Facial recognition is now rampant. The implications for our freedom are chilling Stephanie Hare

#artificialintelligence

Last week, all of us who live in the UK, and all who visit us, discovered that our faces were being scanned secretly by private companies and have been for some time. We don't know what these companies are doing with our faces or how long they've been doing it because they refused to share this with the Financial Times, which reported on Monday that facial recognition technology is being used in King's Cross and may be deployed in Canary Wharf, two areas that cover more than 160 acres of London. We are just as ignorant about what has been happening to our faces when they're scanned by the property developers, shopping centres, museums, conference centres and casinos that have also been secretly using facial recognition technology on us, according to the civil liberties group Big Brother Watch. But we can take a good guess. They may be matching us against police watchlists, maintaining their own watchlists or sharing their watchlists with the police, other companies and other governments.


Competitive Multi-Agent Deep Reinforcement Learning with Counterfactual Thinking

arXiv.org Artificial Intelligence

Counterfactual thinking describes a psychological phenomenon that people re-infer the possible results with different solutions about things that have already happened. It helps people to gain more experience from mistakes and thus to perform better in similar future tasks. This paper investigates the counterfactual thinking for agents to find optimal decision-making strategies in multi-agent reinforcement learning environments. In particular, we propose a multi-agent deep reinforcement learning model with a structure which mimics the human-psychological counterfactual thinking process to improve the competitive abilities for agents. To this end, our model generates several possible actions (intent actions) with a parallel policy structure and estimates the rewards and regrets for these intent actions based on its current understanding of the environment. Our model incorporates a scenario-based framework to link the estimated regrets with its inner policies. During the iterations, our model updates the parallel policies and the corresponding scenario-based regrets for agents simultaneously. To verify the effectiveness of our proposed model, we conduct extensive experiments on two different environments with real-world applications. Experimental results show that counterfactual thinking can actually benefit the agents to obtain more accumulative rewards from the environments with fair information by comparing to their opponents while keeping high performing efficiency.


Performing Deep Recurrent Double Q-Learning for Atari Games

arXiv.org Artificial Intelligence

Currently, many applications in Machine Learning are based on define new models to extract more information about data, In this case Deep Reinforcement Learning with the most common application in video games like Atari, Mario, and others causes an impact in how to computers can learning by himself with only information called rewards obtained from any action. There is a lot of algorithms modeled and implemented based on Deep Recurrent Q-Learning proposed by Deep-Mind used in AlphaZero and Go. In this document, We proposed Deep Recurrent Double Q-Learning that is an implementation of Deep Reinforcement Learning using Double Q-Learning algorithms and Recurrent Networks like LSTM and DRQN.


Artificial intelligence can contribute to a safer world – TechCrunch

#artificialintelligence

We all see the headlines nearly every day. Whether primitive (gunpowder) or cutting-edge (unmanned aerial vehicles) in the wrong hands, technology can empower bad actors and put our society at risk, creating a sense of helplessness and frustration. Current approaches to protecting our public venues are not up to the task, and, frankly appear to meet Einstein's definition of insanity: "doing the same thing over and over and expecting a different result." It is time to look past traditional defense technologies and see if newer approaches can tilt the pendulum back in the defender's favor. Artificial Intelligence (AI) can play a critical role here, helping to identify, classify and promulgate counteractions on potential threats faster than any security personnel.


Unsupervised Behavior Change Detection in Multidimensional Data Streams for Maritime Traffic Monitoring

arXiv.org Artificial Intelligence

The worldwide growth of maritime traffic and the development of the Automatic Identification System (AIS) has led to advances in monitoring systems for preventing vessel accidents and detecting illegal activities. In this work, we describe research gaps and challenges in machine learning for vessel behavior change and event detection, considering several constraints imposed by real-time data streams and the maritime monitoring domain. As a starting point, we investigate how unsupervised and semi-supervised change detection methods may be employed for identifying shifts in vessel behavior, aiming to detect and label unusual events.


A Deep Evolutionary Approach to Bioinspired Classifier Optimisation for Brain-Machine Interaction

arXiv.org Artificial Intelligence

This study suggests a new approach to EEG data classification by exploring the idea of using evolutionary computation to both select useful discriminative EEG features and optimise the topology of Artificial Neural Networks. An evolutionary algorithm is applied to select the most informative features from an initial set of 2550 EEG statistical features. Optimisation of a Multilayer Perceptron (MLP) is performed with an evolutionary approach before classification to estimate the best hyperparameters of the network. Deep learning and tuning with Long Short-Term Memory (LSTM) are also explored, and Adaptive Boosting of the two types of models is tested for each problem. Three experiments are provided for comparison using different classifiers: one for attention state classification, one for emotional sentiment classification, and a third experiment in which the goal is to guess the number a subject is thinking of. The obtained results show that an Adaptive Boosted LSTM can achieve an accuracy of 84.44%, 97.06%, and 9.94% on the attentional, emotional, and number datasets, respectively. An evolutionary-optimised MLP achieves results close to the Adaptive Boosted LSTM for the two first experiments and significantly higher for the number-guessing experiment with an Adaptive Boosted DEvo MLP reaching 31.35%, while being significantly quicker to train and classify. In particular, the accuracy of the nonboosted DEvo MLP was of 79.81%, 96.11%, and 27.07% in the same benchmarks. Two datasets for the experiments were gathered using a Muse EEG headband with four electrodes corresponding to TP9, AF7, AF8, and TP10 locations of the international EEG placement standard. The EEG MindBigData digits dataset was gathered from the TP9, FP1, FP2, and TP10 locations.