Overview
Dependency-based Text Graphs for Keyphrase and Summary Extraction with Applications to Interactive Content Retrieval
We build a bridge between neural network-based machine learning and graph-based natural language processing and introduce a unified approach to keyphrase, summary and relation extraction by aggregating dependency graphs from links provided by a deep-learning based dependency parser. We reorganize dependency graphs to focus on the most relevant content elements of a sentence, integrate sentence identifiers as graph nodes and after ranking the graph, we extract our keyphrases and summaries from its largest strongly-connected component. We take advantage of the implicit structural information that dependency links bring to extract subject-verb-object, is-a and part-of relations. We put it all together into a proof-of-concept dialog engine that specializes the text graph with respect to a query and reveals interactively the document's most relevant content elements. The open-source code of the integrated system is available at https:// github.com/ptarau/DeepRank .
What is this Article about? Extreme Summarization with Topic-aware Convolutional Neural Networks
Narayan, Shashi, Cohen, Shay B., Lapata, Mirella
We introduce "extreme summarization," a new single-document summarization task which aims at creating a short, one-sentence news summary answering the question "What is the article about?". We argue that extreme summarization, by nature, is not amenable to extractive strategies and requires an abstractive modeling approach. In the hope of driving research on this task further: (a) we collect a real-world, large scale dataset by harvesting online articles from the British Broadcasting Corporation (BBC); and (b) propose a novel abstractive model which is conditioned on the article's topics and based entirely on convolutional neural networks. We demonstrate experimentally that this architecture captures long-range dependencies in a document and recognizes pertinent content, outperforming an oracle extractive system and state-of-the-art abstractive approaches when evaluated automatically and by humans on the extreme summarization dataset.
Deep Contextualized Pairwise Semantic Similarity for Arabic Language Questions
Al-Bataineh, Hesham, Farhan, Wael, Mustafa, Ahmad, Seelawi, Haitham, Al-Natsheh, Hussein T.
Question semantic similarity is a challenging and active research problem that is very useful in many NLP applications, such as detecting duplicate questions in community question answering platforms such as Quora. Arabic is considered to be an under-resourced language, has many dialects, and rich in morphology. Combined together, these challenges make identifying semantically similar questions in Arabic even more difficult. In this paper, we introduce a novel approach to tackle this problem, and test it on two benchmarks; one for Modern Standard Arabic (MSA), and another for the 24 major Arabic dialects. We are able to show that our new system outperforms state-of-the-art approaches by achieving 93% F1-score on the MSA benchmark and 82% on the dialectical one. This is achieved by utilizing contextualized word representations (ELMo embeddings) trained on a text corpus containing MSA and dialectic sentences. This in combination with a pairwise fine-grained similarity layer, helps our question-to-question similarity model to generalize predictions on different dialects while being trained only on question-to-question MSA data.
CheckMates Live in New York City
Join us for a cyber security community event with your fellow Check Point customers at the Croton Reservoir Tavern in Manhattan on 19th September 2019 from 11am to 2pm Eastern Time! We guarantee that you'll leave this event having learned something new that you can use to improve your security posture. In addition, this event provides an opportunity to meet your fellow Check Point customers in the region.
Artificial Intelligence (AI) Stats News: AI Is Actively Watching You In 75 Countries
Recent surveys, studies, forecasts and other quantitative assessments of the impact and progress of AI highlighted the strong state of AI surveillance worldwide, the lack of adherence to common privacy principles in companies' data privacy statement, the growing adoption of AI by global businesses, and the perception of AI as a major risk by institutional investors. Using just the first fifteen minutes of a patient's raw electrocardiogram (ECG) signal, the tool produces a score that places patients into different risk categories. Patients in the top quartile were nearly seven times more likely to die of cardiovascular death when compared to the low-risk group in the bottom quartile. U.S. AI and machine learning startups raised $6.62 billion so far in 2019, and international startups raised $6.79 in the same period. The global total for all of 2018 was $19.5 billion [Crunchbase News] The North America AI chip market is estimated to reach $30.62 billion in 2027, up from $2.5 billion in 2018 [ResearchAndMarkets] The Asia Pacific AI chip market is estimated to reach $22.27 billion in 2027, up from $1.03 billion in 2018 [ResearchAndMarkets] "An AI-equipped surveillance camera would be not a mere recording device, but could be made into something closer to an automated police officer"--Edward Snowden "When you get into the millions, you can really start to generate the levels at which humans stop understanding the correlations, and the machines start to understand the correlations"--Ricky Knox, co-founder and CEO, Tandem Bank "As AI gets better at performing the routine tasks traditionally done by humans, only the hardest ones will be left for us to do. But wrestling with only difficult decisions all day long is stressful and unpleasant"--Fred Benenson, former vice president of data, Kickstarter "AI can do things previously unimaginable with the volume, velocity, variety and veracity of big data. It can deliver an edge given the information intensity of all of the processes in asset management"--Amin Rajan, CEO, Create-Research "By 2025, a quarter of all miles driven will be driven by on-demand services"--Amy Wyron, vice president of business solutions, Gett
Learning from Bandit Feedback: An Overview of the State-of-the-art
Jeunen, Olivier, Mykhaylov, Dmytro, Rohde, David, Vasile, Flavian, Gilotte, Alexandre, Bompaire, Martin
In machine learning we often try to optimise a decision rule that would have worked well over a historical dataset; this is the so called empirical risk minimisation principle. In the context of learning from recommender system logs, applying this principle becomes a problem because we do not have available the reward of decisions we did not do. In order to handle this "bandit-feedback" setting, several Counterfactual Risk Minimisation (CRM) methods have been proposed in recent years, that attempt to estimate the performance of different policies on historical data. Through importance sampling and various variance reduction techniques, these methods allow more robust learning and inference than classical approaches. It is difficult to accurately estimate the performance of policies that frequently perform actions that were infrequently done in the past and a number of different types of estimators have been proposed. In this paper, we review several methods, based on different off-policy estimators, for learning from bandit feedback. We discuss key differences and commonalities among existing approaches, and compare their empirical performance on the RecoGym simulation environment. To the best of our knowledge, this work is the first comparison study for bandit algorithms in a recommender system setting.
Distributed Machine Learning on Mobile Devices: A Survey
Gu, Renjie, Yang, Shuo, Wu, Fan
In recent years, mobile devices have gained increasingly development with stronger computation capability and larger storage. Some of the computation-intensive machine learning and deep learning tasks can now be run on mobile devices. To take advantage of the resources available on mobile devices and preserve users' privacy, the idea of mobile distributed machine learning is proposed. It uses local hardware resources and local data to solve machine learning sub-problems on mobile devices, and only uploads computation results instead of original data to contribute to the optimization of the global model. This architecture can not only relieve computation and storage burden on servers, but also protect the users' sensitive information. Another benefit is the bandwidth reduction, as various kinds of local data can now participate in the training process without being uploaded to the server. In this paper, we provide a comprehensive survey on recent studies of mobile distributed machine learning. We survey a number of widely-used mobile distributed machine learning methods. We also present an in-depth discussion on the challenges and future directions in this area. We believe that this survey can demonstrate a clear overview of mobile distributed machine learning and provide guidelines on applying mobile distributed machine learning to real applications.
A literature review on current approaches and applications of fuzzy expert systems
Rajabi, Mina, Hossani, Saeed, Dehghani, Fatemeh
The main purposes of this study are to distinguish the trends of research in publication exits for the utilisations of the fuzzy expert and knowledge-based systems that is done based on the classification of studies in the last decade. The present investigation covers 60 articles from related scholastic journals, International conference proceedings and some major literature review papers. Our outcomes reveal an upward trend in the up-to-date publications number, that is evidence of growing notoriety on the various applications of fuzzy expert systems. This raise in the reports is mainly in the medical neuro-fuzzy and fuzzy expert systems. Moreover, another most critical observation is that many modern industrial applications are extended, employing knowledge-based systems by extracting the experts' knowledge.
Robust Opponent Modeling via Adversarial Ensemble Reinforcement Learning in Asymmetric Imperfect-Information Games
Shen, Macheng, How, Jonathan P.
This paper presents an algorithmic framework for learning robust policies in asymmetric imperfect-information games, where the joint reward could depend on the uncertain opponent type (a private information known only to the opponent itself and its ally). In order to maximize the reward, the protagonist agent has to infer the opponent type through agent modeling. We use multiagent reinforcement learning (MARL) to learn opponent models through self-play, which captures the full strategy interaction and reasoning between agents. However, agent policies learned from self-play can suffer from mutual overfitting. Ensemble training methods can be used to improve the robustness of agent policy against different opponents, but it also significantly increases the computational overhead. In order to achieve a good trade-off between the robustness of the learned policy and the computation complexity, we propose to train a separate opponent policy against the protagonist agent for evaluation purposes. The reward achieved by this opponent is a noisy measure of the robustness of the protagonist agent policy due to the intrinsic stochastic nature of a reinforcement learner. To handle this stochasticity, we apply a stochastic optimization scheme to dynamically update the opponent ensemble to optimize an objective function that strikes a balance between robustness and computation complexity. We empirically show that, under the same limited computational budget, the proposed method results in more robust policy learning than standard ensemble training.
FaceCake: Delivering an Immersive Personalized Shopping Experience Through AI-Powered AR Analytics Insight
FaceCake is the only Augmented Reality and Artificial Intelligence full shopping platform. At its core, FaceCake offers the most immersive online to offline technology-driven consumer shopping experience available, seamlessly enabling consumers to virtually Try-On products instantly with aesthetically stunning AR Try-On as if looking in a mirror, and delivering highly personalized recommendations while concurrently building the most in-depth shopper-initiated data profiles in the industry. Consumers can shop, try, share and buy seamlessly through FaceCake's "mass boutique" AR/AI platform in any category (apparel, beauty, eyewear, jewellery, accessories, home, and more) via mobile, web, In-Store, or even in personalized advertising. Use of FaceCake's platform leads to an increase in conversions, basket size, and reduced returns. FaceCake was built with a simple principle in mind – to make shopping easier, more personalized and accessible.