Grammars & Parsing
Generate relevant leads, Get qualified prospects to make profit!
Have you ever thought of a parser which works without coding? Even a layman can use it with ease. Just keep on clicking and you won't even know when you have parsed your resumes. Data is extracted from resumes to streamline the lead generation process. For an effective lead, you need data about income, job profile, location etc.
On the Possibility of Rewarding Structure Learning Agents: Mutual Information on Linguistic Random Sets
Arroyo-Fernández, Ignacio, Carrasco-Ruíz, Mauricio, Arias-Aguilar, J. Anibal
We present a first attempt to elucidate an Information-Theoretic approach to design the reward provided by a natural language environment to some structure learning agent. To this end, we revisit the Information Theory of unsupervised induction of phrase-structure grammars to characterize the behavior of simulated agents whose actions are characterized in terms of random sets of linguistic samples. Our results showed empirical evidence of that semantic structures (built using Open Information Extraction methods) can be distinguished from randomly constructed structures by observing the Mutual Information among their constituent linguistic random sets. This suggests the possibility of rewarding structure learning agents without using pretrained structural analyzers (oracle actors or experts).
Structural Language Models for Any-Code Generation
Alon, Uri, Sadaka, Roy, Levy, Omer, Yahav, Eran
We address the problem of Any-Code Generation (AnyGen) - generating code without any restriction on the vocabulary or structure. The state-of-the-art in this problem is the sequence-to-sequence (seq2seq) approach, which treats code as a sequence and does not leverage any structural information. We introduce a new approach to AnyGen that leverages the strict syntax of programming languages to model a code snippet as a tree - structural language modeling (SLM). SLM estimates the probability of the program's abstract syntax tree (AST) by decomposing it into a product of conditional probabilities over its nodes. We present a neural model that computes these conditional probabilities by considering all AST paths leading to a target node. Unlike previous structural techniques that have severely restricted the kinds of expressions that can be generated, our approach can generate arbitrary expressions in any programming language. Our model significantly outperforms both seq2seq and a variety of existing structured approaches in generating Java and C# code. We make our code, datasets, and models available online.
Automatically Learning Data Augmentation Policies for Dialogue Tasks
Automatic data augmentation (AutoAugment) (Cubuk et al., 2019) searches for optimal perturbation policies via a controller trained using performance rewards of a sampled policy on the target task, hence reducing data-level model bias. While being a powerful algorithm, their work has focused on computer vision tasks, where it is comparatively easy to apply imperceptible perturbations without changing an image's semantic meaning. In our work, we adapt AutoAugment to automatically discover effective perturbation policies for natural language processing (NLP) tasks such as dialogue generation. We start with a pool of atomic operations that apply subtle semantic-preserving perturbations to the source inputs of a dialogue task (e.g., different POS-tag types of stopword dropout, grammatical errors, and paraphrasing). Next, we allow the controller to learn more complex augmentation policies by searching over the space of the various combinations of these atomic operations. Moreover, we also explore conditioning the controller on the source inputs of the target task, since certain strategies may not apply to inputs that do not contain that strategy's required linguistic features. Empirically, we demonstrate that both our input-agnostic and input-aware controllers discover useful data augmentation policies, and achieve significant improvements over the previous state-of-the-art, including trained on manually-designed policies.
MDP-based Shallow Parsing in Distantly Supervised QA Systems
Zafar, Hamid, Tavakol, Maryam, Lehmann, Jens
Question answering systems over knowledge graphs commonly consist of multiple components such as shallow parser, entity/relation linker, query generation and answer retrieval. We focus on the first task, shallow parsing, which so far received little attention in the QA community. Despite the lack of gold annotations for shallow parsing in question answering datasets, we devise a Reinforcement Learning based model called MDP-Parser, and show that it outperforms the current state-of-the-art approaches. Furthermore, it can be easily embedded into the existing entity/relation linking tools to boost the overall accuracy.
Oracle Unveils AI-Voice for the Enterprise
Oracle announced availability of its AI-trained voice with Oracle Digital Assistant. Now, enterprise customers can use voice commands to communicate with their enterprise applications to drive desired actions and outcomes, enriching the user experience with conversational AI, simplifying interactions and improving productivity. "Enterprises are demanding an AI-powered voice assistant that understands their specific vocabulary and enables naturally expressive interactions for its users," said Suhas Uliyar, vice president, AI and Digital Assistant, Oracle. "Most of all though, enterprises value a highly secure AI-powered voice assistant that stores their business' sensitive data in Oracle's second generation cloud infrastructure." Built on Oracle's next-generation infrastructure, Oracle Digital Assistant applies AI with deep semantic parsing for natural language processing (NLP), natural language understanding (NLU) and custom machine learning (ML) algorithms.
Dependency-based Text Graphs for Keyphrase and Summary Extraction with Applications to Interactive Content Retrieval
We build a bridge between neural network-based machine learning and graph-based natural language processing and introduce a unified approach to keyphrase, summary and relation extraction by aggregating dependency graphs from links provided by a deep-learning based dependency parser. We reorganize dependency graphs to focus on the most relevant content elements of a sentence, integrate sentence identifiers as graph nodes and after ranking the graph, we extract our keyphrases and summaries from its largest strongly-connected component. We take advantage of the implicit structural information that dependency links bring to extract subject-verb-object, is-a and part-of relations. We put it all together into a proof-of-concept dialog engine that specializes the text graph with respect to a query and reveals interactively the document's most relevant content elements. The open-source code of the integrated system is available at https:// github.com/ptarau/DeepRank .
A Split-and-Recombine Approach for Follow-up Query Analysis
Liu, Qian, Chen, Bei, Liu, Haoyan, Fang, Lei, Lou, Jian-Guang, Zhou, Bin, Zhang, Dongmei
Context-dependent semantic parsing has proven to be an important yet challenging task. To leverage the advances in context-independent semantic parsing, we propose to perform follow-up query analysis, aiming to restate context-dependent natural language queries with contextual information. To accomplish the task, we propose STAR, a novel approach with a well-designed two-phase process. It is parser-independent and able to handle multifarious follow-up scenarios in different domains. Experiments on the FollowUp dataset show that STAR outperforms the state-of-the-art baseline by a large margin of nearly 8%. The superiority on parsing results verifies the feasibility of follow-up query analysis. We also explore the extensibility of STAR on the SQA dataset, which is very promising.
Oracle Unveils AI-Voice for the Enterprise
Oracle today announced availability of its AI-trained voice with Oracle Digital Assistant. Now, enterprise customers can use voice commands to communicate with their enterprise applications to drive desired actions and outcomes, enriching the user experience with conversational AI, simplifying interactions and improving productivity. "Enterprises are demanding an AI-powered voice assistant that understands their specific vocabulary and enables naturally expressive interactions for its users," said Suhas Uliyar, vice president, AI and Digital Assistant, Oracle. "Most of all though, enterprises value a highly secure AI-powered voice assistant that stores their business' sensitive data in Oracle's second generation cloud infrastructure." Built on Oracle's next-generation infrastructure, Oracle Digital Assistant applies AI with deep semantic parsing for natural language processing (NLP), natural language understanding (NLU) and custom machine learning (ML) algorithms.
Core Semantic First: A Top-down Approach for AMR Parsing
We introduce a novel scheme for parsing a piece of text into its Abstract Meaning Representation (AMR): Graph Spanning based Parsing (GSP). One novel characteristic of GSP is that it constructs a parse graph incrementally in a top-down fashion. Starting from the root, at each step, a new node and its connections to existing nodes will be jointly predicted. The output graph spans the nodes by the distance to the root, following the intuition of first grasping the main ideas then digging into more details. The \textit{core semantic first} principle emphasizes capturing the main ideas of a sentence, which is of great interest. We evaluate our model on the latest AMR sembank and achieve the state-of-the-art performance in the sense that no heuristic graph re-categorization is adopted. More importantly, the experiments show that our parser is especially good at obtaining the core semantics.