entity structure
Zero-Shot Open-Schema Entity Structure Discovery
Xu, Xueqiang, Xiao, Jinfeng, Barry, James, Elkaref, Mohab, Zou, Jiaru, Jiang, Pengcheng, Zhang, Yunyi, Giammona, Max, de Mel, Geeth, Han, Jiawei
Entity structure extraction, which aims to extract entities and their associated attribute-value structures from text, is an essential task for text understanding and knowledge graph construction. Existing methods based on large language models (LLMs) typically rely heavily on predefined entity attribute schemas or annotated datasets, often leading to incomplete extraction results. To address these challenges, we introduce Zero-Shot Open-schema Entity Structure Discovery (ZOES), a novel approach to entity structure extraction that does not require any schema or annotated samples. ZOES operates via a principled mechanism of enrichment, refinement, and unification, based on the insight that an entity and its associated structure are mutually reinforcing. Experiments demonstrate that ZOES consistently enhances LLMs' ability to extract more complete entity structures across three different domains, showcasing both the effectiveness and generalizability of the method. These findings suggest that such an enrichment, refinement, and unification mechanism may serve as a principled approach to improving the quality of LLM-based entity structure discovery in various scenarios.
Entity Structure Within and Throughout: Modeling Mention Dependencies for Document-Level Relation Extraction
Xu, Benfeng, Wang, Quan, Lyu, Yajuan, Zhu, Yong, Mao, Zhendong
In this work, we formulate such structure as distinctive dependencies between mention pairs. We then propose SSAN, which incorporates these structural dependencies within the standard self-attention mechanism and throughout the overall encoding stage. Specifically, we design two alternative transformation modules inside each self-attention building block to produce attentive biases so as to adaptively regularize its attention flow. Our experiments demonstrate the usefulness of the proposed entity structure and the effectiveness of SSAN. It significantly outperforms competitive baselines, achieving new state-of-the-art results on three popular document-level relation extraction datasets. We further provide ablation and visualization to show how the entity structure guides the model for better relation extraction. Our code is publicly available.
Lifted Bayesian Filtering in Multiset Rewriting Systems
Lüdtke, Stefan (University of Rostock) | Kirste, Thomas (University of Rostock)
We present a model for Bayesian filtering (BF) in discrete dynamic systems where multiple entities (inter)-act, i.e. where the system dynamics is naturally described by a Multiset rewriting system (MRS). Typically, BF in such situations is computationally expensive due to the high number of discrete states that need to be maintained explicitly. We devise a lifted state representation, based on a suitable decomposition of multiset states, such that some factors of the distribution are exchangeable and thus afford an efficient representation. Intuitively, this representation groups together similar entities whose properties follow an exchangeable joint distribution. Subsequently, we introduce a BF algorithm that works directly on lifted states, without resorting to the original, much larger ground representation. This algorithm directly lends itself to approximate versions by limiting the number of explicitly represented lifted states in the posterior. We show empirically that the lifted representation can lead to a factorial reduction in the representational complexity of the distribution, and in the approximate cases can lead to a lower variance of the estimate and a lower estimation error compared to the original, ground representation.
How To Migrate Your Chatbot From IBM Watson Assistant To Rasa
IBM Watson Assistant (WA), at its core has a basic intent and entity structure. Intents are as minimalist as can be. During the intent creation process, there are two features which aid in the defining of intents. Bot of these features translate into better defined intents, and translates nicely into the JSON export file. Hence the leverage these functions lend to the intent creation process is not lost.