Goto

Collaborating Authors

 Ontologies


The Acquisition of Semantic Relationships between words

arXiv.org Artificial Intelligence

DB["e"]=5 The study of semantic relationships has revealed a DB["f"]=6 close connection between these relationships and DB["g"]=7 the morphological characteristics of a language. Morphology, as a subfield of linguistics, DB["h"]=8 investigates the internal structure and formation of words. By delving into the relationship between DB["i"]=9 semantic relationships and language morphology, we can gain deeper insights into how the DB["j"]=10 underlying structure of words contributes to the DB["k"]=20 interpretation and comprehension of language. This paper explores the dynamic interplay between DB["l"]=30 semantic relationships and the morphological aspects of different languages, by examining the DB["m"]=40 intricate relationship between language morphology and semantic relationships, valuable DB["n"]=50 insights can be gained regarding how the structure DB["o"]=60 of words influences language comprehension.


Employing Crowdsourcing for Enriching a Music Knowledge Base in Higher Education

arXiv.org Artificial Intelligence

This paper describes the methodology followed and the lessons learned from employing crowdsourcing techniques as part of a homework assignment involving higher education students of computer science. Making use of a platform that supports crowdsourcing in the cultural heritage domain students were solicited to enrich the metadata associated with a selection of music tracks. The results of the campaign were further analyzed and exploited by students through the use of semantic web technologies. In total, 98 students participated in the campaign, contributing more than 6400 annotations concerning 854 tracks. The process also led to the creation of an openly available annotated dataset, which can be useful for machine learning models for music tagging. The campaign's results and the comments gathered through an online survey enable us to draw some useful insights about the benefits and challenges of integrating crowdsourcing into computer science curricula and how this can enhance students' engagement in the learning process.


An Open-Source Knowledge Graph Ecosystem for the Life Sciences

arXiv.org Artificial Intelligence

Translational research requires data at multiple scales of biological organization. Advancements in sequencing and multi-omics technologies have increased the availability of these data but researchers face significant integration challenges. Knowledge graphs (KGs) are used to model complex phenomena, and methods exist to automatically construct them. However, tackling complex biomedical integration problems requires flexibility in the way knowledge is modeled. Moreover, existing KG construction methods provide robust tooling at the cost of fixed or limited choices among knowledge representation models. PheKnowLator (Phenotype Knowledge Translator) is a semantic ecosystem for automating the FAIR (Findable, Accessible, Interoperable, and Reusable) construction of ontologically grounded KGs with fully customizable knowledge representation. The ecosystem includes KG construction resources (e.g., data preparation APIs), analysis tools (e.g., SPARQL endpoints and abstraction algorithms), and benchmarks (e.g., prebuilt KGs and embeddings). We evaluate the ecosystem by surveying open-source KG construction methods and analyzing its computational performance when constructing 12 large-scale KGs. With flexible knowledge representation, PheKnowLator enables fully customizable KGs without compromising performance or usability.


OntoChatGPT Information System: Ontology-Driven Structured Prompts for ChatGPT Meta-Learning

arXiv.org Artificial Intelligence

This research presents a comprehensive methodology for utilizing an ontology-driven structured prompts system in interplay with ChatGPT, a widely used large language model (LLM). The study develops formal models, both information and functional, and establishes the methodological foundations for integrating ontology-driven prompts with ChatGPT's meta-learning capabilities. The resulting productive triad comprises the methodological foundations, advanced information technology, and the OntoChatGPT system, which collectively enhance the effectiveness and performance of chatbot systems. The implementation of this technology is demonstrated using the Ukrainian language within the domain of rehabilitation. By applying the proposed methodology, the OntoChatGPT system effectively extracts entities from contexts, classifies them, and generates relevant responses. The study highlights the versatility of the methodology, emphasizing its applicability not only to ChatGPT but also to other chatbot systems based on LLMs, such as Google's Bard utilizing the PaLM 2 LLM. The underlying principles of meta-learning, structured prompts, and ontology-driven information retrieval form the core of the proposed methodology, enabling their adaptation and utilization in various LLM-based systems. This versatile approach opens up new possibilities for NLP and dialogue systems, empowering developers to enhance the performance and functionality of chatbot systems across different domains and languages.


Performance Optimization for Variable Bitwidth Federated Learning in Wireless Networks

arXiv.org Artificial Intelligence

This paper considers improving wireless communication and computation efficiency in federated learning (FL) via model quantization. In the proposed bitwidth FL scheme, edge devices train and transmit quantized versions of their local FL model parameters to a coordinating server, which aggregates them into a quantized global model and synchronizes the devices. The goal is to jointly determine the bitwidths employed for local FL model quantization and the set of devices participating in FL training at each iteration. We pose this as an optimization problem that aims to minimize the training loss of quantized FL under a per-iteration device sampling budget and delay requirement. However, the formulated problem is difficult to solve without (i) a concrete understanding of how quantization impacts global ML performance and (ii) the ability of the server to construct estimates of this process efficiently. To address the first challenge, we analytically characterize how limited wireless resources and induced quantization errors affect the performance of the proposed FL method. Our results quantify how the improvement of FL training loss between two consecutive iterations depends on the device selection and quantization scheme as well as on several parameters inherent to the model being learned. Then, we show that the FL training process can be described as a Markov decision process and propose a model-based reinforcement learning (RL) method to optimize action selection over iterations. Compared to model-free RL, this model-based RL approach leverages the derived mathematical characterization of the FL training process to discover an effective device selection and quantization scheme without imposing additional device communication overhead. Simulation results show that the proposed FL algorithm can reduce the convergence time.


Cloud Render Farm Services Discovery Using NLP And Ontology Based Knowledge Graph

arXiv.org Artificial Intelligence

Cloud render farm services are the Platform-as-a-Service (PaaS) type of cloud services that provide their cloud resources and the complete platform to render the animation files [1, 2]. The animation files to be rendered are uploaded onto the Cloud render farm servers using the web interface of the service provider [3, 4]. The uploaded files are assessed by the rendering job queue manager and the render nodes are assigned for completing the rendering job. The updates on the rendering process are displayed in the render management software dashboard and the user has the privilege to monitor, stop or pause the rendering job and pay only for the rendering time for which the cloud render nodes were used. Hence, the cloud render farm services are considered to be a costeffective alternative for rendering needs in other fields like Fashion designing include Renderingfox, RenderRocket, Rebusfarm etc [5, 6]. Many of our previous work have been focussed on creating a cloud broker service [7,8,9] to aggregate the information about the cloud renderfarms to recommend the right cloud renderfarm services and that let to the realization of the significance of an ontology of cloud renderfarm services to discover and recommend the right cloud renderfarm services. Though many have worked on cloud rendering [10,11,12] and also towards developing an ontology-based service discovery engine for the generic IaaS (Infrastructureas-a-Service) like Sim KM, et al [13,14,15], no work has considered developing domain specific service discovery engine for cloud render farm services of PaaS (Platform-as-a-Service) type. This research work proposes ontology-based domain specific service discovery engine named RenderSearch for the cloud render farm services of PaaS (Platform-as-a-Service) type. The contributions of this research work include the following: i) This work proposes service discovery engine architecture for domain specific cloud render farm services.


DeepOnto: A Python Package for Ontology Engineering with Deep Learning

arXiv.org Artificial Intelligence

Applying deep learning techniques, particularly language models (LMs), in ontology engineering has raised widespread attention. However, deep learning frameworks like PyTorch and Tensorflow are predominantly developed for Python programming, while widely-used ontology APIs, such as the OWL API and Jena, are primarily Java-based. To facilitate seamless integration of these frameworks and APIs, we present Deeponto, a Python package designed for ontology engineering. The package encompasses a core ontology processing module founded on the widely-recognised and reliable OWL API, encapsulating its fundamental features in a more "Pythonic" manner and extending its capabilities to include other essential components including reasoning, verbalisation, normalisation, projection, and more. Building on this module, Deeponto offers a suite of tools, resources, and algorithms that support various ontology engineering tasks, such as ontology alignment and completion, by harnessing deep learning methodologies, primarily pre-trained LMs. In this paper, we also demonstrate the practical utility of Deeponto through two use-cases: the Digital Health Coaching in Samsung Research UK and the Bio-ML track of the Ontology Alignment Evaluation Initiative (OAEI).


Causing is Achieving -- A solution to the problem of causation

arXiv.org Artificial Intelligence

From the standpoint of applied ontology, the problem of understanding and modeling causation has been recently challenged on the premise that causation is real. As a consequence, the following three results were obtained: (1) causation can be understood via the notion of systemic function; (2) any cause can be decomposed using only four subfunctions, namely Achieves, Prevents, Allows, and Disallows; and (3) the last three subfunctions can be defined in terms of Achieves alone. It follows that the essence of causation lies in a single function, namely Achieves. It remains to elucidate the nature of the Achieves function, which has been elaborated only partially in the previous work. In this paper, we first discuss a couple of underlying policies in the above-mentioned causal theory since these are useful in the discussion, then summarize the results obtained in the former paper, and finally reveal the nature of Achieves giving a complete solution to the problem of what causation is.


Towards Unbiased Exploration in Partial Label Learning

arXiv.org Artificial Intelligence

We consider learning a probabilistic classifier from partially-labelled supervision (inputs denoted with multiple possibilities) using standard neural architectures with a softmax as the final layer. We identify a bias phenomenon that can arise from the softmax layer in even simple architectures that prevents proper exploration of alternative options, making the dynamics of gradient descent overly sensitive to initialization. We introduce a novel loss function that allows for unbiased exploration within the space of alternative outputs. We give a theoretical justification for our loss function, and provide an extensive evaluation of its impact on synthetic data, on standard partially labelled benchmarks and on a contributed novel benchmark related to an existing rule learning challenge.


Hierarchical Pretraining for Biomedical Term Embeddings

arXiv.org Artificial Intelligence

Electronic health records (EHR) contain narrative notes that provide extensive details on the medical condition and management of patients. Natural language processing (NLP) of clinical notes can use observed frequencies of clinical terms as predictive features for downstream applications such as clinical decision making and patient trajectory prediction. However, due to the vast number of highly similar and related clinical concepts, a more effective modeling strategy is to represent clinical terms as semantic embeddings via representation learning and use the low dimensional embeddings as feature vectors for predictive modeling. To achieve efficient representation, fine-tuning pretrained language models with biomedical knowledge graphs may generate better embeddings for biomedical terms than those from standard language models alone. These embeddings can effectively discriminate synonymous pairs of from those that are unrelated. However, they often fail to capture different degrees of similarity or relatedness for concepts that are hierarchical in nature. To overcome this limitation, we propose HiPrBERT, a novel biomedical term representation model trained on additionally complied data that contains hierarchical structures for various biomedical terms. We modify an existing contrastive loss function to extract information from these hierarchies. Our numerical experiments demonstrate that HiPrBERT effectively learns the pair-wise distance from hierarchical information, resulting in a substantially more informative embeddings for further biomedical applications