Learning to Answer Multilingual and Code-Mixed Questions
–arXiv.org Artificial Intelligence
Question-answering (QA) that comes naturally to humans is a critical component in seamless human-computer interaction. It has emerged as one of the most convenient and natural methods to interact with the web and is especially desirable in voice-controlled environments. Despite being one of the oldest research areas, the current QA system faces the critical challenge of handling multilingual queries. To build an Artificial Intelligent (AI) agent that can serve multilingual end users, a QA system is required to be language versatile and tailored to suit the multilingual environment. Recent advances in QA models have enabled surpassing human performance primarily due to the availability of a sizable amount of high-quality datasets. However, the majority of such annotated datasets are expensive to create and are only confined to the English language, making it challenging to acknowledge progress in foreign languages. Therefore, to measure a similar improvement in the multilingual QA system, it is necessary to invest in high-quality multilingual evaluation benchmarks. In this dissertation, we focus on advancing QA techniques for handling end-user queries in multilingual environments. This dissertation consists of two parts. In the first part, we explore multilingualism and a new dimension of multilingualism referred to as code-mixing. Second, we propose a technique to solve the task of multi-hop question generation by exploiting multiple documents. Experiments show our models achieve state-of-the-art performance on answer extraction, ranking, and generation tasks on multiple domains of MQA, VQA, and language generation. The proposed techniques are generic and can be widely used in various domains and languages to advance QA systems.
arXiv.org Artificial Intelligence
Nov-14-2022
- Country:
- Asia
- Europe > United Kingdom
- England (0.92)
- North America
- Canada > British Columbia
- United States (1.00)
- Genre:
- Overview (1.00)
- Research Report
- Experimental Study (0.92)
- New Finding (1.00)
- Summary/Review (1.00)
- Industry:
- Leisure & Entertainment > Sports
- Soccer (0.67)
- Health & Medicine > Therapeutic Area (0.67)
- Media > Film (1.00)
- Information Technology (0.67)
- Education > Educational Setting (0.67)
- Energy > Renewable
- Solar (0.67)
- Transportation > Ground (0.92)
- Government > Regional Government
- Automobiles & Trucks > Manufacturer (0.67)
- Leisure & Entertainment > Sports
- Technology:
- Information Technology > Artificial Intelligence
- Machine Learning
- Learning Graphical Models > Directed Networks
- Bayesian Learning (0.67)
- Neural Networks > Deep Learning (1.00)
- Statistical Learning (1.00)
- Learning Graphical Models > Directed Networks
- Natural Language
- Chatbot (1.00)
- Grammars & Parsing (1.00)
- Information Retrieval (1.00)
- Large Language Model (1.00)
- Machine Translation (1.00)
- Question Answering (1.00)
- Text Processing (1.00)
- Representation & Reasoning
- Expert Systems (1.00)
- Personal Assistant Systems (1.00)
- Speech (1.00)
- Machine Learning
- Information Technology > Artificial Intelligence