Goto

Collaborating Authors

 Education


Conversational Multi-Hop Reasoning with Neural Commonsense Knowledge and Symbolic Logic Rules

arXiv.org Artificial Intelligence

One of the challenges faced by conversational agents is their inability to identify unstated presumptions of their users' commands, a task trivial for humans due to their common sense. In this paper, we propose a zero-shot commonsense reasoning system for conversational agents in an attempt to achieve this. Our reasoner uncovers unstated presumptions from user commands satisfying a general template of if-(state), then-(action), because-(goal). Our reasoner uses a state-of-the-art transformer-based generative commonsense knowledge base (KB) as its source of background knowledge for reasoning. We propose a novel and iterative knowledge query mechanism to extract multi-hop reasoning chains from the neural KB which uses symbolic logic rules to significantly reduce the search space. Similar to any KBs gathered to date, our commonsense KB is prone to missing knowledge. Therefore, we propose to conversationally elicit the missing knowledge from human users with our novel dynamic question generation strategy, which generates and presents contextualized queries to human users. We evaluate the model with a user study with human users that achieves a 35% higher success rate compared to SOTA.


Distilling Linguistic Context for Language Model Compression

arXiv.org Artificial Intelligence

A computationally expensive and memory intensive neural network lies behind the recent success of language representation learning. Knowledge distillation, a major technique for deploying such a vast language model in resource-scarce environments, transfers the knowledge on individual word representations learned without restrictions. In this paper, inspired by the recent observations that language representations are relatively positioned and have more semantic knowledge as a whole, we present a new knowledge distillation objective for language representation learning that transfers the contextual knowledge via two types of relationships across representations: Word Relation and Layer Transforming Relation. Unlike other recent distillation techniques for the language models, our contextual distillation does not have any restrictions on architectural changes between teacher and student. We validate the effectiveness of our method on challenging benchmarks of language understanding tasks, not only in architectures of various sizes, but also in combination with DynaBERT, the recently proposed adaptive size pruning method.


Online Learning of Network Bottlenecks via Minimax Paths

arXiv.org Machine Learning

The path-specific Another commonly used method for these problems is bottleneck on a path between a source and a target node in a Upper Confidence Bound (UCB) (Auer 2002), which utilizes network is defined as the edge with a maximal cost or weight optimism to balance exploration and exploitation. UCB according to some criterion such as transfer time, load, commute has been adapted to combinatorial settings (Chen, Wang, and time, distance, etc. Then, the goal of bottleneck identification Yuan 2013), and also exists in Bayesian variants (Kaufmann, and avoidance is to find a path whose bottleneck is Cappé, and Garivier 2012). Recently, a variant of UCB has minimal. Thus, one may model bottleneck identification as been studied for bottleneck avoidance problems in a combinatorial the problem of computing the minimax edge over the given pure exploration setting (Du, Kuroki, and Chen network/graph, to obtain an edge with a minimal largest gap 2021). They consider a different problem setting and method between the source and target nodes. Equivalently, it can be than ours, though their bottleneck reward function is similar formulated as a widest path problem or maximum capacity to the one we use in our approximation method.


What Will Online Learning Look Like in 10 Years? Zoom Has Some Ideas - EdSurge News

#artificialintelligence

Last March, Zoom, the ubiquitous online conferencing platform, became a staple of daily life for many students and educators as learning shifted online. Millions downloaded it--and first learned of it--back in early 2020, when lockdowns forced billions of students online, and at least 100,000 schools onto Zoom. But as the company itself will tell you, it didn't spring up overnight. Zoom is actually a decade old, and the first conferences launched in 2012, limited to a mere 15 participants. While post-pandemic growth has slowed as schools resume in-person learning, the company is still flush with cash, reporting over $1 billion in revenue in the second quarter of 2021.


Making Machine Learning: computers think!

#artificialintelligence

Making Machine Learning: computers think! This is a practical machine learning course for people who wan to kickstart their career in Machine learning. This course will give you an understanding of what is machine learning and the concepts related to it. At the end of this course you will learn how to create a simple pipeline for a prediction model and make it feasible for real time deployment.


A Complete Guide on TensorFlow 2.0 using Keras API

#artificialintelligence

A Complete Guide on TensorFlow 2.0 using Keras API, Build Amazing Applications of Deep Learning and Artificial Intelligence in TensorFlow 2.0 Created by Hadelin de Ponteves, Kirill Eremenko, SuperDataScience Team, Luka AnicinPreview this Course - GET COUPON CODE Welcome to Tensorflow 2.0! TensorFlow 2.0 has just been released, and it introduced many features that simplify the model development and maintenance processes. From the educational side, it boosts people's understanding by simplifying many complex concepts. From the industry point of view, models are much easier to understand, maintain, and develop. Deep Learning is one of the fastest growing areas of Artificial Intelligence.


Top Data Science Crash Courses to Shape Your Career in 2021

#artificialintelligence

As the demand for data science professionals grows rapidly, students are looking for data science crash courses to gain the necessary knowledge and high-end skills needed to tackle real-world challenges. Here are the top data science courses for data aspirants to pursue. The program features a five-course series formulated to boost the foundation of data scientists in the areas of machine learning, data science, and statistics. This course is best suited for students wanting to learn big data analysis. The course gives you a deep understanding of statistics, data analysis techniques, machine learning algorithms, and probability.


Deep Learning: Advanced Computer Vision (GANs, SSD, +More!)

#artificialintelligence

Free Coupon Discount - Deep Learning: Advanced Computer Vision (GANs, SSD, More!), VGG, ResNet, Inception, SSD, RetinaNet, Neural Style Transfer, GANs More in Tensorflow, Keras, and Python Created by Lazy Programmer Inc. English [Auto], Italian [Auto] Students also bought Deep Learning: Advanced NLP and RNNs Deep Learning: Convolutional Neural Networks in Python Recommender Systems and Deep Learning in Python Deep Learning: Recurrent Neural Networks in Python PyTorch: Deep Learning and Artificial Intelligence Preview this Udemy Course - GET COUPON CODE Latest update: Instead of SSD, I show you how to use RetinaNet, which is better and more modern. I show you both how to use a pretrained model and how to train one yourself with a custom dataset on Google Colab. This is one of the most exciting courses I've done and it really shows how fast and how far deep learning has come over the years. When I first started my deep learning series, I didn't ever consider that I'd make two courses on convolutional neural networks. I think what you'll find is that, this course is so entirely different from the previous one, you will be impressed at just how much material we have to cover.


Multimodal Data Fusion in High-Dimensional Heterogeneous Datasets via Generative Models

arXiv.org Machine Learning

The commonly used latent space embedding techniques, such as Principal Component Analysis, Factor Analysis, and manifold learning techniques, are typically used for learning effective representations of homogeneous data. However, they do not readily extend to heterogeneous data that are a combination of numerical and categorical variables, e.g., arising from linked GPS and text data. In this paper, we are interested in learning probabilistic generative models from high-dimensional heterogeneous data in an unsupervised fashion. The learned generative model provides latent unified representations that capture the factors common to the multiple dimensions of the data, and thus enable fusing multimodal data for various machine learning tasks. Following a Bayesian approach, we propose a general framework that combines disparate data types through the natural parameterization of the exponential family of distributions. To scale the model inference to millions of instances with thousands of features, we use the Laplace-Bernstein approximation for posterior computations involving nonlinear link functions. The proposed algorithm is presented in detail for the commonly encountered heterogeneous datasets with real-valued (Gaussian) and categorical (multinomial) features. Experiments on two high-dimensional and heterogeneous datasets (NYC Taxi and MovieLens-10M) demonstrate the scalability and competitive performance of the proposed algorithm on different machine learning tasks such as anomaly detection, data imputation, and recommender systems.


An Algorithm for Generating Gap-Fill Multiple Choice Questions of an Expert System

arXiv.org Artificial Intelligence

This research is aimed to propose an artificial intelligence algorithm comprising an ontology-based design, text mining, and natural language processing for automatically generating gap-fill multiple choice questions (MCQs). The simulation of this research demonstrated an application of the algorithm in generating gap-fill MCQs about software testing. The simulation results revealed that by using 103 online documents as inputs, the algorithm could automatically produce more than 16 thousand valid gap-fill MCQs covering a variety of topics in the software testing domain. Finally, in the discussion section of this paper we suggest how the proposed algorithm should be applied to produce gap-fill MCQs being collected in a question pool used by a knowledge expert system.