Goto

Collaborating Authors

 Education


We Are Underestimating Artificial Intelligence and BCI

#artificialintelligence

We all know that AI is already in place in our daily lives. It enables the processing of very large data sets, learns from daily life, helps us to both create and identify "deepfakes" and promises to replace millions of jobs in the coming few years. Of course, there are prototype autonomous cars -- even self-driving buses operating on some university campuses. In the sphere of learning, artificial intelligence drives adaptive learning models today that can personalize the learning experience. This is not a trivial advancement.


Artificial Intelligence and the Environmental Crisis

#artificialintelligence

A free introductory session is offered to anyone new to online learning. Artificial Intelligence and The Environmental Crisis: Can technology really save the world? Based on his latest book of the same title, Dr Keith Skene explores the history of artificial intelligence, its contributions to humanity and the dangers it may pose. We'll encounter many interesting characters, key events and controversial moments associated with this rapidly developing field. We'll then explore what human intelligence is and how other forms of intelligence (including plant, animal, bacterial and ecosystem intelligence) offer alternative ways of thinking.


Artificial Intelligence Books for Beginners

#artificialintelligence

Artificial Intelligence (AI) has taken the world by storm. Almost every industry across the globe is incorporating AI for a variety of applications and use cases. Some of its wide range of applications includes process automation, predictive analysis, fraud detection, improving customer experience, etc. To learn more about AI and it's concepts, you can start by reading the Top Artificial Intelligence Books for self-learning. AI is being foreseen as the future of technological and economic development.


Machine Learning Force Fields

arXiv.org Machine Learning

In recent years, the use of Machine Learning (ML) in computational chemistry has enabled numerous advances previously out of reach due to the computational complexity of traditional electronic-structure methods. One of the most promising applications is the construction of ML-based force fields (FFs), with the aim to narrow the gap between the accuracy of ab initio methods and the efficiency of classical FFs. The key idea is to learn the statistical relation between chemical structure and potential energy without relying on a preconceived notion of fixed chemical bonds or knowledge about the relevant interactions. Such universal ML approximations are in principle only limited by the quality and quantity of the reference data used to train them. This review gives an overview of applications of ML-FFs and the chemical insights that can be obtained from them. The core concepts underlying ML-FFs are described in detail and a step-by-step guide for constructing and testing them from scratch is given. The text concludes with a discussion of the challenges that remain to be overcome by the next generation of ML-FFs.


Theoretical bounds on estimation error for meta-learning

arXiv.org Machine Learning

Machine learning models have traditionally been developed under the assumption that the training and test distributions match exactly. However, recent success in few-shot learning and related problems are encouraging signs that these models can be adapted to more realistic settings where train and test distributions differ. Unfortunately, there is severely limited theoretical support for these algorithms and little is known about the difficulty of these problems. In this work, we provide novel information-theoretic lower-bounds on minimax rates of convergence for algorithms that are trained on data from multiple sources and tested on novel data. Our bounds depend intuitively on the information shared between sources of data, and characterize the difficulty of learning in this setting for arbitrary algorithms. We demonstrate these bounds on a hierarchical Bayesian model of meta-learning, computing both upper and lower bounds on parameter estimation via maximum-a-posteriori inference.


Weight Squeezing: Reparameterization for Compression and Fast Inference

arXiv.org Machine Learning

In this work, we present a novel approach for simultaneous knowledge transfer and model compression called Weight Squeezing. With this method, we perform knowledge transfer from a pre-trained teacher model by learning the mapping from its weights to smaller student model weights, without significant loss of model accuracy. We applied Weight Squeezing combined with Knowledge Distillation to a pre-trained text classification model, and compared it to various knowledge transfer and model compression methods on several downstream text classification tasks. We observed that our approach produces better results than Knowledge Distillation methods without any loss in inference speed. We also compared Weight Squeezing with Low Rank Factorization methods and observed that our method is significantly faster at inference while being competitive in terms of accuracy.


Distributional Generalization: A New Kind of Generalization

arXiv.org Machine Learning

We introduce a new notion of generalization -- Distributional Generalization -- which roughly states that outputs of a classifier at train and test time are close *as distributions*, as opposed to close in just their average error. For example, if we mislabel 30% of dogs as cats in the train set of CIFAR-10, then a ResNet trained to interpolation will in fact mislabel roughly 30% of dogs as cats on the *test set* as well, while leaving other classes unaffected. This behavior is not captured by classical generalization, which would only consider the average error and not the distribution of errors over the input domain. Our formal conjectures, which are much more general than this example, characterize the form of distributional generalization that can be expected in terms of problem parameters: model architecture, training procedure, number of samples, and data distribution. We give empirical evidence for these conjectures across a variety of domains in machine learning, including neural networks, kernel machines, and decision trees. Our results thus advance our empirical understanding of interpolating classifiers.


Temperature check: theory and practice for training models with softmax-cross-entropy losses

arXiv.org Artificial Intelligence

The softmax function combined with a cross-entropy loss is a principled approach to modeling probability distributions that has become ubiquitous in deep learning. The softmax function is defined by a lone hyperparameter, the temperature, that is commonly set to one or regarded as a way to tune model confidence after training; however, less is known about how the temperature impacts training dynamics or generalization performance. In this work we develop a theory of early learning for models trained with softmax-cross-entropy loss and show that the learning dynamics depend crucially on the inverse-temperature $\beta$ as well as the magnitude of the logits at initialization, $||\beta{\bf z}||_{2}$. We follow up these analytic results with a large-scale empirical study of a variety of model architectures trained on CIFAR10, ImageNet, and IMDB sentiment analysis. We find that generalization performance depends strongly on the temperature, but only weakly on the initial logit magnitude. We provide evidence that the dependence of generalization on $\beta$ is not due to changes in model confidence, but is a dynamical phenomenon. It follows that the addition of $\beta$ as a tunable hyperparameter is key to maximizing model performance. Although we find the optimal $\beta$ to be sensitive to the architecture, our results suggest that tuning $\beta$ over the range $10^{-2}$ to $10^1$ improves performance over all architectures studied. We find that smaller $\beta$ may lead to better peak performance at the cost of learning stability.


Data Science Course 2021: Complete Machine Learning Training

#artificialintelligence

Created by Data-Driven Science Preview this Udemy Course - GET COUPON CODE " We will shift from a mobile first to an AI first world." AI will transform every industry similar to electricity over 100 years ago and have a huge impact on how humans live and work in the future. Moving into Data Science is an amazing career choice. There's high demand for Data Scientists across the globe and people working in the field enjoy high salaries and rewarding careers. For instance, average annual salaries are around $125,000 in America and ₹14 lacs in India.


IIT-Jodhpur launches BTech in artificial intelligence, data science

#artificialintelligence

The Indian Institute of Technology (IIT) Jodhpur will offer a new undergraduate programme in artificial intelligence and data science from the academic session 2020-21. The new BTech programme will have courses in computer science, mathematics, artificial intelligence, machine learning, data science, and their applications in various domains. Students who opt for the course can also take a specialisation in areas including visual computing, socio-digital realities, language technologies, robotics, and the Artificial Intelligence of Things. Students will also have the option to pursue MBA (tech) in the fifth year as dual-degree option in the School of Management and Entrepreneurship, the IIT said in an official release. Prof Santanu Chaudhury, Director, IIT-Jodhpur, said: "Under the broad umbrella of IIT Jodhpur's unique proposition of AI for everything, students belonging to the academic programmes in AI, Data and Computational Sciences will be part of scientific innovations for solving local and global engineering and social problems in close collaboration with industry. Students will be part of the institute's initiatives for ensuring better life and livelihood for all with AI as the enabling force. IIT-Jodhpur would like AI and Data Science students to explore transdisciplinary research agenda fostering collaborative opportunities across all the departments of IIT Jodhpur and partner organisations."