Education
Deep Learning Prerequisites: The Numpy Stack in Python V2
This is Deep Learning, Machine Learning, and Data Science Prerequisites: The Numpy Stack in Python (V2). The reason I made this course is because there is a huge gap for many students between machine learning "theory" and writing actual code. As I've always said: "If you can't implement it, then you don't understand it". Without basic knowledge of data manipulation, vectors, and matrices, students are not able to put their great ideas into working form, on a computer. This course closes that gap by teaching you all the basic operations you need for implementing machine learning and deep learning algorithms.
What is Machine Learning and how is it impacting the world today?
Machine learning is a hot issue in this age of artificial intelligence. Nobody could have predicted that computer vision and predictive analytics would break new ground. Face recognition on smartphones, language translation software, and self-driving cars are all examples of how we are increasingly seeing both of them in our daily lives. What may appear to be science fiction is becoming a reality, and it is only a matter of time before we achieve Artificial General Intelligence. Machine Learning Course in Chennai at FITA Academy provides the best practical sessions to develop your skills technically.
Pinaki Laskar on LinkedIn: #MachineLearning #mathematics #Gametheory
AI Researcher, Cognitive Technologist Inventor - AI Thinking, Think Chain Innovator - AIOT, XAI, Autonomous Cars, IIOT Founder Fisheyebox Spatial Computing Savant, Transformative Leader, Industry X.0 Practitioner Is Game Theory a new approach to solve fundamental #MachineLearning problems? A Branch of applied #mathematics devised to analyze certain situations in which there is an interplay between parties that may have similar, opposed, or mixed interests. In a typical game, or competition with fixed rules, "players" try to outsmart one another by anticipating the others' decisions, or moves. A solution to a game prescribes the optimal strategy or strategies for each player and predicts the average, or expected, outcome. Until a highly contrived counterexample was devised in 1967, it was thought that every contest had at least one solution.
Basics guide to terms AI-ML-DS-DL
Artificial Intelligence (AI) is the field of computer science dedicated to solving cognitive problems commonly associated with human intelligence, such as learning, problem solving, and pattern recognition.AI becomes "smarter" and learns faster with more data, and every day, businesses are generating this fuel for running machine learning and deep learning solutions, whether collected and extracted from a data warehouse. Planning, decision making, identifying objects, recognizing sounds, social & business transactions. Machine learning(ML) is the study of computer algorithms that can improve automatically through experience and by the use of data. Machine learning algorithms build a model based on sample data, known as training data in order to make predictions or decisions without being explicitly programmed to do so. When algorithms are self-learning, the data itself is an asset.
Low-resource Learning with Knowledge Graphs: A Comprehensive Survey
Chen, Jiaoyan, Geng, Yuxia, Chen, Zhuo, Pan, Jeff Z., He, Yuan, Zhang, Wen, Horrocks, Ian, Chen, Huajun
Machine learning methods especially deep neural networks have achieved great success but many of them often rely on a number of labeled samples for training. In real-world applications, we often need to address sample shortage due to e.g., dynamic contexts with emerging prediction targets and costly sample annotation. Therefore, low-resource learning, which aims to learn robust prediction models with no enough resources (especially training samples), is now being widely investigated. Among all the low-resource learning studies, many prefer to utilize some auxiliary information in the form of Knowledge Graph (KG), which is becoming more and more popular for knowledge representation, to reduce the reliance on labeled samples. In this survey, we very comprehensively reviewed over $90$ papers about KG-aware research for two major low-resource learning settings -- zero-shot learning (ZSL) where new classes for prediction have never appeared in training, and few-shot learning (FSL) where new classes for prediction have only a small number of labeled samples that are available. We first introduced the KGs used in ZSL and FSL studies as well as the existing and potential KG construction solutions, and then systematically categorized and summarized KG-aware ZSL and FSL methods, dividing them into different paradigms such as the mapping-based, the data augmentation, the propagation-based and the optimization-based. We next presented different applications, including not only KG augmented tasks in Computer Vision and Natural Language Processing (e.g., image classification, text classification and knowledge extraction), but also tasks for KG curation (e.g., inductive KG completion), and some typical evaluation resources for each task. We eventually discussed some challenges and future directions on aspects such as new learning and reasoning paradigms, and the construction of high quality KGs.
Towards continual task learning in artificial neural networks: current approaches and insights from neuroscience
The innate capacity of humans and other animals to learn a diverse, and often interfering, range of knowledge and skills throughout their lifespan is a hallmark of natural intelligence, with obvious evolutionary motivations. In parallel, the ability of artificial neural networks (ANNs) to learn across a range of tasks and domains, combining and re-using learned representations where required, is a clear goal of artificial intelligence. This capacity, widely described as continual learning, has become a prolific subfield of research in machine learning. Despite the numerous successes of deep learning in recent years, across domains ranging from image recognition to machine translation, such continual task learning has proved challenging. Neural networks trained on multiple tasks in sequence with stochastic gradient descent often suffer from representational interference, whereby the learned weights for a given task effectively overwrite those of previous tasks in a process termed catastrophic forgetting. This represents a major impediment to the development of more generalised artificial learning systems, capable of accumulating knowledge over time and task space, in a manner analogous to humans. A repository of selected papers and implementations accompanying this review can be found at https://github.com/mccaffary/ Several definitions of intelligence have emerged in machine learning literature in recent years (Legg & Hutter, 2007; Tenenbaum et al., 2011). Although many of these differ in particularities, one consistent requirement is that an intelligent agent must have the capacity to accumulate and maintain task proficiency across experiences (Hinton et al., 1986; Hassabis et al., 2017). In contrast to biological agents, existing neural network approaches have proved lacking in this regard, with sequential task learning often resulting in catastrophic forgetting of previously encountered tasks (French, 1999; McCloskey & Cohen, 1989; Ratcliff, 1990).
A Finite Sample Theorem for Longitudinal Causal Inference with Machine Learning: Long Term, Dynamic, and Mediated Effects
I construct and justify confidence intervals for longitudinal causal parameters estimated with machine learning. Longitudinal parameters include long term, dynamic, and mediated effects. I provide a nonasymptotic theorem for any longitudinal causal parameter estimated with any machine learning algorithm that satisfies a few simple, interpretable conditions. The main result encompasses local parameters defined for specific demographics as well as proximal parameters defined in the presence of unobserved confounding. Formally, I prove consistency, Gaussian approximation, and semiparametric efficiency. The rate of convergence is $n^{-1/2}$ for global parameters, and it degrades gracefully for local parameters. I articulate a simple set of conditions to translate mean square rates into statistical inference. A key feature of the main result is a new multiple robustness to ill posedness for proximal causal inference in longitudinal settings.
Socially-Optimal Mechanism Design for Incentivized Online Learning
Wang, Zhiyuan, Gao, Lin, Huang, Jianwei
Multi-arm bandit (MAB) is a classic online learning framework that studies the sequential decision-making in an uncertain environment. The MAB framework, however, overlooks the scenario where the decision-maker cannot take actions (e.g., pulling arms) directly. It is a practically important scenario in many applications such as spectrum sharing, crowdsensing, and edge computing. In these applications, the decision-maker would incentivize other selfish agents to carry out desired actions (i.e., pulling arms on the decision-maker's behalf). This paper establishes the incentivized online learning (IOL) framework for this scenario. The key challenge to design the IOL framework lies in the tight coupling of the unknown environment learning and asymmetric information revelation. To address this, we construct a special Lagrangian function based on which we propose a socially-optimal mechanism for the IOL framework. Our mechanism satisfies various desirable properties such as agent fairness, incentive compatibility, and voluntary participation. It achieves the same asymptotic performance as the state-of-art benchmark that requires extra information. Our analysis also unveils the power of crowd in the IOL framework: a larger agent crowd enables our mechanism to approach more closely the theoretical upper bound of social performance. Numerical results demonstrate the advantages of our mechanism in large-scale edge computing.
Robust Convergence in Federated Learning through Label-wise Clustering
Lee, Hunmin, Liu, Yueyang, Kim, Donghyun, Li, Yingshu
Non-IID dataset and heterogeneous environment of the local clients are regarded as a major issue in Federated Learning (FL), causing a downturn in the convergence without achieving satisfactory performance. In this paper, we propose a novel Label-wise clustering algorithm that guarantees the trainability among geographically dispersed heterogeneous local clients, by selecting only the local models trained with a dataset that approximates into uniformly distributed class labels, which is likely to obtain faster minimization of the loss and increment the accuracy among the FL network. Through conducting experiments on the suggested six common non-IID scenarios, we empirically show that the vanilla FL aggregation model is incapable of gaining robust convergence generating biased pre-trained local models and drifting the local weights to mislead the trainability in the worst case. Moreover, we quantitatively estimate the expected performance of the local models before training, which offers a global server to select the optimal clients, saving additional computational costs. Ultimately, in order to gain resolution of the non-convergence in such non-IID situations, we design clustering algorithms based on local input class labels, accommodating the diversity and assorting clients that could lead the overall system to attain the swift convergence as global training continues. Our paper shows that proposed Label-wise clustering demonstrates prompt and robust convergence compared to other FL algorithms when local training datasets are non-IID or coexist with IID through multiple experiments.
Towards Relatable Explainable AI with the Perceptual Process
Machine learning models need to provide contrastive explanations, since people often seek to understand why a puzzling prediction occurred instead of some expected outcome. Current contrastive explanations are rudimentary comparisons between examples or raw features, which remain difficult to interpret, since they lack semantic meaning. We argue that explanations must be more relatable to other concepts, hypotheticals, and associations. Inspired by the perceptual process from cognitive psychology, we propose the XAI Perceptual Processing Framework and RexNet model for relatable explainable AI with Contrastive Saliency, Counterfactual Synthetic, and Contrastive Cues explanations. We investigated the application of vocal emotion recognition, and implemented a modular multi-task deep neural network to predict and explain emotions from speech. From think-aloud and controlled studies, we found that counterfactual explanations were useful and further enhanced with semantic cues, but not saliency explanations. This work provides insights into providing and evaluating relatable contrastive explainable AI for perception applications.