Goto

Collaborating Authors

 Education


The Surprising Importance of Mathematics in Artificial Intelligence

#artificialintelligence

Artificial intelligence (AI) has been around since the 1950s, but it's only recently that AI has gained the recognition it deserves. This field of study has grown and expanded in recent years, and much of that success can be attributed to the ability to process large amounts of data quickly and efficiently. This in turn leads many people to ask whether mathematics plays an important role in artificial intelligence, which many feel like it doesn't due to its perceived abstract nature. The reality, however, is much different than this perception suggests, and mathematics will always play an important role in AI development. It may seem like today's machines are more advanced than ever before, but artificial intelligence can trace its roots back to ancient Greece.


Few-Shot Semantic Relation Prediction across Heterogeneous Graphs

arXiv.org Artificial Intelligence

Semantic relation prediction aims to mine the implicit relationships between objects in heterogeneous graphs, which consist of different types of objects and different types of links. In real-world scenarios, new semantic relations constantly emerge and they typically appear with only a few labeled data. Since a variety of semantic relations exist in multiple heterogeneous graphs, the transferable knowledge can be mined from some existing semantic relations to help predict the new semantic relations with few labeled data. This inspires a novel problem of few-shot semantic relation prediction across heterogeneous graphs. However, the existing methods cannot solve this problem because they not only require a large number of labeled samples as input, but also focus on a single graph with a fixed heterogeneity. Targeting this novel and challenging problem, in this paper, we propose a Meta-learning based Graph neural network for Semantic relation prediction, named MetaGS. Firstly, MetaGS decomposes the graph structure between objects into multiple normalized subgraphs, then adopts a two-view graph neural network to capture local heterogeneous information and global structure information of these subgraphs. Secondly, MetaGS aggregates the information of these subgraphs with a hyper-prototypical network, which can learn from existing semantic relations and adapt to new semantic relations. Thirdly, using the well-initialized two-view graph neural network and hyper-prototypical network, MetaGS can effectively learn new semantic relations from different graphs while overcoming the limitation of few labeled data. Extensive experiments on three real-world datasets have demonstrated the superior performance of MetaGS over the state-of-the-art methods.


Gradual Domain Adaptation without Indexed Intermediate Domains

arXiv.org Artificial Intelligence

The effectiveness of unsupervised domain adaptation degrades when there is a large discrepancy between the source and target domains. Gradual domain adaptation (GDA) is one promising way to mitigate such an issue, by leveraging additional unlabeled data that gradually shift from the source to the target. Through sequentially adapting the model along the "indexed" intermediate domains, GDA substantially improves the overall adaptation performance. In practice, however, the extra unlabeled data may not be separated into intermediate domains and indexed properly, limiting the applicability of GDA. In this paper, we investigate how to discover the sequence of intermediate domains when it is not already available. Concretely, we propose a coarse-to-fine framework, which starts with a coarse domain discovery step via progressive domain discriminator training. This coarse domain sequence then undergoes a fine indexing step via a novel cycle-consistency loss, which encourages the next intermediate domain to preserve sufficient discriminative knowledge of the current intermediate domain. The resulting domain sequence can then be used by a GDA algorithm. On benchmark data sets of GDA, we show that our approach, which we name Intermediate DOmain Labeler (IDOL), can lead to comparable or even better adaptation performance compared to the pre-defined domain sequence, making GDA more applicable and robust to the quality of domain sequences. Codes are available at https://github.com/hongyouc/IDOL.


Towards Substantive Conceptions of Algorithmic Fairness: Normative Guidance from Equal Opportunity Doctrines

arXiv.org Artificial Intelligence

In this work we use Equal Oppportunity (EO) doctrines from political philosophy to make explicit the normative judgements embedded in different conceptions of algorithmic fairness. We contrast formal EO approaches that narrowly focus on fair contests at discrete decision points, with substantive EO doctrines that look at people's fair life chances more holistically over the course of a lifetime. We use this taxonomy to provide a moral interpretation of the impossibility results as the incompatibility between different conceptions of a fair contest -- foward-facing versus backward-facing -- when people do not have fair life chances. We use this result to motivate substantive conceptions of algorithmic fairness and outline two plausible fair decision procedures based on the luck-egalitarian doctrine of EO, and Rawls's principle of fair equality of opportunity. Equality of Opportunity (EO) is a philosophical doctrine that objects to morally arbitrary and irrelevant factors affecting people's access to desirable positions, and the social goods attached to them (such as opportunity and wealth). In an EO-respecting society, all people, irrespective of their morally arbitrary characteristics, such as socio-economic background, gender, race, or disability status, have comparable access to the opportunities that they desire. Similarly, in fair machine learning (fair-ML), we are usually interested in ensuring that the outputs of algorithmic systems, specially those used in critical social contexts, do not systematically skew along the lines of membership in protected groups based on gender, race, or disability. In so far as protected groups are constructed on the basis of morally arbitrary factors, the moral desiderata of EO doctrines from political philosophy align exactly with the fairness-related concerns in machine learning. In this work, we employ ideas from the rich literature on Equality of Opportunity from political philosophy [1-11] to clarify the normative foundations of fairness and justice-related interventions, and gauge the efficacy of current algorithmic approaches that attempt to codify these criteria. There are two broad principles of EO, namely, the principle of fair contests and the principle of fair life chances. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. The principle of fair contests, commonly understood as the nondiscrimination principle, says that competitions for desirable positions should be open to all and should be adjudicated based on competitors' relevant merits, or qualifications.


Sim-To-Real Transfer of Visual Grounding for Human-Aided Ambiguity Resolution

arXiv.org Artificial Intelligence

Service robots should be able to interact naturally with non-expert human users, not only to help them in various tasks but also to receive guidance in order to resolve ambiguities that might be present in the instruction. We consider the task of visual grounding, where the agent segments an object from a crowded scene given a natural language description. Modern holistic approaches to visual grounding usually ignore language structure and struggle to cover generic domains, therefore relying heavily on large datasets. Additionally, their transfer performance in RGB-D datasets suffers due to high visual discrepancy between the benchmark and the target domains. Modular approaches marry learning with domain modeling and exploit the compositional nature of language to decouple visual representation from language parsing, but either rely on external parsers or are trained in an end-to-end fashion due to the lack of strong supervision. In this work, we seek to tackle these limitations by introducing a fully decoupled modular framework for compositional visual grounding of entities, attributes, and spatial relations. We exploit rich scene graph annotations generated in a synthetic domain and train each module independently. Our approach is evaluated both in simulation and in two real RGB-D scene datasets. Experimental results show that the decoupled nature of our framework allows for easy integration with domain adaptation approaches for Sim-To-Real visual recognition, offering a data-efficient, robust, and interpretable solution to visual grounding in robotic applications.


Top 14 Artificial Intelligence Applications in 2022 - For all the latest on all IT Tech like ERP, Cloud, Bot, AI, IoT,M2M, Netsuite, Salesforce

#artificialintelligence

Artificial Intelligence technology is used to create recommendation engines through which you can engage better with your customers. These recommendations are made in accordance with their browsing history, preference, and interests. It helps in improving your relationship with your customers and their loyalty towards your brand. Virtual shopping assistants and chatbots help improve the user experience while shopping online. Natural Language Processing is used to make the conversation sound as human and personal as possible.


The Full Stack Data Scientist BootCamp

#artificialintelligence

Created by Dr. Bright (PhD Data Science) 123 hours on-demand video course The Full-Stack Data Scientist BootCamp is the ONLY course on Udemy that covers A to Z of lessons that will make you a Data Scientist. Created by Dr. Bright, a Ph.D. in Data Science holder, former Microsoft Senior Data Scientist, and a Visiting Faculty at Worcester Institute, this course covers everything that you need to know to become a Full Stack Data Scientist. The instructors and advisors of the course spent over 13 months creating and vetting the course to make sure it meets the industry and academic standards. With 100 hours of quality course curriculum, this course is the same as we use for our 18 months MS in Data Science program on campus and even more exciting are the Projects in the course to make you more efficient and confident in building Data Science and Artificial Intelligence (AI) products. The motivation is to bring Quality Data Science education to every serious learner at affordable cost.


Deep Learning Masterclass with TensorFlow 2 Over 15 Projects

#artificialintelligence

Introductory Python, to more advanced concepts like Object Oriented Programming, decorators, generators, and even specialized libraries like Numpy & Matplotlib Mastery of the fundamentals of Machine Learning and The Machine Learning Developmment Lifecycle. Linear Regression, Logistic Regression and Neural Networks built from scratch. TensorFlow installation, Basics and training neural networks with TensorFlow 2. Convolutional Neural Networks, Modern ConvNets, training object recognition models with TensorFlow 2. Breast Cancer detection, people counting, object detection with yolo and image segmentation Generative Adversarial neural networks from scratch and image generation Recurrent Neural Networks, Modern RNNs, training sentiment analysis models with TensorFlow 2. Neural Machine Translation, Question Answering, Image Captioning, Sentiment Analysis, Speech recognition Deploying a Deep Learning Model with Google Cloud Function. Linear Regression, Logistic Regression and Neural Networks built from scratch. Convolutional Neural Networks, Modern ConvNets, training object recognition models with TensorFlow 2. In this course, we shall look at core Deep Learning concepts and apply our knowledge to solve real world problems in Computer Vision and Natural Language Processing using the Python Programming Language and TensorFlow 2. We shall explain core Machine Learning topics like Linear Regression, Logistic Regression, Multi-class classification and Neural Networks.


Smart Multi-tenant Federated Learning

arXiv.org Artificial Intelligence

Federated learning (FL) is an emerging distributed machine learning method that empowers in-situ model training on decentralized edge devices. However, multiple simultaneous training activities could overload resource-constrained devices. In this work, we propose a smart multi-tenant FL system, MuFL, to effectively coordinate and execute simultaneous training activities. We first formalize the problem of multi-tenant FL, define multi-tenant FL scenarios, and introduce a vanilla multi-tenant FL system that trains activities sequentially to form baselines. Then, we propose two approaches to optimize multi-tenant FL: 1) activity consolidation merges training activities into one activity with a multi-task architecture; 2) after training it for rounds, activity splitting divides it into groups by employing affinities among activities such that activities within a group have better synergy. Extensive experiments demonstrate that MuFL outperforms other methods while consuming 40% less energy. We hope this work will inspire the community to further study and optimize multi-tenant FL.


Continual Few-Shot Learning with Adversarial Class Storage

arXiv.org Artificial Intelligence

Humans have a remarkable ability to quickly and effectively learn new concepts in a continuous manner without forgetting old knowledge. Though deep learning has made tremendous successes on various computer vision tasks, it faces challenges for achieving such human-level intelligence. In this paper, we define a new problem called continual few-shot learning, in which tasks arrive sequentially and each task is associated with a few training samples. We propose Continual Meta-Learner (CML) to solve this problem. CML integrates metric-based classification and a memory-based mechanism along with adversarial learning into a meta-learning framework, which leads to the desirable properties: 1) it can quickly and effectively learn to handle a new task; 2) it overcomes catastrophic forgetting; 3) it is model-agnostic. We conduct extensive experiments on two image datasets, MiniImageNet and CIFAR100. Experimental results show that CML delivers state-of-the-art performance in terms of classification accuracy on few-shot learning tasks without catastrophic forgetting.