Goto

Collaborating Authors

 Education


Why kids need special protection from AI's influence

#artificialintelligence

Vosloo led the drafting of a new set of guidelines from Unicef designed to help governments and companies develop AI policies that consider children's needs. Released on September 16, the nine new guidelines are the culmination of several consultations held with policymakers, child development researchers, AI practitioners, and kids around the world. They also take into consideration the UN Convention on the Rights of the Child, a human rights treaty ratified in 1989. The guidelines aren't meant to be yet another set of AI principles, many of which already say the same things. In January of this year, a Harvard Berkman Klein Center review of 36 of the most prominent documents guiding national and company AI strategies found eight common themes--among them privacy, safety, fairness, and explainability.


Causal Rule Ensemble: Interpretable Inference of Heterogeneous Treatment Effects

arXiv.org Machine Learning

In environmental epidemiology, it is critically important to identify subpopulations that are most vulnerable to the adverse effects of air pollution so we can develop targeted interventions. In recent years, there have been many methodological developments for addressing heterogeneity of treatment effects in causal inference. A common approach is to estimate the conditional average treatment effect (CATE) for a pre-specified covariate set. However, this approach does not provide an easy-to-interpret tool for identifying susceptible subpopulations or discover new subpopulations that are not defined a priori by the researchers. In this paper, we propose a new causal rule ensemble (CRE) method with two features simultaneously: 1) ensuring interpretability by revealing heterogeneous treatment effect structures in terms of decision rules and 2) providing CATE estimates with high statistical precision similar to causal machine learning algorithms. We provide theoretical results that guarantee consistency of the estimated causal effects for the newly discovered causal rules. Furthermore, via simulations, we show that the CRE method has competitive performance on its ability to discover subpopulations and then accurately estimate the causal effects. We also develop a new sensitivity analysis method that examine robustness to unmeasured confounding bias. Lastly, we apply the CRE method to the study of the effects of long-term exposure to air pollution on the 5-year mortality rate of the New England Medicare-enrolled population in United States. Code is available at https://github.com/kwonsang/causal_rule_ensemble.


RLzoo: A Comprehensive and Adaptive Reinforcement Learning Library

arXiv.org Artificial Intelligence

Recently, we have seen a rapidly growing adoption of Deep Reinforcement Learning (DRL) technologies. Fully achieving the promise of these technologies in practice is, however, extremely difficult. Users have to invest tremendous efforts in building DRL agents, incorporating the agents into various external training environments, and tuning agent implementation/hyper-parameters so that they can reproduce state-of-the-art (SOTA) performance. In this paper, we propose RLzoo, a new DRL library that aims to make it easy to develop and reproduce DRL algorithms. RLzoo has both high-level APIs and low-level APIs, useful for constructing and customising DRL agents, respectively. It has an adaptive agent construction algorithm that can automatically integrate custom RLzoo agents into various external training environments. To help reproduce the results of SOTA algorithms, RLzoo provides rich reference DRL algorithm implementations and effective hyper-parameter settings. Extensive evaluation results show that RLzoo not only outperforms existing DRL libraries in its simplicity of API design; but also provides the largest number of reference DRL algorithm implementations.


Federated Learning with Nesterov Accelerated Gradient Momentum Method

arXiv.org Machine Learning

Federated learning (FL) is a fast-developing technique that allows multiple workers to train a global model based on a distributed dataset. Conventional FL employs gradient descent algorithm, which may not be efficient enough. It is well known that Nesterov Accelerated Gradient (NAG) is more advantageous in centralized training environment, but it is not clear how to quantify the benefits of NAG in FL so far. In this work, we focus on a version of FL based on NAG (FedNAG) and provide a detailed convergence analysis. The result is compared with conventional FL based on gradient descent. One interesting conclusion is that as long as the learning step size is sufficiently small, FedNAG outperforms FedAvg. Extensive experiments based on real-world datasets are conducted, verifying our conclusions and confirming the better convergence performance of FedNAG.


Accelerated Large Batch Optimization of BERT Pretraining in 54 minutes

arXiv.org Machine Learning

BERT has recently attracted a lot of attention in natural language understanding (NLU) and achieved state-of-the-art results in various NLU tasks. However, its success requires large deep neural networks and huge amount of data, which result in long training time and impede development progress. Using stochastic gradient methods with large mini-batch has been advocated as an efficient tool to reduce the training time. Along this line of research, LAMB is a prominent example that reduces the training time of BERT from 3 days to 76 minutes on a TPUv3 Pod. In this paper, we propose an accelerated gradient method called LANS to improve the efficiency of using large mini-batches for training. As the learning rate is theoretically upper bounded by the inverse of the Lipschitz constant of the function, one cannot always reduce the number of optimization iterations by selecting a larger learning rate. In order to use larger mini-batch size without accuracy loss, we develop a new learning rate scheduler that overcomes the difficulty of using large learning rate. Using the proposed LANS method and the learning rate scheme, we scaled up the mini-batch sizes to 96K and 33K in phases 1 and 2 of BERT pretraining, respectively. It takes 54 minutes on 192 AWS EC2 P3dn.24xlarge instances to achieve a target F1 score of 90.5 or higher on SQuAD v1.1, achieving the fastest BERT training time in the cloud.



Future of AI Part 2

#artificialintelligence

This part of the series looks at the future of AI with much of the focus in the period after 2025. The leading AI researcher, Geoff Hinton, stated that it is very hard to predict what advances AI will bring beyond five years, noting that exponential progress makes the uncertainty too great. This article will therefore consider both the opportunities as well as the challenges that we will face along the way across different sectors of the economy. It is not intended to be exhaustive. AI deals with the area of developing computing systems which are capable of performing tasks that humans are very good at, for example recognising objects, recognising and making sense of speech, and decision making in a constrained environment. Some of the classical approaches to AI include (non-exhaustive list) Search algorithms such as Breath-First, Depth-First, Iterative Deepening Search, A* algorithm, and the field of Logic including Predicate Calculus and Propositional Calculus. Local Search approaches were also developed for example Simulated Annealing, Hill Climbing (see also Greedy), Beam Search and Genetic Algorithms (see below). Machine Learning is defined as the field of AI that applies statistical methods to enable computer systems to learn from the data towards an end goal. The term was introduced by Arthur Samuel in 1959. A non-exhaustive list of examples of techniques include Linear Regression, Logistic Regression, K-Means, k-Nearest Neighbour (kNN), Naive Bayes, Support Vector Machine (SVM), Decision Trees, Random Forests, XG Boost, Light Gradient Boosting Machine (LightGBM), CatBoost. Deep Learning refers to the field of Neural Networks with several hidden layers. Such a neural network is often referred to as a deep neural network. Neural Networks are biologically inspired networks that extract abstract features from the data in a hierarchical fashion.


30 Best Edureka Free Courses, Tutorial & Certification 2020

#artificialintelligence

Are you looking for the Best Edureka Courses 2020? Edureka is an online technical training platform that offers Big Data, cloud computing, artificial intelligence, and blockchain-based courses. The classes can be attended to at any place and any time as per your choice Use our Android and iOS App to learn on the go. Their engaging learning platform, expert industry practitioners, and support ninjas make sure that you complete the course. Get lifetime accesses to the entire content including quizzes and assignments as the technology upgrades your content gets updated at no cost? Choose from a number of batches as per your convenience if you got something urgent to do, reschedule your batch for a later time. If you want to get started with top Edureka free courses check out the Edureka course catalog from the Edureka site. You will get tons of free courses online Edureka on the Edureka platform.


6 Resources for teaching about Artificial Intelligence

#artificialintelligence

The interest in Artificial Intelligence (AI) has grown so much in the past few months, with news alerts and updates about how Artificial Intelligence is being used in almost every area of life. Last year, Information Week published a "10 Prime Industries for AI Applications" and it was interesting to read how much AI is already being used in the world. There are applications for AI in business, education, the legal field, healthcare, manufacturing, military, politics, science; and the use of AI continues to evolve at a rapid pace. Approximately 77% of people are using AI every day while only 33% of consumers think that they are. Think about some of your daily activities when it comes to communication, transportation, or shopping, for a few examples.


Data Science with Python Course : Hands-on Data Science 2020

#artificialintelligence

Data Science with Python Course: Hands-on Data Science 2020 Numpy, Pandas, Matplotlib, Scikit-Learn, WebScraping, Data Science, Machine Learning, Pyspark, statistics, Data Science What you'll learn Welcome to Complete Ultimate course guide on Data Science and Machine learning with Python. How Android speech Recognition or Apple siri understand your speech signal with such high accuracy. If you would like algorithm or technology running behind that, This is first course to get started in this direction. This course has more than 100 - 5 star rating. "This is a truly great course! It covers far more than it's written in its name: many data science libraries, frameworks, techniques, tips, starting from basics to advanced level topics. "This course has taught me many things I wanted to know about pandas.