Goto

Collaborating Authors

 Country


AI Ethics doesn't exist

#artificialintelligence

Is Artificial intelligence (A.I) a revolution or a war? Do we really need more metaphors to describe it? Nowadays, A.I dictates what information is presented to us on social media, which ads we see, and what prices we're offered both on and offline. An algorithm can technically write and analyse books, beat humans at about every game conceivable, make movies, compose classical songs and help magicians perform better tricks. Beyond the arts, it also has the potential to encourage better decision-making, make medical diagnoses, and even solve some of humanity's most pressing challenges. It's intertwining with criminal justice, retail, education, recruiting, healthcare, banking, farming, transportation, warfare, insurance, media… the list goes on. Yet, we're so often busy discussing the ins and outs of whether A.I CAN do something, that we seldom ask if we SHOULD design it at all.


AI and Machine Learning for Healthcare - KDnuggets

#artificialintelligence

The 21st century is only two decades old and it is certain that one of the biggest transformative technologies and enablers for human society of this century is going to be Artificial intelligence (AI). It is a well-established idea that AI and associated services and platforms are set to transform global productivity, working patterns, and lifestyles and create enormous wealth. For example, McKinsey sees it delivering global economic activity of around $13 trillion by 2030. In the short-term, research firm Gartner expects the global AI-based economic activity to increase from about $1.2 trillion in 2018 to about $3.9 Trillion by 2022. It is no secret that this transformation is being, to a large extent, fueled by the powerful Machine Learning (ML) tools and techniques such as Deep Convolutional Networks, Generative Adversarial Networks (GAN), Gradient-boosted-tree models (GBM), Deep Reinforcement Learning (DRL), etc. However, traditional business and technology sectors are not the only fields being impacted by AI.


Covariant raises $40 million funding to provide artificial intelligence for warehouse robots

#artificialintelligence

Robotics and artificial intelligence (AI) provider Covariant is planning to scale up its technology for automated material handling applications across multiple industries, thanks to $40 million in new venture capital funding announced today. Berkeley, California-based Covariant raised the "series B" funding in a deal that was led by Index Ventures, along with Radical Ventures and participation from existing investor Amplify Partners and others. The investment raises the firm's total funding to $67 million, and will be used to accelerate Covariant's partnerships, introduce AI Robotics to new industries, and grow its research, engineering, and commercial teams, the firm said. The latest funding follows Covariant's moves to build partnerships with industrial robotics supplier ABB and with intralogistics systems supplier Knapp, both intended to accelerate the deployment of robotic stations to customers. "As the coronavirus crisis has exposed serious frailty in the global supply chain, we're seeing more demand than ever for our AI Robotics solutions," Peter Chen, Covariant's CEO and co-founder, said in a release.


Deep-learning of Parametric Partial Differential Equations from Sparse and Noisy Data

arXiv.org Artificial Intelligence

Data-driven methods have recently made great progress in the discovery of partial differential equations (PDEs) from spatial-temporal data. However, several challenges remain to be solved, including sparse noisy data, incomplete candidate library, and spatially- or temporally-varying coefficients. In this work, a new framework, which combines neural network, genetic algorithm and adaptive methods, is put forward to address all of these challenges simultaneously. In the framework, a trained neural network is utilized to calculate derivatives and generate a large amount of meta-data, which solves the problem of sparse noisy data. Next, genetic algorithm is utilized to discover the form of PDEs and corresponding coefficients with an incomplete candidate library. Finally, a two-step adaptive method is introduced to discover parametric PDEs with spatially- or temporally-varying coefficients. In this method, the structure of a parametric PDE is first discovered, and then the general form of varying coefficients is identified. The proposed algorithm is tested on the Burgers equation, the convection-diffusion equation, the wave equation, and the KdV equation. The results demonstrate that this method is robust to sparse and noisy data, and is able to discover parametric PDEs with an incomplete candidate library.


Classification vs regression in overparameterized regimes: Does the loss function matter?

arXiv.org Machine Learning

Paradigmatic problems in supervised machine learning (ML) involve predicting an output response from an input, based on patterns extracted from a (training) dataset. In classification, the output response is (finitely) discrete and we need to classify input data into one of these discrete categories. In regression, the output is continuous, typically a real number or a vector. Owing to this important distinction in output response, the two tasks are typically treated differently. The differences in treatment manifest in two phases of modern ML: optimization (training), which consists of an algorithmic procedure to extract a predictor from the training data, typically by minimizing the training loss (also called empirical risk); and generalization (testing), which consists of an evaluation of the obtained predictor on a separate test, or validation, dataset. Traditionally, the choice of loss functions for both phases is starkly different across classification and regression tasks. The squared-loss function is typically used both for the training and the testing phases in regression. In contrast, the hinge or logistic (cross-entropy for multi-class problems) loss functions are typically used in the training phase of classification, while the very different 0-1 loss function is used for testing.


Lifelong Control of Off-grid Microgrid with Model Based Reinforcement Learning

arXiv.org Artificial Intelligence

The lifelong control problem of an off-grid microgrid is composed of two tasks, namely estimation of the condition of the microgrid devices and operational planning accounting for the uncertainties by forecasting the future consumption and the renewable production. The main challenge for the effective control arises from the various changes that take place over time. In this paper, we present an open-source reinforcement framework for the modeling of an off-grid microgrid for rural electrification. The lifelong control problem of an isolated microgrid is formulated as a Markov Decision Process (MDP). We categorize the set of changes that can occur in progressive and abrupt changes. We propose a novel model based reinforcement learning algorithm that is able to address both types of changes. In particular the proposed algorithm demonstrates generalisation properties, transfer capabilities and better robustness in case of fast-changing system dynamics. The proposed algorithm is compared against a rule-based policy and a model predictive controller with look-ahead. The results show that the trained agent is able to outperform both benchmarks in the lifelong setting where the system dynamics are changing over time.


Transforming variables to central normality

arXiv.org Machine Learning

Many real data sets contain features (variables) whose distribution is far from normal (gaussian). Instead, their distribution is often skewed. In order to handle such data it is customary to preprocess the variables to make them more normal. The Box-Cox and Yeo-Johnson transformations are well-known tools for this. However, the standard maximum likelihood estimator of their transformation parameter is highly sensitive to outliers, and will often try to move outliers inward at the expense of the normality of the central part of the data. We propose an automatic preprocessing technique that is robust against such outliers, which transforms the data to central normality. It compares favorably to existing techniques in an extensive simulation study and on real data.


Generalized Bayesian Posterior Expectation Distillation for Deep Neural Networks

arXiv.org Machine Learning

Monte Carlo methods provide one solution to represent neural network parameter posteriors as ensembles of networks, but this requires In this paper, we present a general framework large amounts of both storage and compute time (Neal, for distilling expectations with respect to the 1996; Welling and Teh, 2011). Bayesian posterior distribution of a deep neural network classifier, extending prior work on To help overcome these problems, Balan et al. (2015) introduced the Bayesian Dark Knowledge framework. The a model training method referred to as Bayesian proposed framework takes as input "teacher" Dark Knowledge (BDK). BDK attempts to compress (or and student model architectures and a general distill) the Bayesian posterior predictive distribution induced posterior expectation of interest. The distillation by the full parameter posterior of a "teacher" network method performs an online compression (represented via a set of Mote Carlo samples) into a of the selected posterior expectation using iteratively significantly more compact "student" network. The major generated Monte Carlo samples. We advantage of BDK is that the computational complexity focus on the posterior predictive distribution of prediction at test time is drastically reduced compared and expected entropy as distillation targets. We to directly computing predictions via Monte Carlo averages investigate several aspects of this framework over the set of teacher network samples (the teacher including the impact of uncertainty and the ensemble).


Towards classification parity across cohorts

arXiv.org Machine Learning

Recently, there has been a lot of interest in ensuring algorithmic fairness in machine learning where the central question is how to prevent sensitive information (e.g. knowledge about the ethnic group of an individual) from adding "unfair" bias to a learning algorithm (Feldman et al. (2015), Zemel et al. (2013)). This has led to several debiasing algorithms on word embeddings (Qian et al. (2019) , Bolukbasi et al. (2016)), coreference resolution (Zhao et al. (2018a)), semantic role labeling (Zhao et al. (2017)), etc. Most of these existing work deals with explicit sensitive features such as gender, occupations or race which doesn't work with data where such features are not captured due to privacy concerns. In this research work, we aim to achieve classification parity across explicit as well as implicit sensitive features. We define explicit cohorts as groups of people based on explicit sensitive attributes provided in the data (age, gender, race) whereas implicit cohorts are defined as groups of people with similar language usage. We obtain implicit cohorts by clustering embeddings of each individual trained on the language generated by them using a language model. We achieve two primary objectives in this work : [1.] We experimented and discovered classification performance differences across cohorts based on implicit and explicit features , [2] We improved classification parity by introducing modification to the loss function aimed to minimize the range of model performances across cohorts.


Encryption Inspired Adversarial Defense for Visual Classification

arXiv.org Machine Learning

Conventional adversarial defenses reduce classification accuracy whether or not a model is under attacks. Moreover, most of image processing based defenses are defeated due to the problem of obfuscated gradients. In this paper, we propose a new adversarial defense which is a defensive transform for both training and test images inspired by perceptual image encryption methods. The proposed method utilizes a block-wise pixel shuffling method with a secret key. The experiments are carried out on both adaptive and non-adaptive maximum-norm bounded white-box attacks while considering obfuscated gradients. The results show that the proposed defense achieves high accuracy (91.55 %) on clean images and (89.66 %) on adversarial examples with noise distance of 8/255 on CIFAR-10 dataset. Thus, the proposed defense outperforms state-of-the-art adversarial defenses including latent adversarial training, adversarial training and thermometer encoding.