Goto

Collaborating Authors

 Africa


Will Data Analysts be Replaced by AI? - KDnuggets

#artificialintelligence

It is true that parts of data analytics are being automated every day like visualization and reporting, and I believe the trend will continue well into the future. I can understand this statement because many professions such as call center agents are being replaced by Chat bots and aspiring data analysts are afraid that if they start learning data analytics in a few years' time they too will be out of work. What is good about AI? When used on routine and repetitive tasks AI is very efficient. Finally, when we look at latest developments in "Strong" AI such as GANs, we see that machines can really take us to places we never imagined.


SWAT Watershed Model Calibration using Deep Learning

arXiv.org Artificial Intelligence

Watershed models such as the Soil and Water Assessment Tool (SWAT) consist of high-dimensional physical and empirical parameters. These parameters need to be accurately calibrated for models to produce reliable predictions for streamflow, evapotranspiration, snow water equivalent, and nutrient loading. Existing parameter estimation methods are time-consuming, inefficient, and computationally intensive, with reduced accuracy when estimating high-dimensional parameters. In this paper, we present a fast, accurate, and reliable methodology to calibrate the SWAT model (i.e., 21 parameters) using deep learning (DL). We develop DL-enabled inverse models based on convolutional neural networks to ingest streamflow data and estimate the SWAT model parameters. Hyperparameter tuning is performed to identify the optimal neural network architecture and the nine next best candidates. We use ensemble SWAT simulations to train, validate, and test the above DL models. We estimated the actual parameters of the SWAT model using observational data. We test and validate the proposed DL methodology on the American River Watershed, located in the Pacific Northwest-based Yakima River basin. Our results show that the DL models-based calibration is better than traditional parameter estimation methods, such as generalized likelihood uncertainty estimation (GLUE). The behavioral parameter sets estimated by DL have narrower ranges than GLUE and produce values within the sampling range even under high relative observational errors. This narrow range of parameters shows the reliability of the proposed workflow to estimate sensitive parameters accurately even under noise. Due to its fast and reasonably accurate estimations of process parameters, the proposed DL workflow is attractive for calibrating integrated hydrologic models for large spatial-scale applications.


The Low-Resource Double Bind: An Empirical Study of Pruning for Low-Resource Machine Translation

arXiv.org Artificial Intelligence

A "bigger is better" explosion in the number of parameters in deep neural networks has made it increasingly challenging to make state-of-the-art networks accessible in compute-restricted environments. Compression techniques have taken on renewed importance as a way to bridge the gap. However, evaluation of the trade-offs incurred by popular compression techniques has been centered on high-resource datasets. In this work, we instead consider the impact of compression in a data-limited regime. We introduce the term low-resource double bind to refer to the co-occurrence of data limitations and compute resource constraints. This is a common setting for NLP for low-resource languages, yet the trade-offs in performance are poorly studied. Our work offers surprising insights into the relationship between capacity and generalization in data-limited regimes for the task of machine translation. Our experiments on magnitude pruning for translations from English into Yoruba, Hausa, Igbo and German show that in low-resource regimes, sparsity preserves performance on frequent sentences but has a disparate impact on infrequent ones. However, it improves robustness to out-of-distribution shifts, especially for datasets that are very distinct from the training distribution. Our findings suggest that sparsity can play a beneficial role at curbing memorization of low frequency attributes, and therefore offers a promising solution to the low-resource double bind.


A Survey on Evidential Deep Learning For Single-Pass Uncertainty Estimation

arXiv.org Machine Learning

Popular approaches for quantifying predictive uncertainty in deep neural networks often involve a set of weights or models, for instance via ensembling or Monte Carlo Dropout. These techniques usually produce overhead by having to train multiple model instances or do not produce very diverse predictions. This survey aims to familiarize the reader with an alternative class of models based on the concept of Evidential Deep Learning: For unfamiliar data, they admit "what they don't know" and fall back onto a prior belief. Furthermore, they allow uncertainty estimation in a single model and forward pass by parameterizing distributions over distributions. This survey recapitulates existing works, focusing on the implementation in a classification setting. Finally, we survey the application of the same paradigm to regression problems. We also provide a reflection on the strengths and weaknesses of the mentioned approaches compared to existing ones and provide the most central theoretical results in order to inform future research.


5G & The Future Of Connectivity

#artificialintelligence

The next generation of wireless technology could affect a wide range of industries, from healthcare to financial services to retail. The technology enables faster data transfer speeds -- up to 10x faster than the speeds achievable with older standards -- lower latency, and greater network capacity. As a result, 5G creates a tremendous opportunity for numerous industries, but also sets the stage for large-scale disruption. Download the free report to understand what 5G is, the industries it's disrupting, and the drivers paving the way for its implementation. As of June 2021, commercial 5G services have already been deployed across more than 1,500 cities in 60 countries worldwide, according to Viavi Solutions. The number of IoT devices -- which will rely on 5G to transmit vast amounts of data in real time -- is projected to grow from 12B in 2020 to 30B in 2025, per IoT Analytics, more than 4 devices for every person on Earth. Executives across industries are already jostling to take advantage of 5G tech -- and avoid being disrupted by it. Earnings call mentions of 5G have soared in recent years. From enabling remote robotic surgery and autonomous cars to improving crop management, 5G is poised to transform many of the world's biggest industries. The impact of 5G on manufacturing could be huge. It's estimated that improved connectivity through 5G will create $13T in global economic value across industries by 2035, according to IHS Markit. A third of that total is projected to come from the manufacturing sector alone. This would enable manufacturers to build "smart factories" that rely on automation, augmented reality, and IoT. And with 5G powering large amounts of IoT devices and sensors around the factory, artificial intelligence can be integrated more deeply with operations. On fast-paced assembly lines, even microseconds of latency can cause costly disruptions for the manufacturer.


Enterprise Artificial Intelligence (AI) Market 2021-2028: – Today Newspaper

#artificialintelligence

An exploratory survey of the key coordinates of the Enterprise Artificial Intelligence (AI) market strategically describes multiple aspects of the industry through a systematically organised data representation followed by extracting deepest information from various reliable sources. It compiles a series of statistically significant data explaining the Enterprise Artificial Intelligence (AI) market size and volume ratios coupled with the market infrastructure specifications delivering the market estimation and metrics along with industry valuation. The study intends to deliver an all-inclusive market analysis offering optimum client satisfaction. It delivers a highly informative and relevant market study offering valuable insights into the Enterprise Artificial Intelligence (AI) market growth and development. The forecast represented in the market study helps picture the growth predictions realistically determined based on current growth determinants.


The 4 Trends That Prevail on the Gartner Hype Cycle for AI, 2021

#artificialintelligence

For the majority of organizations, continuously delivering and integrating AI solutions within enterprise applications and business workflows is a complex afterthought. On average, it takes about eight months to get an AI-based model integrated within a business workflow and for it to deliver tangible value. However, to reduce AI project failures, organizations must efficiently operationalize their AI architectures. Gartner expects that by 2025, 70% of organizations will have operationalized AI architectures due to the rapid maturity of AI orchestration initiatives. Organizations should consider model operationalization (ModelOps) for operationalizing AI solutions.


Autoregressive Diffusion Models

arXiv.org Machine Learning

We introduce Autoregressive Diffusion Models (ARDMs), a model class encompassing and generalizing order-agnostic autoregressive models (Uria et al., 2014) and absorbing discrete diffusion (Austin et al., 2021), which we show are special cases of ARDMs under mild assumptions. ARDMs are simple to implement and easy to train. Unlike standard ARMs, they do not require causal masking of model representations, and can be trained using an efficient objective similar to modern probabilistic diffusion models that scales favourably to highly-dimensional data. At test time, ARDMs support parallel generation which can be adapted to fit any given generation budget. We find that ARDMs require significantly fewer steps than discrete diffusion models to attain the same performance. Finally, we apply ARDMs to lossless compression, and show that they are uniquely suited to this task. Contrary to existing approaches based on bits-back coding, ARDMs obtain compelling results not only on complete datasets, but also on compressing single data points. Moreover, this can be done using a modest number of network calls for (de)compression due to the model's adaptable parallel generation. Deep generative models have made great progress in modelling different sources of data, such as images, text and audio. These models have a wide variety of applications, such as denoising, inpainting, translating and representation learning. A popular type of likelihood-based models are Autoregressive Models (ARMs). Although very effective, ARMs require a pre-specified order in which to generate data, which may not be an obvious choice for some data modalities, for example images. Further, although the likelihood of ARMs can be retrieved with a single neural network call, sampling from a model requires the same number of network calls as the dimensionality of the data. Recently, modern probabilistic diffusion models have introduced a new training paradigm: Instead of optimizing the entire likelihood of a datapoint, a component of the likelihood bound can be sampled and optimized instead. Works on diffusion on discrete spaces (Sohl-Dickstein et al., 2015; Hoogeboom et al., 2021; Austin et al., 2021) describe a discrete destruction process for which the Work done during as research intern at Google Brain.


A Theoretical Perspective on Hyperdimensional Computing

Journal of Artificial Intelligence Research

Hyperdimensional (HD) computing is a set of neurally inspired methods for obtaining highdimensional, low-precision, distributed representations of data. These representations can be combined with simple, neurally plausible algorithms to effect a variety of information processing tasks. HD computing has recently garnered significant interest from the computer hardware community as an energy-efficient, low-latency, and noise-robust tool for solving learning problems. In this review, we present a unified treatment of the theoretical foundations of HD computing with a focus on the suitability of representations for learning.


Investigating Health-Aware Smart-Nudging with Machine Learning to Help People Pursue Healthier Eating-Habits

arXiv.org Artificial Intelligence

Food-choices and eating-habits directly contribute to our long-term health. This makes the food recommender system a potential tool to address the global crisis of obesity and malnutrition. Over the past decade, artificial-intelligence and medical researchers became more invested in researching tools that can guide and help people make healthy and thoughtful decisions around food and diet. In many typical (Recommender System) RS domains, smart nudges have been proven effective in shaping users' consumption patterns. In recent years, knowledgeable nudging and incentifying choices started getting attention in the food domain as well. To develop smart nudging for promoting healthier food choices, we combined Machine Learning and RS technology with food-healthiness guidelines from recognized health organizations, such as the World Health Organization, Food Standards Agency, and the National Health Service United Kingdom. In this paper, we discuss our research on, persuasive visualization for making users aware of the healthiness of the recommended recipes. Here, we propose three novel nudging technology, the WHO-BubbleSlider, the FSA-ColorCoading, and the DRCI-MLCP, that encourage users to choose healthier recipes. We also propose a Topic Modeling based portion-size recommendation algorithm. To evaluate our proposed smart-nudges, we conducted an online user study with 96 participants and 92250 recipes. Results showed that, during the food decision-making process, appropriate healthiness cues make users more likely to click, browse, and choose healthier recipes over less healthy ones.