Goto

Collaborating Authors

 South America


Knowledge Infused Learning (K-IL): Towards Deep Incorporation of Knowledge in Deep Learning

arXiv.org Artificial Intelligence

Learning the underlying patterns in the data goes beyond instance-based generalization to some external knowledge represented in structured graphs or networks. Deep Learning (DL) has shown significant advances in probabilistically learning latent patterns in the data using a multi-layered network of computational nodes (i.e. neurons/hidden units). However, with the tremendous amount of training data, uncertainty in generalization on domain-specific tasks, and delta improvement with an increase in complexity of models seem to raise a concern on the features learned by the model. As incorporation of domain specific knowledge will aid in supervising the learning of features for the model, infusion of knowledge from knowledge graphs within hidden layers will further enhance the learning process. Although much work remains, we believe that KGs will play an increasing role in developing hybrid neuro-symbolic intelligent systems (that is bottom up deep learning with top down symbolic computing) as well as in building explainable AI systems for which KGs will provide a scaffolding for punctuating neural computing. In this position paper, we describe our motivation for such hybrid approach and a framework that combines knowledge graph and neural networks.


My Journey South: Tracing developments on Artificial Intelligence (AI) in Latin America and the Caribbean – SRC

#artificialintelligence

While some still consider AI to be beyond the grasp of developing countries, our South American neighbours have been shattering that stereotype. AI is being deployed in a number of their endeavours: to speed up artefact findings in Peru; to increase crop yields in Colombian rice fields through AI-powered platforms; to boost security and enhance customer service in Brazil's banking sector; to create vegan alternatives with the same taste and texture as animal-based foods in Chile's food industry; to predict school dropouts and teenage pregnancy in Argentina; and to forecast crimes in Uruguay. Some of the push in AI adoption in these countries has come from academics and researchers, like the ones at the University of Sao Paulo who are developing AI to determine the susceptibility of patients to disease outbreaks; or Peru's National Engineering University where robots are being used for mine exploration to detect gases; or Argentina's National Scientific and Technical Research Council where AI software is predicting early onset pluripotent stem cell differentiation. These and other truths were revealed to me at a Latin America and Caribbean (LAC) Workshop on AI organized by Facebook and the Inter-American Development Bank in Montevideo, Uruguay, in November this year. I was the lone Caribbean participant in attendance, presenting my paper entitled: AI & The Caribbean: A Discussion on Potential Applications & Ethical Considerations, on behalf of the Shridath Ramphal Centre (UWI, Cave Hill).


A Surrogate Video-Based Safety Methodology for Diagnosis and Evaluation of Low-Cost Pedestrian-Safety Countermeasures: The Case of Cochabamba, Bolivia

#artificialintelligence

Due to a lack of reliable data collection systems, traffic fatalities and injuries are often under-reported in developing countries. Recent developments in surrogate road safety methods and video analytics tools offer an alternative approach that can be both lower cost and more time efficient when crash data is incomplete or missing. However, very few studies investigating pedestrian road safety in developing countries using these approaches exist. This research uses an automated video analytics tool to develop and analyze surrogate traffic safety measures and to evaluate the effectiveness of temporary low-cost countermeasures at selected pedestrian crossings at risky intersections in the city of Cochabamba, Bolivia. Specialized computer vision software is used to process hundreds of hours of video data and generate data on road users' speed and trajectories.


futureofwork _2019-11-26_19-00-43.xlsx

#artificialintelligence

The graph represents a network of 3,989 Twitter users whose tweets in the requested range contained "futureofwork ", or who were replied to or mentioned in those tweets. The network was obtained from the NodeXL Graph Server on Wednesday, 27 November 2019 at 03:02 UTC. The requested start date was Monday, 25 November 2019 at 01:01 UTC and the maximum number of days (going backward) was 14. The maximum number of tweets collected was 5,000. The tweets in the network were tweeted over the 3-day, 1-hour, 59-minute period from Thursday, 21 November 2019 at 23:00 UTC to Monday, 25 November 2019 at 01:00 UTC.


AI has a bias problem. Barring African experts from a conference in Canada won't help

#artificialintelligence

London (CNN Business)Some of the leading artificial intelligence experts from Africa and South America have been denied visas to attend a major industry conference in Canada, dealing a setback to efforts to prevent bias from taking root in the new technology. Conference organizers say Canadian immigration authorities have denied visas to two dozen academics from countries such as Nigeria and Brazil, preventing them from attending the event next month in Vancouver. Katherine Heller, a professor who serves as co-chair of diversity and inclusion at the Neural Information Processing Systems conference, said organizers "are trying extremely hard" to have the visa denials overturned. "It is very significant for the field of AI that all voices be heard," she said. The problem of algorithmic bias in data science has become more pronounced, and there's mounting evidence that AI-powered algorithms display bias against women and some racial groups.


AI magic bean could save farmers millions

#artificialintelligence

Farmers across the world could jack up giant profits using an Artificial Intelligence soil monitoring system developed at Brunel University London. By collecting data about soil and growing conditions, the'magic bean' helps farmers boost crops, cut waste and save time, money and water. It comes after France this year saw record temperatures of 49.5 ºC, the US had its wettest spring since 1995 and severe frost threatened Brazil's coffee harvest. The Brunel algorithms could help producers work around freak weather triggered by climate change and unplanned supply problems after Brexit. "We have a way of using data to make crops grow better, worldwide," said electronic engineer Dr Tatiana Kalganova.


Financial Time Series Forecasting with Deep Learning : A Systematic Literature Review: 2005-2019

arXiv.org Machine Learning

Financial time series forecasting is, without a doubt, the top choice of computational intelligence for finance researchers from both academia and financial industry due to its broad implementation areas and substantial impact. Machine Learning (ML) researchers came up with various models and a vast number of studies have been published accordingly. As such, a significant amount of surveys exist covering ML for financial time series forecasting studies. Lately, Deep Learning (DL) models started appearing within the field, with results that significantly outperform traditional ML counterparts. Even though there is a growing interest in developing models for financial time series forecasting research, there is a lack of review papers that were solely focused on DL for finance. Hence, our motivation in this paper is to provide a comprehensive literature review on DL studies for financial time series forecasting implementations. We not only categorized the studies according to their intended forecasting implementation areas, such as index, forex, commodity forecasting, but also grouped them based on their DL model choices, such as Convolutional Neural Networks (CNNs), Deep Belief Networks (DBNs), Long-Short Term Memory (LSTM). We also tried to envision the future for the field by highlighting the possible setbacks and opportunities, so the interested researchers can benefit.


Applications of the Deep Galerkin Method to Solving Partial Integro-Differential and Hamilton-Jacobi-Bellman Equations

arXiv.org Machine Learning

We extend the Deep Galerkin Method (DGM) introduced in Sirignano and Spiliopoulos (2018) to solve a number of partial differential equations (PDEs) that arise in the context of optimal stochastic control and mean field games. First, we consider PDEs where the function is constrained to be positive and integrate to unity, as is the case with Fokker-Planck equations. Our approach involves reparameterizing the solution as the exponential of a neural network appropriately normalized to ensure both requirements are satisfied. This then gives rise to a partial integro-differential equation (PIDE) where the integral appearing in the equation is handled using importance sampling. Secondly, we tackle a number of Hamilton-Jacobi-Bellman (HJB) equations that appear in stochastic optimal control problems. The key contribution is that these equations are approached in their unsimplified primal form which includes an optimization problem as part of the equation. We extend the DGM algorithm to solve for the value function and the optimal control simultaneously by characterizing both as deep neural networks. Training the networks is performed by taking alternating stochastic gradient descent steps for the two functions, a technique similar in spirit to policy improvement algorithms.


Learning Likelihoods with Conditional Normalizing Flows

arXiv.org Machine Learning

Such behavior is desirable in multivariate structured prediction tasks, where handcrafted per-pixel loss-based methods inadequately capture strong correlations between output dimensions. CNFs are efficient in sampling and inference, they can be trained with a likelihood-based objective, and CNFs, being generative flows, do not suffer from mode collapse or training instabilities. We provide an effective method to train continuous CNFs for binary problems and in particular, we apply these CNFs to super-resolution and vessel segmentation tasks demonstrating competitive performance on standard benchmark datasets in terms of likelihood and conventional metrics. When the output y is high-dimensional this is a particularly challenging task, and the practitioner is left with many design choices. Do we factorize the conditional? If not, do we model correlations with, say, a conditional random field (Prince, 2012)? Do we use a unimodal distribution? How fat should the tails be? Do we use an explicit likelihood at all, or use implicit methods (Mohamed & Rezende, 2015) such as a GAN (Goodfellow et al., 2014)? Do we quantize the output?


Procedural Content Generation: From Automatically Generating Game Levels to Increasing Generality in Machine Learning

arXiv.org Artificial Intelligence

The idea behind procedural content generation (PCG) in games is to create content automatically, using algorithms, instead of relying on user-designed content. While PCG approaches have traditionally focused on creating content for video games, they are now being applied to all kinds of virtual environments, thereby enabling training of machine learning systems that are significantly more general. For example, PCG's ability to generate never-ending streams of new levels has allowed DeepMind's Capture the Flag agent to reach beyond human-level-performance. Additionally, PCG-inspired methods such as domain randomization enabled OpenAI's robot arm to learn to manipulate objects with unprecedented dexterity. Level generation in 2D arcade games has also illuminated some shortcomings of standard deep RL methods, suggesting potential ways to train more general policies. This Review looks at key aspect of PCG approaches, including its ability to (1) enable new video games (such as No Man's Sky), (2) create open-ended learning environments, (3) combat overfitting in supervised and reinforcement learning tasks, and (4) create better benchmarks that could ultimately spur the development of better learning algorithms. We hope this article can introduce the broader machine learning community to PCG, which we believe will be a critical tool in creating a more general machine intelligence.