Africa
Implicit Regularization in Deep Tensor Factorization
Milanesi, Paolo, Kadri, Hachem, Ayache, Stéphane, Artières, Thierry
Attempts of studying implicit regularization associated to gradient descent (GD) have identified matrix completion as a suitable test-bed. Late findings suggest that this phenomenon cannot be phrased as a minimization-norm problem, implying that a paradigm shift is required and that dynamics has to be taken into account. In the present work we address the more general setup of tensor completion by leveraging two popularized tensor factorization, namely Tucker and TensorTrain (TT). We track relevant quantities such as tensor nuclear norm, effective rank, generalized singular values and we introduce deep Tucker and TT unconstrained factorization to deal with the completion task. Experiments on both synthetic and real data show that gradient descent promotes solution with low-rank, and validate the conjecture saying that the phenomenon has to be addressed from a dynamical perspective.
A learning gap between neuroscience and reinforcement learning
Wauthier, Samuel T., Mazzaglia, Pietro, Çatal, Ozan, De Boom, Cedric, Verbelen, Tim, Dhoedt, Bart
Historically, artificial intelligence has drawn much inspiration from neuroscience to fuel advances in the field. However, current progress in reinforcement learning is largely focused on benchmark problems that fail to capture many of the aspects that are of interest in neuroscience today. We illustrate this point by extending a T-maze task from neuroscience for use with reinforcement learning algorithms, and show that state-of-the-art algorithms are not capable of solving this problem. Finally, we point out where insights from neuroscience could help explain some of the issues encountered.
Global Artificial Intelligence (AI) in BFSI Market Research Report 2021 – NeighborWebSJ
Western Market Research-WMR Private Limited is a leading global consulting and market research company in India. We offer business intelligence and support to our client for business growth.We analyze the data and create an algorithm that provides specific insights, which are highly valued in the industry.WMR focus on strategies, future estimations, growth, opportunity analysis, and consumer survey by market experts.We care about the client data privacy and authenticity, Western Market Research has worked hard building our legacy of outstanding service, expertise, efficiency and integrity.
Looking at your phone makes other people do the same, study finds
Looking at your phone makes other people nearby do the same in less than a minute, a new study reveals. Researchers in Italy investigated human'mimicry' or the'chameleon effect' – subconsciously replicating the physical actions of another human. Out of 184 people, half replicated the action of touching and looking at their phone 30 seconds after a subconscious trigger, researchers found. The experts say copying smartphone use is similar to the well-known'contagious yawning' phenomenon, when an individual yawns in response to someone else doing so. Mammals have evolved to subconsciously mimic each others' behaviour without knowing it.
NC State preparing students for artificial intelligence as tech companies come to Triangle
It's something most people use without realizing it. From phones to search engines, social media, and smart devices in homes -- each uses artificial intelligence technology. "When we have our conversational assistance in our homes and we're talking with one of these and we're asking what's the weather going to be like or what's the capital of Tanzania. Those are kind of questions that are easy to answer," said North Carolina State University Distinguished Professor James Lester. Lester is also the Director of the Center for Educational Informatics where they conduct research on AI technologies for education.
Learning Good State and Action Representations via Tensor Decomposition
Ni, Chengzhuo, Zhang, Anru, Duan, Yaqi, Wang, Mengdi
The transition kernel of a continuous-state-action Markov decision process (MDP) admits a natural tensor structure. This paper proposes a tensor-inspired unsupervised learning method to identify meaningful low-dimensional state and action representations from empirical trajectories. The method exploits the MDP's tensor structure by kernelization, importance sampling and low-Tucker-rank approximation. This method can be further used to cluster states and actions respectively and find the best discrete MDP abstraction. We provide sharp statistical error bounds for tensor concentration and the preservation of diffusion distance after embedding.
Attention-augmented Spatio-Temporal Segmentation for Land Cover Mapping
Ghosh, Rahul, Ravirathinam, Praveen, Jia, Xiaowei, Lin, Chenxi, Jin, Zhenong, Kumar, Vipin
The availability of massive earth observing satellite data provide huge opportunities for land use and land cover mapping. However, such mapping effort is challenging due to the existence of various land cover classes, noisy data, and the lack of proper labels. Also, each land cover class typically has its own unique temporal pattern and can be identified only during certain periods. In this article, we introduce a novel architecture that incorporates the UNet structure with Bidirectional LSTM and Attention mechanism to jointly exploit the spatial and temporal nature of satellite data and to better identify the unique temporal patterns of each land cover. We evaluate this method for mapping crops in multiple regions over the world. We compare our method with other state-of-the-art methods both quantitatively and qualitatively on two real-world datasets which involve multiple land cover classes. We also visualise the attention weights to study its effectiveness in mitigating noise and identifying discriminative time period.
An Examination of Fairness of AI Models for Deepfake Detection
Recent studies have demonstrated that deep learning models can discriminate based on protected classes like race and gender. In this work, we evaluate bias present in deepfake datasets and detection models across protected subgroups. Using facial datasets balanced by race and gender, we examine three popular deepfake detectors and find large disparities in predictive performances across races, with up to 10.7% difference in error rate between subgroups. A closer look reveals that the widely used FaceForensics++ dataset is overwhelmingly composed of Caucasian subjects, with the majority being female Caucasians. Our investigation of the racial distribution of deepfakes reveals that the methods used to create deepfakes as positive training signals tend to produce "irregular" faces - when a person's face is swapped onto another person of a different race or gender. This causes detectors to learn spurious correlations between the foreground faces and fakeness. Moreover, when detectors are trained with the Blended Image (BI) dataset from Face X-Rays, we find that those detectors develop systematic discrimination towards certain racial subgroups, primarily female Asians.
CARL-DTN: Context Adaptive Reinforcement Learning based Routing Algorithm in Delay Tolerant Network
Yesuf, Fuad Yimer, Prathap, M.
The term Delay/Disruption-Tolerant Networks (DTN) invented to describe and cover all types of long-delay, disconnected, intermittently connected networks, where mobility and outages or scheduled contacts may be experienced. This environment is characterized by frequent network partitioning, intermittent connectivity, large or variable delay, asymmetric data rate, and low transmission reliability. There have been routing protocols developed in DTN. However, those routing algorithms are design based upon specific assumptions. The assumption makes existing algorithms suitable for specific environment scenarios. Different routing algorithm uses different relay node selection criteria to select the replication node. Too Frequently forwarding messages can result in excessive packet loss and large buffer and network overhead. On the other hand, less frequent transmission leads to a lower delivery ratio. In DTN there is a trade-off off between delivery ratio and overhead. In this study, we proposed context-adaptive reinforcement learning based routing(CARL-DTN) protocol to determine optimal replicas of the message based on the real-time density. Our routing protocol jointly uses a real-time physical context, social-tie strength, and real-time message context using fuzzy logic in the routing decision. Multi-hop forwarding probability is also considered for the relay node selection by employing Q-Learning algorithm to estimate the encounter probability between nodes and to learn about nodes available in the neighbor by discounting reward. The performance of the proposed protocol is evaluated based on various simulation scenarios. The result shows that the proposed protocol has better performance in terms of message delivery ratio and overhead.
Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges
Bronstein, Michael M., Bruna, Joan, Cohen, Taco, Veličković, Petar
The last decade has witnessed an experimental revolution in data science and machine learning, epitomised by deep learning methods. Indeed, many high-dimensional learning tasks previously thought to be beyond reach -- such as computer vision, playing Go, or protein folding -- are in fact feasible with appropriate computational scale. Remarkably, the essence of deep learning is built from two simple algorithmic principles: first, the notion of representation or feature learning, whereby adapted, often hierarchical, features capture the appropriate notion of regularity for each task, and second, learning by local gradient-descent type methods, typically implemented as backpropagation. While learning generic functions in high dimensions is a cursed estimation problem, most tasks of interest are not generic, and come with essential pre-defined regularities arising from the underlying low-dimensionality and structure of the physical world. This text is concerned with exposing these regularities through unified geometric principles that can be applied throughout a wide spectrum of applications. Such a 'geometric unification' endeavour, in the spirit of Felix Klein's Erlangen Program, serves a dual purpose: on one hand, it provides a common mathematical framework to study the most successful neural network architectures, such as CNNs, RNNs, GNNs, and Transformers. On the other hand, it gives a constructive procedure to incorporate prior physical knowledge into neural architectures and provide principled way to build future architectures yet to be invented.