Africa
Learning to solve arithmetic problems with a virtual abacus
Petruzzellis, Flavio, Chen, Ling Xuan, Testolin, Alberto
Acquiring mathematical skills is considered a key challenge for modern Artificial Intelligence systems. Inspired by the way humans discover numerical knowledge, here we introduce a deep reinforcement learning framework that allows to simulate how cognitive agents could gradually learn to solve arithmetic problems by interacting with a virtual abacus. The proposed model successfully learn to perform multi-digit additions and subtractions, achieving an error rate below 1% even when operands are much longer than those observed during training. We also compare the performance of learning agents receiving a different amount of explicit supervision, and we analyze the most common error patterns to better understand the limitations and biases resulting from our design choices.
Follow Us and Become Famous! Insights and Guidelines From Instagram Engagement Mechanisms
Tricomi, Pier Paolo, Chilese, Marco, Conti, Mauro, Sadeghi, Ahmad-Reza
With 1.3 billion users, Instagram (IG) has also become a business tool. IG influencer marketing, expected to generate $33.25 billion in 2022, encourages companies and influencers to create trending content. Various methods have been proposed for predicting a post's popularity, i.e., how much engagement (e.g., Likes) it will generate. However, these methods are limited: first, they focus on forecasting the likes, ignoring the number of comments, which became crucial in 2021. Secondly, studies often use biased or limited data. Third, researchers focused on Deep Learning models to increase predictive performance, which are difficult to interpret. As a result, end-users can only estimate engagement after a post is created, which is inefficient and expensive. A better approach is to generate a post based on what people and IG like, e.g., by following guidelines. In this work, we uncover part of the underlying mechanisms driving IG engagement. To achieve this goal, we rely on statistical analysis and interpretable models rather than Deep Learning (black-box) approaches. We conduct extensive experiments using a worldwide dataset of 10 million posts created by 34K global influencers in nine different categories. With our simple yet powerful algorithms, we can predict engagement up to 94% of F1-Score, making us comparable and even superior to Deep Learning-based method. Furthermore, we propose a novel unsupervised algorithm for finding highly engaging topics on IG. Thanks to our interpretable approaches, we conclude by outlining guidelines for creating successful posts.
Simplex Autoencoders
Bouayed, Aymene Mohammed, Naccache, David
Synthetic data generation is increasingly important due to privacy concerns. While Autoencoder-based approaches have been widely used for this purpose, sampling from their latent spaces can be challenging. Mixture models are currently the most efficient way to sample from these spaces. In this work, we propose a new approach that models the latent space of an Autoencoder as a simplex, allowing for a novel heuristic for determining the number of components in the mixture model. This heuristic is independent of the number of classes and produces comparable results. We also introduce a sampling method based on probability mass functions, taking advantage of the compactness of the latent space. We evaluate our approaches on a synthetic dataset and demonstrate their performance on three benchmark datasets: MNIST, CIFAR-10, and Celeba. Our approach achieves an image generation FID of 4.29, 13.55, and 11.90 on the MNIST, CIFAR-10, and Celeba datasets, respectively. The best AE FID results to date on those datasets are respectively 6.3, 85.3 and 35.6 we hence substantially improve those figures (the lower is the FID the better). However, AEs are not the best performing algorithms on the concerned datasets and all FID records are currently held by GANs. While we do not perform better than GANs on CIFAR and Celeba we do manage to squeeze-out a non-negligible improvement (of 0.21) over the current GAN-held record for the MNIST dataset.
Enforcing Privacy in Distributed Learning with Performance Guarantees
Rizk, Elsa, Vlaski, Stefan, Sayed, Ali H.
We study the privatization of distributed learning and optimization strategies. We focus on differential privacy schemes and study their effect on performance. We show that the popular additive random perturbation scheme degrades performance because it is not well-tuned to the graph structure. For this reason, we exploit two alternative graph-homomorphic constructions and show that they improve performance while guaranteeing privacy. Moreover, contrary to most earlier studies, the gradient of the risks is not assumed to be bounded (a condition that rarely holds in practice; e.g., quadratic risk). We avoid this condition and still devise a differentially private scheme with high probability. We examine optimization and learning scenarios and illustrate the theoretical findings through simulations.
DQNAS: Neural Architecture Search using Reinforcement Learning
Chauhan, Anshumaan, Bhattacharyya, Siddhartha, Vadivel, S.
Convolutional Neural Networks have been used in a variety of image related applications after their rise in popularity due to ImageNet competition. Convolutional Neural Networks have shown remarkable results in applications including face recognition, moving target detection and tracking, classification of food based on the calorie content and many more. Designing of Convolutional Neural Networks requires experts having a cross domain knowledge and it is laborious, which requires a lot of time for testing different values for different hyperparameter along with the consideration of different configurations of existing architectures. Neural Architecture Search is an automated way of generating Neural Network architectures which saves researchers from all the brute-force testing trouble, but with the drawback of consuming a lot of computational resources for a prolonged period. In this paper, we propose an automated Neural Architecture Search framework DQNAS, guided by the principles of Reinforcement Learning along with One-shot Training which aims to generate neural network architectures that show superior performance and have minimum scalability problem.
Detection problems in the spiked matrix models
Jung, Ji Hyung, Chung, Hye Won, Lee, Ji Oon
We study the statistical decision process of detecting the low-rank signal from various signal-plus-noise type data matrices, known as the spiked random matrix models. We first show that the principal component analysis can be improved by entrywise pre-transforming the data matrix if the noise is non-Gaussian, generalizing the known results for the spiked random matrix models with rank-1 signals. As an intermediate step, we find out sharp phase transition thresholds for the extreme eigenvalues of spiked random matrices, which generalize the Baik-Ben Arous-P\'{e}ch\'{e} (BBP) transition. We also prove the central limit theorem for the linear spectral statistics for the spiked random matrices and propose a hypothesis test based on it, which does not depend on the distribution of the signal or the noise. When the noise is non-Gaussian noise, the test can be improved with an entrywise transformation to the data matrix with additive noise. We also introduce an algorithm that estimates the rank of the signal when it is not known a priori.
MANDERA: Malicious Node Detection in Federated Learning via Ranking
Zhu, Wanchuang, Zhao, Benjamin Zi Hao, Luo, Simon, Liu, Tongliang, Deng, Ke
Byzantine attacks hinder the deployment of federated learning algorithms. Although we know that the benign gradients and Byzantine attacked gradients are distributed differently, to detect the malicious gradients is challenging due to (1) the gradient is high-dimensional and each dimension has its unique distribution and (2) the benign gradients and the attacked gradients are always mixed (two-sample test methods cannot apply directly). To address the above, for the first time, we propose MANDERA which is theoretically guaranteed to efficiently detect all malicious gradients under Byzantine attacks with no prior knowledge or history about the number of attacked nodes. More specifically, we transfer the original updating gradient space into a ranking matrix. By such an operation, the scales of different dimensions of the gradients in the ranking space become identical. The high-dimensional benign gradients and the malicious gradients can be easily separated. The effectiveness of MANDERA is further confirmed by experimentation on four Byzantine attack implementations (Gaussian, Zero Gradient, Sign Flipping, Shifted Mean), comparing with state-of-the-art defenses. The experiments cover both IID and Non-IID datasets.
Artificial Intelligence in Drug Discovery Market is expected to represent Significant CAGR of 29.5% by 2030 Major Players: IBM, Microsoft, Google - Digital Journal
New Jersey, United States, Jan 15, 2023 /DigitalJournal/ AI can aid in structure-based drug discovery by predicting 3D protein structure as the design conforms to the chemical environment of the target protein site, thus helping to predict the effect of a compound on the target as well as safety considerations prior to their synthesis or manufacture. Growing demand for the discovery and development of new drug therapies and increasing manufacturing capabilities in the life science industry are driving the demand for artificial intelligence (AI) based solutions in drug discovery processes. Manufacturers in the life science industry are constantly focused on replenishing their product pipelines as the majority of big sellers drop their patents. The global Artificial Intelligence (AI) in Drug Discovery Market is expected to grow at a Massive CAGR of 29.5% during the forecasting period of 2022 to 2029. The Artificial Intelligence (AI) in Drug Discovery Market research report provides all the information related to the industry.
Gangs smuggling Iranian missiles and drugs in the Gulf to be hunted by 100 new drones
Terrorist gangs smuggling Iranian missiles and drugs in the Middle East will soon have a fleet of 100 robo-ships hunting them down, Britain's most senior military commander in the Gulf has revealed. The new naval force, made up of drones that can operate around the clock, will be up and running by the summer, claimed Commodore Adrian Fryer. It comes as the top officer insisted he remained'alive' to the ever-present threat posed by Iran after a series of recent stand-offs, with the Commodore calling the Middle Eastern state the'main destabilising country' in the region. A small number of the unmanned vessels currently operating in the Gulf are already proving their worth, gathering invaluable data and information that's helping Royal Navy warships cut off smuggling routes and ambush gangs at sea. During the past 12 months, frigate HMS Montrose has seized her biggest haul of narcotics in its three years in the Gulf, bagging a whopping £46.8 million, bringing the ship's total during its time in the Middle East to a staggering £111.1 million.
Mapping smallholder cashew plantations to inform sustainable tree crop expansion in Benin
Yin, Leikun, Ghosh, Rahul, Lin, Chenxi, Hale, David, Weigl, Christoph, Obarowski, James, Zhou, Junxiong, Till, Jessica, Jia, Xiaowei, Mao, Troy, Kumar, Vipin, Jin, Zhenong
Cashews are grown by over 3 million smallholders in more than 40 countries worldwide as a principal source of income. As the third largest cashew producer in Africa, Benin has nearly 200,000 smallholder cashew growers contributing 15% of the country's national export earnings. However, a lack of information on where and how cashew trees grow across the country hinders decision-making that could support increased cashew production and poverty alleviation. By leveraging 2.4-m Planet Basemaps and 0.5-m aerial imagery, newly developed deep learning algorithms, and large-scale ground truth datasets, we successfully produced the first national map of cashew in Benin and characterized the expansion of cashew plantations between 2015 and 2021. In particular, we developed a SpatioTemporal Classification with Attention (STCA) model to map the distribution of cashew plantations, which can fully capture texture information from discriminative time steps during a growing season. We further developed a Clustering Augmented Self-supervised Temporal Classification (CASTC) model to distinguish high-density versus low-density cashew plantations by automatic feature extraction and optimized clustering. Results show that the STCA model has an overall accuracy over 85% and the CASTC model achieved an overall accuracy of 76%. We found that the cashew area in Benin almost doubled from 2015 to 2021 with 60% of new plantation development coming from cropland or fallow land, while encroachment of cashew plantations into protected areas has increased by 55%. Only half of cashew plantations were high-density in 2021, suggesting high potential for intensification. Our study illustrates the power of combining high-resolution remote sensing imagery and state-of-the-art deep learning algorithms to better understand tree crops in the heterogeneous smallholder landscape.