Goto

Collaborating Authors

 South America


Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding

arXiv.org Artificial Intelligence

This paper presents a new Vision Transformer (ViT) architecture Multi-Scale Vision Longformer, which significantly enhances the ViT of \cite{dosovitskiy2020image} for encoding high-resolution images using two techniques. The first is the multi-scale model structure, which provides image encodings at multiple scales with manageable computational cost. The second is the attention mechanism of vision Longformer, which is a variant of Longformer \cite{beltagy2020longformer}, originally developed for natural language processing, and achieves a linear complexity w.r.t. the number of input tokens. A comprehensive empirical study shows that the new ViT significantly outperforms several strong baselines, including the existing ViT models and their ResNet counterparts, and the Pyramid Vision Transformer from a concurrent work \cite{wang2021pyramid}, on a range of vision tasks, including image classification, object detection, and segmentation. The models and source code used in this study will be released to public soon.


Measuring Sample Efficiency and Generalization in Reinforcement Learning Benchmarks: NeurIPS 2020 Procgen Benchmark

arXiv.org Artificial Intelligence

The NeurIPS 2020 Procgen Competition was designed as a centralized benchmark with clearly defined tasks for measuring Sample Efficiency and Generalization in Reinforcement Learning. Generalization remains one of the most fundamental challenges in deep reinforcement learning, and yet we do not have enough benchmarks to measure the progress of the community on Generalization in Reinforcement Learning. We present the design of a centralized benchmark for Reinforcement Learning which can help measure Sample Efficiency and Generalization in Reinforcement Learning by doing end to end evaluation of the training and rollout phases of thousands of user submitted code bases in a scalable way. We designed the benchmark on top of the already existing Procgen Benchmark by defining clear tasks and standardizing the end to end evaluation setups. The design aims to maximize the flexibility available for researchers who wish to design future iterations of such benchmarks, and yet imposes necessary practical constraints to allow for a system like this to scale. This paper presents the competition setup and the details and analysis of the top solutions identified through this setup in context of 2020 iteration of the competition at NeurIPS.


KNN, An Underestimated Model for Regional Rainfall Forecasting

arXiv.org Artificial Intelligence

ABSTRACT Regional rainfall forecasting is an important issue in hydrology and meteorology. This paper aims to design an integrated tool by applying various machine learning algorithms, especially the state-of-the-art deep learning algorithms including Deep Neural Network, Wide Neural Network, Deep and Wide Neural Network, Reservoir Computing, Long Short Term Memory, Support Vector Machine, K-Nearest Neighbor for forecasting regional precipitations over different catchments in Upstate New York. Through the experimental results and the comparison among machine learning models including classification and regression, we find that KNN is an outstanding model over other models to handle the uncertainty in the precipitation data. The data normalization methods such as ZScore and MinMax are also evaluated and discussed. Keywords: rainfall forecasting, k-nearest neighbor, deep and wide neural network, reservoir computing, long short term memory. 1 INTRODUCTION New York historically had sufficient precipitation until recently, with intense drought occurring over the 2016 growing season, especially in western New York (Todaro 2018). The observed precipitation in 2016 was less than normal, with shortfalls of 4-8 inches being common in the 90 days leading up to the drought watch. Accurate rainfall forecasting is important for planning in agriculture and other relevant activities. Although a number of modern algorithms and applications have been used to forecast rainfall, there are two categories of approaches to solve the problem. However, it is thought not feasible limited by the complex climatic system in various spatial and temporal dimensions. A second category is based on the data mining and pattern recognition, which attempts to mine rainfall patterns and learn the knowledge from numerous features and a large volume of data. Historical meteorological data including precipitation data are used to feed and train the recognition model and further predict the evolution of other storms.


Playing Against the Board: Rolling Horizon Evolutionary Algorithms Against Pandemic

arXiv.org Artificial Intelligence

Competitive board games have provided a rich and diverse testbed for artificial intelligence. This paper contends that collaborative board games pose a different challenge to artificial intelligence as it must balance short-term risk mitigation with long-term winning strategies. Collaborative board games task all players to coordinate their different powers or pool their resources to overcome an escalating challenge posed by the board and a stochastic ruleset. This paper focuses on the exemplary collaborative board game Pandemic and presents a rolling horizon evolutionary algorithm designed specifically for this game. The complex way in which the Pandemic game state changes in a stochastic but predictable way required a number of specially designed forward models, macro-action representations for decision-making, and repair functions for the genetic operations of the evolutionary algorithm. Variants of the algorithm which explore optimistic versus pessimistic game state evaluations, different mutation rates and event horizons are compared against a baseline hierarchical policy agent. Results show that an evolutionary approach via short-horizon rollouts can better account for the future dangers that the board may introduce, and guard against them. Results highlight the types of challenges that collaborative board games pose to artificial intelligence, especially for handling multi-player collaboration interactions.


Global Machine Learning Infrastructure as a Service Market Top Manufacturers Analysis by 2026: Amazon Web Services (AWS), Google, Valohai, Microsoft, VMware etc. – The Market Eagle

#artificialintelligence

Predicting Growth Scope: Global Machine Learning Infrastructure as a Service Market The Global Machine Learning Infrastructure as a Service Market research report is comprised of the thorough study of all the market associated dynamics. The research report is a complete guide to study all the dynamics related to global Machine Learning Infrastructure as a Service market. The comprehensive analysis of potential customer base, market values and future scope is included in the global Machine Learning Infrastructure as a Service market report. Along with that the research report on the global market holds all the vital information regarding the latest technologies and trends being adopted or followed by the vendors across the globe.The research report provides an in-depth examination of all the market risks and opportunities. The analysis covered in the report helps manufacturers in the industry in eliminating the risks offered by the global market.


How close are we to becoming the Jetsons?

#artificialintelligence

Back in the nineties, my favorite TV show was called Tomorrow's World, a UK-based show which ran for a whopping 38 years on the BBC. It discussed the latest developments in science and technology (just look at this snippet of what the home in 2020 would look like). Back then, the future was extra exciting. Technology would make our lives infinitely easier – we'd be commuting to work in electric, automated cars, and life at home would just be one smooth series of button pushing. The height of this slightly skewed future gazing was my favorite Saturday morning space-age animated sitcom, The Jetsons, which first aired in the 1960s.


AI's Take On The Overvalued Freeport-McMoRan Inc Stock

#artificialintelligence

Freeport-McMoRan Inc – often shorthanded as Freeport – closed down 1.83% on Thursday to $31.61 per share, dipping harder than the broader markets. The day's end marked a staggering 27 million trades for the mining company, despite continuing a recent pattern of falling stock prices as seen against the 10-day price average of $35.22. However, stock prices are still up almost 16.5% for the year. Currently, the company is trading with a forward 12-month P/E of 12.65. Freeport-McMoRan is a leading international mining company with headquarters in Phoenix, Arizona.


Community Detection in General Hypergraph via Graph Embedding

arXiv.org Machine Learning

Network data has attracted tremendous attention in recent years, and most conventional networks focus on pairwise interactions between two vertices. However, real-life network data may display more complex structures, and multi-way interactions among vertices arise naturally. In this article, we propose a novel method for detecting community structure in general hypergraph networks, uniform or non-uniform. The proposed method introduces a null vertex to augment a non-uniform hypergraph into a uniform multi-hypergraph, and then embeds the multi-hypergraph in a low-dimensional vector space such that vertices within the same community are close to each other. The resultant optimization task can be efficiently tackled by an alternative updating scheme. The asymptotic consistencies of the proposed method are established in terms of both community detection and hypergraph estimation, which are also supported by numerical experiments on some synthetic and real-life hypergraph networks.


Graph Unlearning

arXiv.org Artificial Intelligence

The right to be forgotten states that a data subject has the right to erase their data from an entity storing it. In the context of machine learning (ML), it requires the ML model provider to remove the data subject's data from the training set used to build the ML model, a process known as \textit{machine unlearning}. While straightforward and legitimate, retraining the ML model from scratch upon receiving unlearning requests incurs high computational overhead when the training set is large. To address this issue, a number of approximate algorithms have been proposed in the domain of image and text data, among which SISA is the state-of-the-art solution. It randomly partitions the training set into multiple shards and trains a constituent model for each shard. However, directly applying SISA to the graph data can severely damage the graph structural information, and thereby the resulting ML model utility. In this paper, we propose GraphEraser, a novel machine unlearning method tailored to graph data. Its contributions include two novel graph partition algorithms, and a learning-based aggregation method. We conduct extensive experiments on five real-world datasets to illustrate the unlearning efficiency and model utility of GraphEraser. We observe that GraphEraser achieves 2.06$\times$ (small dataset) to 35.94$\times$ (large dataset) unlearning time improvement compared to retraining from scratch. On the other hand, GraphEraser achieves up to $62.5\%$ higher F1 score than that of random partitioning. In addition, our proposed learning-based aggregation method achieves up to $112\%$ higher F1 score than that of the majority vote aggregation.


Global Deep Learning Market Research Report – SoccerNurds

#artificialintelligence

WMR-Western Market Research has recently published a comprehensive and exclusive research report, which is an intelligent study covering all key segments. This research report provides breakthrough inputs and insights on market related factors like size, competition, trends, analysis, forecasts etc. The study encompasses primary and secondary data sources along with quantitative and qualitative practices thus assuring data accuracy. Introspective Market Research Predicts that Deep Learning Market was valued USD xxxx unit in 2020 and is expected to reach USD xxxx Unit by the year 2025, growing at a CAGR of xx% globally. Global Deep Learning Market Overview: Global Deep Learning Market Report 2020 comes with the extensive industry analysis of development components, patterns, flows and sizes.