South America
Benchmarking learned non-Cartesian k-space trajectories and reconstruction networks
R, Chaithya G, Ciuciu, Philippe
We benchmark the current existing methods to jointly learn non-Cartesian k-space trajectory and reconstruction: PILOT, BJORK, and compare them with those obtained from the recently developed generalized hybrid learning (HybLearn) framework. We present the advantages of using projected gradient descent to enforce MR scanner hardware constraints as compared to using added penalties in the cost function. Further, we use the novel HybLearn scheme to jointly learn and compare our results through a retrospective study on fastMRI validation dataset.
A Survey on Visual Transfer Learning using Knowledge Graphs
Monka, Sebastian, Halilaj, Lavdim, Rettinger, Achim
Recent approaches of computer vision utilize deep learning methods as they perform quite well if training and testing domains follow the same underlying data distribution. However, it has been shown that minor variations in the images that occur when using these methods in the real world can lead to unpredictable errors. Transfer learning is the area of machine learning that tries to prevent these errors. Especially, approaches that augment image data using auxiliary knowledge encoded in language embeddings or knowledge graphs (KGs) have achieved promising results in recent years. This survey focuses on visual transfer learning approaches using KGs. KGs can represent auxiliary knowledge either in an underlying graph-structured schema or in a vector-based knowledge graph embedding. Intending to enable the reader to solve visual transfer learning problems with the help of specific KG-DL configurations we start with a description of relevant modeling structures of a KG of various expressions, such as directed labeled graphs, hypergraphs, and hyper-relational graphs. We explain the notion of feature extractor, while specifically referring to visual and semantic features. We provide a broad overview of knowledge graph embedding methods and describe several joint training objectives suitable to combine them with high dimensional visual embeddings. The main section introduces four different categories on how a KG can be combined with a DL pipeline: 1) Knowledge Graph as a Reviewer; 2) Knowledge Graph as a Trainee; 3) Knowledge Graph as a Trainer; and 4) Knowledge Graph as a Peer. To help researchers find evaluation benchmarks, we provide an overview of generic KGs and a set of image processing datasets and benchmarks including various types of auxiliary knowledge. Last, we summarize related surveys and give an outlook about challenges and open issues for future research.
Recursive Decoding: A Situated Cognition Approach to Compositional Generation in Grounded Language Understanding
Setzler, Matthew, Howland, Scott, Phillips, Lauren
Compositional generalization is a troubling blind spot for neural language models. Recent efforts have presented techniques for improving a model's ability to encode novel combinations of known inputs, but less work has focused on generating novel combinations of known outputs. Here we focus on this latter "decode-side" form of generalization in the context of gSCAN, a synthetic benchmark for compositional generalization in grounded language understanding. We present Recursive Decoding (RD), a novel procedure for training and using seq2seq models, targeted towards decode-side generalization. Rather than generating an entire output sequence in one pass, models are trained to predict one token at a time. Inputs (i.e., the external gSCAN environment) are then incrementally updated based on predicted tokens, and re-encoded for the next decoder time step. RD thus decomposes a complex, out-of-distribution sequence generation task into a series of incremental predictions that each resemble what the model has already seen during training. RD yields dramatic improvement on two previously neglected generalization tasks in gSCAN. We provide analyses to elucidate these gains over failure of a baseline, and then discuss implications for generalization in naturalistic grounded language understanding, and seq2seq more generally.
Smart City Defense Game: Strategic Resource Management during Socio-Cyber-Physical Attacks
Sikeridis, Dimitrios, Devetsikiotis, Michael
Ensuring public safety in a Smart City (SC) environment is a critical and increasingly complicated task due to the involvement of multiple agencies and the city's expansion across cyber and social layers. In this paper, we propose an extensive form perfect information game to model interactions and optimal city resource allocations when a Terrorist Organization (TO) performs attacks on multiple targets across two conceptual SC levels, a physical, and a cyber-social. The Smart City Defense Game (SCDG) considers three players that initially are entitled to a specific finite budget. Two SC agencies that have to defend their physical or social territories respectively, fight against a common enemy, the TO. Each layer consists of multiple targets and the attack outcome depends on whether the resources allocated there by the associated agency, exceed or not the TO's. Each player's utility is equal to the number of successfully defended targets. The two agencies are allowed to make budget transfers provided that it is beneficial for both. We completely characterize the Sub-game Perfect Nash Equilibrium (SPNE) of the SCDG that consists of strategies for optimal resource exchanges between SC agencies and accounts for the TO's budget allocation across the physical and social targets. Also, we present numerical and comparative results demonstrating that when the SC players act according to the SPNE, they maximize the number of successfully defended targets. The SCDG is shown to be a promising solution for modeling critical resource allocations between SC parties in the face of multi-layer simultaneous terrorist attacks.
Transfer Portal: Accurately Forecasting the Impact of a Player Transfer in Soccer
Dinsdale, Daniel, Gallagher, Joe
One of the most important and challenging problems in football is predicting future player performance when transferred to another club within and between different leagues. In addition to being the most valuable prediction a team makes, it is also the most complex analytics task to perform as it needs to take into consideration: a) differences in playing style between the player's current team and target team, b) differences in style and ability of other players on each team, c) differences in league quality and style, and d) the role the player is desired to play. In this paper, we present a method which addresses these issues and enables us to make accurate predictions of future performance. Our Transfer Portal model utilizes a personalized neural network accounting for both stylistic and ability level input representations for players, teams, and leagues to simulate future player performance at any chosen club. Furthermore, we use a Bayesian updating framework to dynamically modify player and team representations over time which enables us to generate predictions for rising stars with small amounts of data.
How Machine Learning Can Improve Our Email Experience
Around 2015 or 2016, Google began a strategic move, possibly one of the most important it has undertaken in its more than 20 years of existence, to incorporate machine learning and apply it to all its products. Its CEO, Sundar Pichai, saw machine learning as the ultimate disruptive technology, in the same way fire or electricity once were, and in a strong display of leadership, embarked on a mission to introduce the technology throughout the company, training all its employees in it. A few years on, what can we observe? I think email, a tool we all use quite regularly, is an interesting example. What changes have we noticed over the last few years with Gmail, for example?
Microsoft has released new and updated building footprints
Microsoft continues to make significant investments in deep learning, computer vision, and AI. The Microsoft Maps Team has been leveraging that investment to identify map features at scale and produce high-quality building footprint data sets with the overall goal to add to the OpenStreetMap and MissingMaps humanitarian efforts. As of this post, the following locations are available and Microsoft offers access to this data under the Open Data Commons Open Database License (ODbL). Country/Region Million buildings United States of America 129.6 Nigeria and Kenya 50.5 South America 44.5 Uganda and Tanzania 17.9 Canada 11.8 Australia 11.3 As you might expect, the vintage of the footprints depends on the collection date of the underlying imagery. Bing Maps Imagery is a composite of multiple sources with different capture dates (ranging 2012 to 2021).
Jalisco's multiclass land cover analysis and classification using a novel lightweight convnet with real-world multispectral and relief data
Quevedo, Alexander, Sánchez, Abraham, Nancláres, Raul, Montoya, Diana P., Pacho, Juan, Martínez, Jorge, Moya-Sánchez, E. Ulises
Terrestrial vegetation is a critical component of global biogeochemical cycles and provides important ecosystem services to support human life [1]. Given its importance, it is essential to know the spatial-temporal variations of vegetation [2]. These variations are due to several determining factors such as global climate variability, climate gradients, and anthropogenic factors such as Land Use and Land Cover Change (LULCC). The diversity in climatic conditions and vegetation types pose different obstacles to monitoring and classifying land cover using remote sensing. Mexico is considered one of the mega-diverse countries on the planet due to its location in a transition zone between Nearctic and Neotropic regions making it more difficult for land use classification and monitoring. The anthropogenic factors, could be a trigger for deforestation and forest degradation [3] and have a severe impact on the global carbon cycle, soil erosion, hydrological cycles, and in general, affect on the ecosystem services that sustain society [4]. As a result, timely land cover monitoring and classification are of crucial importance for assessing gradual degradation-ecosystem processes. Furthermore, it is important to be in line with the United Nations Sustainable Development Goals (SDGs) specifically SDG 15 concerning "Life on Land" [5].
On the Power of Gradual Network Alignment Using Dual-Perception Similarities
Park, Jin-Duk, Tran, Cong, Shin, Won-Yong, Cao, Xin
Network alignment (NA) is the task of finding the correspondence of nodes between two networks based on the network structure and node attributes. Our study is motivated by the fact that, since most of existing NA methods have attempted to discover all node pairs at once, they do not harness information enriched through interim discovery of node correspondences to more accurately find the next correspondences during the node matching. To tackle this challenge, we propose Grad-Align, a new NA method that gradually discovers node pairs by making full use of node pairs exhibiting strong consistency, which are easy to be discovered in the early stage of gradual matching. Specifically, Grad-Align first generates node embeddings of the two networks based on graph neural networks along with our layer-wise reconstruction loss, a loss built upon capturing the first-order and higher-order neighborhood structures. Then, nodes are gradually aligned by computing dual-perception similarity measures including the multi-layer embedding similarity as well as the Tversky similarity, an asymmetric set similarity using the Tversky index applicable to networks with different scales. Additionally, we incorporate an edge augmentation module into Grad-Align to reinforce the structural consistency. Through comprehensive experiments using real-world and synthetic datasets, we empirically demonstrate that Grad-Align consistently outperforms state-of-the-art NA methods.
Speed, Quality, and the Optimal Timing of Complex Decisions: Field Evidence
Sunde, Uwe, Zegners, Dainis, Strittmatter, Anthony
This paper presents an empirical investigation of the relation between decision speed and decision quality for a real-world setting of cognitively-demanding decisions in which the timing of decisions is endogenous: professional chess. Move-by-move data provide exceptionally detailed and precise information about decision times and decision quality, based on a comparison of actual decisions to a computational benchmark of best moves constructed using the artificial intelligence of a chess engine. The results reveal that faster decisions are associated with better performance. The findings are consistent with the predictions of procedural decision models like drift-diffusion-models in which decision makers sequentially acquire information about decision alternatives with uncertain valuations.