Government
Fast Bayesian Coresets via Subsampling and Quasi-Newton Refinement
Naik, Cian, Rousseau, Judith, Campbell, Trevor
Any inference procedure that is too computationally expensive to be run on the full posterior can instead be run inexpensively on the coreset, with results that approximate those on the full data. However, current approaches are limited by either a significant run-time or the need for the user to specify a low-cost approximation to the full posterior. We propose a Bayesian coreset construction algorithm that first selects a uniformly random subset of data, and then optimizes the weights using a novel quasi-Newton method. Our algorithm is a simple to implement, black-box method, that does not require the user to specify a low-cost posterior approximation. It is the first to come with a general high-probability bound on the KL divergence of the output coreset posterior. Experiments demonstrate that our method provides significant improvements in coreset quality against alternatives with comparable construction times, with far less storage cost and user input required.
Mapping smallholder cashew plantations to inform sustainable tree crop expansion in Benin
Yin, Leikun, Ghosh, Rahul, Lin, Chenxi, Hale, David, Weigl, Christoph, Obarowski, James, Zhou, Junxiong, Till, Jessica, Jia, Xiaowei, Mao, Troy, Kumar, Vipin, Jin, Zhenong
Cashews are grown by over 3 million smallholders in more than 40 countries worldwide as a principal source of income. As the third largest cashew producer in Africa, Benin has nearly 200,000 smallholder cashew growers contributing 15% of the country's national export earnings. However, a lack of information on where and how cashew trees grow across the country hinders decision-making that could support increased cashew production and poverty alleviation. By leveraging 2.4-m Planet Basemaps and 0.5-m aerial imagery, newly developed deep learning algorithms, and large-scale ground truth datasets, we successfully produced the first national map of cashew in Benin and characterized the expansion of cashew plantations between 2015 and 2021. In particular, we developed a SpatioTemporal Classification with Attention (STCA) model to map the distribution of cashew plantations, which can fully capture texture information from discriminative time steps during a growing season. We further developed a Clustering Augmented Self-supervised Temporal Classification (CASTC) model to distinguish high-density versus low-density cashew plantations by automatic feature extraction and optimized clustering. Results show that the STCA model has an overall accuracy over 85% and the CASTC model achieved an overall accuracy of 76%. We found that the cashew area in Benin almost doubled from 2015 to 2021 with 60% of new plantation development coming from cropland or fallow land, while encroachment of cashew plantations into protected areas has increased by 55%. Only half of cashew plantations were high-density in 2021, suggesting high potential for intensification. Our study illustrates the power of combining high-resolution remote sensing imagery and state-of-the-art deep learning algorithms to better understand tree crops in the heterogeneous smallholder landscape.
Learning Sparse Temporal Video Mapping for Action Quality Assessment in Floor Gymnastics
Zahan, Sania, Hassan, Ghulam Mubashar, Mian, Ajmal
Abstract--Athlete performance measurement in sports videos requires modeling long sequences since the entire spatio-temporal progression contributes dominantly to the performance. It is crucial to comprehend local discriminative spatial dependencies and global semantics for accurate evaluation. However, existing benchmark datasets mainly incorporate sports where the performance lasts only a few seconds. Consequently, state-ofthe-art sports quality assessment methods specifically focus on spatial structure. Although they achieve high performance in short-term sports, they are unable to model prolonged video sequences and fail to achieve similar performance in long-term sports. To facilitate such analysis, we introduce a new dataset, coined AGF-Olympics, that incorporates artistic gymnastic floor routines. AFG-Olympics provides highly challenging scenarios with extensive background, viewpoint, and scale variations over an extended sample duration of up to 2 minutes. In addition, we propose a discriminative attention module to map the dense feature space into a sparse representation by disentangling complex associations. Extensive experiments indicate that our proposed module provides an effective way to embed long-range spatial and temporal correlation semantics. AQA conceptual workflow: discriminative non-local attention focuses on latent spatio-temporal association.
Interpretable and Scalable Graphical Models for Complex Spatio-temporal Processes
This thesis focuses on data that has complex spatio-temporal structure and on probabilistic graphical models that learn the structure in an interpretable and scalable manner. We target two research areas of interest: Gaussian graphical models for tensor-variate data and summarization of complex time-varying texts using topic models. This work advances the state-of-the-art in several directions. First, it introduces a new class of tensor-variate Gaussian graphical models via the Sylvester tensor equation. Second, it develops an optimization technique based on a fast-converging proximal alternating linearized minimization method, which scales tensor-variate Gaussian graphical model estimations to modern big-data settings. Third, it connects Kronecker-structured (inverse) covariance models with spatio-temporal partial differential equations (PDEs) and introduces a new framework for ensemble Kalman filtering that is capable of tracking chaotic physical systems. Fourth, it proposes a modular and interpretable framework for unsupervised and weakly-supervised probabilistic topic modeling of time-varying data that combines generative statistical models with computational geometric methods. Throughout, practical applications of the methodology are considered using real datasets. This includes brain-connectivity analysis using EEG data, space weather forecasting using solar imaging data, longitudinal analysis of public opinions using Twitter data, and mining of mental health related issues using TalkLife data. We show in each case that the graphical modeling framework introduced here leads to improved interpretability, accuracy, and scalability.
Computability of Optimizers
Lee, Yunseok, Boche, Holger, Kutyniok, Gitta
Optimization problems are a staple of today's scientific and technical landscape. However, at present, solvers of such problems are almost exclusively run on digital hardware. Using Turing machines as a mathematical model for any type of digital hardware, in this paper, we analyze fundamental limitations of this conceptual approach of solving optimization problems. Since in most applications, the optimizer itself is of significantly more interest than the optimal value of the corresponding function, we will focus on computability of the optimizer. In fact, we will show that in various situations the optimizer is unattainable on Turing machines and consequently on digital computers. Moreover, even worse, there does not exist a Turing machine, which approximates the optimizer itself up to a certain constant error. We prove such results for a variety of well-known problems from very different areas, including artificial intelligence, financial mathematics, and information theory, often deriving the even stronger result that such problems are not Banach-Mazur computable, also not even in an approximate sense.
Wild-Time: A Benchmark of in-the-Wild Distribution Shift over Time
Yao, Huaxiu, Choi, Caroline, Cao, Bochuan, Lee, Yoonho, Koh, Pang Wei, Finn, Chelsea
Distribution shift occurs when the test distribution differs from the training distribution, and it can considerably degrade performance of machine learning models deployed in the real world. Temporal shifts -- distribution shifts arising from the passage of time -- often occur gradually and have the additional structure of timestamp metadata. By leveraging timestamp metadata, models can potentially learn from trends in past distribution shifts and extrapolate into the future. While recent works have studied distribution shifts, temporal shifts remain underexplored. To address this gap, we curate Wild-Time, a benchmark of 5 datasets that reflect temporal distribution shifts arising in a variety of real-world applications, including patient prognosis and news classification. On these datasets, we systematically benchmark 13 prior approaches, including methods in domain generalization, continual learning, self-supervised learning, and ensemble learning. We use two evaluation strategies: evaluation with a fixed time split (Eval-Fix) and evaluation with a data stream (Eval-Stream). Eval-Fix, our primary evaluation strategy, aims to provide a simple evaluation protocol, while Eval-Stream is more realistic for certain real-world applications. Under both evaluation strategies, we observe an average performance drop of 20% from in-distribution to out-of-distribution data. Existing methods are unable to close this gap. Code is available at https://wild-time.github.io/.
Machine learning digs into states' archives - GCN
Before digitization became the norm, one paper memo may have been copied just a handful of times. Now, as electronic records are replacing their paper counterparts, one copy can easily become hundreds, creating a records management challenge, said Kristopher Stenson, state records manager at the Oregon State Archives. Besides the multiplying number of digital-born records, the software and hardware meant to store and maintain records grows obsolete over time, making it difficult to ensure a document's associated provenance and other metadata is properly conveyed in files, Michelle Gallinger, the state electronic records initiative coordinator for the Council of State Archives, said in an email. Another challenge lies in the lack of understanding among state agencies about digital preservation techniques and best practices and the unclear roles and responsibilities around records management, she said. "Exacerbating these issues is the reality that effective electronic records management remains a low priority and largely underfunded mandate in state government, and many existing digital preservation tools, primarily open-source tools, cannot be supported in existing state/territorial IT infrastructures," she said.
NASA unveils plan for next-gen telescope to search space for signs of life: reports
Veteran NASA astronaut Tom Jones recaps the historic Artemis I mission after the Orion capsule made a successful return to earth and outlines what this means for the lunar return program. The Habitable Worlds Observatory was announced Monday at the latest American Astronomical Society meeting, and its goal is searching for signs of life on habitable exoplanets. Space.com said on Friday that the observatory will need a powerful coronograph, which is an instrument that allows scientists to study faint objects. Mark Clampin, the director of NASA's astrophysics division, reportedly said that the agency would approach the project as if it faced a strict launch window, building on previous technology used for the Nancy Grace Roman Space Telescope as well as Webb. FILE - In this April 13, 2017, photo provided by NASA, technicians lift the mirror of the James Webb Space Telescope using a crane at the Goddard Space Flight Center in Greenbelt, Maryland.
AI will Go Mainstream in 2023 - BulletinPrime
This week, Artificial Intelligence (AI) made significant strides in its ability to generate original text, videos, and pictures from scratch. Experts predict that in 2023, this technology will become mainstream and widely adopted by businesses and individuals around the world. In other news, the United Nations Biodiversity Conference in Montreal brought together countries from around the world to approve a historic environmental agreement. This agreement aims to protect Earth's land and water by 2030, with the goal of preserving and restoring the planet's ecosystems for future generations. In international news, China and Russia continue to reduce the US dollar's power and influence on the global stage.
Technology development. Technology development has come a long…
Technology development has come a long way in recent years, with new and innovative products and services being released at a rapid pace. The advances in technology have had a significant impact on society, transforming the way we communicate, work, and live our lives. One of the most significant areas of technology development is in the field of artificial intelligence (AI). AI has the potential to revolutionize many industries, from healthcare to transportation, by automating tasks and making them more efficient. There have been significant advances in natural language processing, machine learning, and robotics, which have led to the development of AI systems that can perform a wide range of tasks, from diagnosing diseases to driving cars.