South America
Annual field-scale maps of tall and short crops at the global scale using GEDI and Sentinel-2
Di Tommaso, Stefania, Wang, Sherrie, Vajipey, Vivek, Gorelick, Noel, Strey, Rob, Lobell, David B.
Crop type maps are critical for tracking agricultural land use and estimating crop production. Remote sensing has proven an efficient and reliable tool for creating these maps in regions with abundant ground labels for model training, yet these labels remain difficult to obtain in many regions and years. NASA's Global Ecosystem Dynamics Investigation (GEDI) spaceborne lidar instrument, originally designed for forest monitoring, has shown promise for distinguishing tall and short crops. In the current study, we leverage GEDI to develop wall-to-wall maps of short vs tall crops on a global scale at 10 m resolution for 2019-2021. Specifically, we show that (1) GEDI returns can reliably be classified into tall and short crops after removing shots with extreme view angles or topographic slope, (2) the frequency of tall crops over time can be used to identify months when tall crops are at their peak height, and (3) GEDI shots in these months can then be used to train random forest models that use Sentinel-2 time series to accurately predict short vs. tall crops. Independent reference data from around the world are then used to evaluate these GEDI-S2 maps. We find that GEDI-S2 performed nearly as well as models trained on thousands of local reference training points, with accuracies of at least 87% and often above 90% throughout the Americas, Europe, and East Asia. Systematic underestimation of tall crop area was observed in regions where crops frequently exhibit low biomass, namely Africa and South Asia, and further work is needed in these systems. Although the GEDI-S2 approach only differentiates tall from short crops, in many landscapes this distinction goes a long way toward mapping the main individual crop types. The combination of GEDI and Sentinel-2 thus presents a very promising path towards global crop mapping with minimal reliance on ground data.
Almost Cost-Free Communication in Federated Best Arm Identification
Reddy, Kota Srinivas, Karthik, P. N., Tan, Vincent Y. F.
We study the problem of best arm identification in a federated learning multi-armed bandit setup with a central server and multiple clients. Each client is associated with a multi-armed bandit in which each arm yields {\em i.i.d.}\ rewards following a Gaussian distribution with an unknown mean and known variance. The set of arms is assumed to be the same at all the clients. We define two notions of best arm -- local and global. The local best arm at a client is the arm with the largest mean among the arms local to the client, whereas the global best arm is the arm with the largest average mean across all the clients. We assume that each client can only observe the rewards from its local arms and thereby estimate its local best arm. The clients communicate with a central server on uplinks that entail a cost of $C\ge0$ units per usage per uplink. The global best arm is estimated at the server. The goal is to identify the local best arms and the global best arm with minimal total cost, defined as the sum of the total number of arm selections at all the clients and the total communication cost, subject to an upper bound on the error probability. We propose a novel algorithm {\sc FedElim} that is based on successive elimination and communicates only in exponential time steps and obtain a high probability instance-dependent upper bound on its total cost. The key takeaway from our paper is that for any $C\geq 0$ and error probabilities sufficiently small, the total number of arm selections (resp.\ the total cost) under {\sc FedElim} is at most~$2$ (resp.~$3$) times the maximum total number of arm selections under its variant that communicates in every time step. Additionally, we show that the latter is optimal in expectation up to a constant factor, thereby demonstrating that communication is almost cost-free in {\sc FedElim}. We numerically validate the efficacy of {\sc FedElim}.
XNOR-FORMER: Learning Accurate Approximations in Long Speech Transformers
Transformers are among the state of the art for many tasks in speech, vision, and natural language processing, among others. Self-attentions, which are crucial contributors to this performance have quadratic computational complexity, which makes training on longer input sequences challenging. Prior work has produced state-of-the-art transformer variants with linear attention, however, current models sacrifice performance to achieve efficient implementations. In this work, we develop a novel linear transformer by examining the properties of the key-query product within self-attentions. Our model outperforms state of the art approaches on speech recognition and speech summarization, resulting in 1 % absolute WER improvement on the Librispeech-100 speech recognition benchmark and a new INTERVIEW speech recognition benchmark, and 5 points on ROUGE for summarization with How2.
Enhanced word embeddings using multi-semantic representation through lexical chains
Ruas, Terry, Ferreira, Charles Henrique Porto, Grosky, William, de França, Fabrício Olivetti, Medeiros, Débora Maria Rossi
The relationship between words in a sentence often tells us more about the underlying semantic content of a document than its actual words, individually. In this work, we propose two novel algorithms, called Flexible Lexical Chain II and Fixed Lexical Chain II. These algorithms combine the semantic relations derived from lexical chains, prior knowledge from lexical databases, and the robustness of the distributional hypothesis in word embeddings as building blocks forming a single system. In short, our approach has three main contributions: (i) a set of techniques that fully integrate word embeddings and lexical chains; (ii) a more robust semantic representation that considers the latent relation between words in a document; and (iii) lightweight word embeddings models that can be extended to any natural language task. We intend to assess the knowledge of pre-trained models to evaluate their robustness in the document classification task. The proposed techniques are tested against seven word embeddings algorithms using five different machine learning classifiers over six scenarios in the document classification task. Our results show the integration between lexical chains and word embeddings representations sustain state-of-the-art results, even against more complex systems.
Multi-sense embeddings through a word sense disambiguation process
Ruas, Terry, Grosky, William, Aizawa, Akiko
Natural Language Understanding has seen an increasing number of publications in the last few years, especially after robust word embeddings models became prominent, when they proved themselves able to capture and represent semantic relationships from massive amounts of data. Nevertheless, traditional models often fall short in intrinsic issues of linguistics, such as polysemy and homonymy. Any expert system that makes use of natural language in its core, can be affected by a weak semantic representation of text, resulting in inaccurate outcomes based on poor decisions. To mitigate such issues, we propose a novel approach called Most Suitable Sense Annotation (MSSA), that disambiguates and annotates each word by its specific sense, considering the semantic effects of its context. Our approach brings three main contributions to the semantic representation scenario: (i) an unsupervised technique that disambiguates and annotates words by their senses, (ii) a multi-sense embeddings model that can be extended to any traditional word embeddings algorithm, and (iii) a recurrent methodology that allows our models to be re-used and their representations refined. We test our approach on six different benchmarks for the word similarity task, showing that our approach can produce state-of-the-art results and outperforms several more complex state-of-the-art systems.
Revisiting Additive Compositionality: AND, OR and NOT Operations with Word Embeddings
Naito, Masahiro, Yokoi, Sho, Kim, Geewook, Shimodaira, Hidetoshi
It is well-known that typical word embedding methods such as Word2Vec and GloVe have the property that the meaning can be composed by adding up the embeddings (additive compositionality). Several theories have been proposed to explain additive compositionality, but the following questions remain unanswered: (Q1) The assumptions of those theories do not hold for the practical word embedding. (Q2) Ordinary additive compositionality can be seen as an AND operation of word meanings, but it is not well understood how other operations, such as OR and NOT, can be computed by the embeddings. We address these issues by the idea of frequency-weighted centering at its core. This paper proposes a post-processing method for bridging the gap between practical word embedding and the assumption of theory about additive compositionality as an answer to (Q1). It also gives a method for taking OR or NOT of the meaning by linear operation of word embedding as an answer to (Q2). Moreover, we confirm experimentally that the accuracy of AND operation, i.e., the ordinary additive compositionality, can be improved by our post-processing method (3.5x improvement in top-100 accuracy) and that OR and NOT operations can be performed correctly.
How ISS's new AI-powered program will help real-time monitoring of the climate crisis
The world is in a climate crisis. With average global temperatures increasing every year, the threat of seasonal forest fires is becoming increasingly worse. In places like the Pacific Northwest, wildfire season causes extensive damage to woodlands, rural communities, and townships, destroying farmlands and infrastructure and forcing hundreds of thousands of residents to flee their homes. These fires also lead to terrible air quality in cities located hundreds (or even thousands) of miles away. For instance, in September of 2022, the city of Vancouver (British Columbia) was ranked as having the worst air quality in the world - per the Air Quality Index (AQI).
Artificial Intelligence Service Market size was valued at USD 93.5 billion in 2021, growing at a CAGR of 38.1% from 2022 to 2032: Evolve Business Intelligence - Digital Journal
Artificial intelligence (AI), often recognized as machine intelligence, is an area of computer science that emphasizes developing and managing technology that can learn to make choices and can separately carry out transactions on behalf of humans. The banking, financial services, and insurance segments experience substantial expansion during the estimated period. A substantial amount of client data or transaction records are produced owing to the rising digital revolution in banking and the augmented use of mobile payment, real-time money transfers, e-banking, and mobile banking applications. The global Artificial Intelligence Service Market size was valued at USD 93.5 billion in 2021 growing at the CAGR of 38.1% from 2022 to 2032. Evolve Business Intelligence provides an in-dept research study that contains the ability to focus on the major market dynamics in several region across the globe.
The 10 biggest science stories of 2022 – chosen by scientists
The year opened with a bang. The successful film Don't Look Up, in which a comet is found to be on a collision course with Earth, had been released just before Christmas 2021. In the bleak days of post-festive gloom, the news media were on an adrenaline high, chasing any and every story about potential asteroid collisions to cheer us all up. Five asteroids were to pass close to the Earth in January alone! Happily for the health and wellbeing of humanity, none was predicted to come within a whisker of hitting the planet.
Argentina vs France final prediction: World Cup 2022
Argentina take on France in the final of World Cup 2022. Kashef, our artificial intelligence (AI) robot, has analysed more than 200 metrics, including the number of wins, goals scored and FIFA rankings, from matches played over the past century to see who is most likely to win on Sunday. Prediction: With 63 matches completed, Kashef has a 68 percent accuracy level. Sizing up all the odds, it could not be any closer. Kashef predicts that France, captained by Hugo Lloris, will edge out Argentina on Sunday to win the 2022 World Cup.