Goto

Collaborating Authors

 metnet


Meta-Learning Triplet Network with Adaptive Margins for Few-Shot Named Entity Recognition

Han, Chengcheng, Zhu, Renyu, Kuang, Jun, Chen, FengJiao, Li, Xiang, Gao, Ming, Cao, Xuezhi, Wu, Wei

arXiv.org Artificial Intelligence

Meta-learning methods have been widely used in few-shot named entity recognition (NER), especially prototype-based methods. However, the Other(O) class is difficult to be represented by a prototype vector because there are generally a large number of samples in the class that have miscellaneous semantics. To solve the problem, we propose MeTNet, which generates prototype vectors for entity types only but not O-class. We design an improved triplet network to map samples and prototype vectors into a low-dimensional space that is easier to be classified and propose an adaptive margin for each entity type. The margin plays as a radius and controls a region with adaptive size in the low-dimensional space. Based on the regions, we propose a new inference procedure to predict the label of a query instance. We conduct extensive experiments in both in-domain and cross-domain settings to show the superiority of MeTNet over other state-of-the-art methods. In particular, we release a Chinese few-shot NER dataset FEW-COMM extracted from a well-known e-commerce platform. To the best of our knowledge, this is the first Chinese few-shot NER dataset. All the datasets and codes are provided at https://github.com/hccngu/MeTNet.


MetNet: A Neural Weather Model for Precipitation Forecasting

Sønderby, Casper Kaae, Espeholt, Lasse, Heek, Jonathan, Dehghani, Mostafa, Oliver, Avital, Salimans, Tim, Agrawal, Shreya, Hickey, Jason, Kalchbrenner, Nal

arXiv.org Machine Learning

Weather forecasting is a long standing scientific challenge with direct social and economic impact. The task is suitable for deep neural networks due to vast amounts of continuously collected data and a rich spatial and temporal structure that presents long range dependencies. We introduce MetNet, a neural network that forecasts precipitation up to 8 hours into the future at the high spatial resolution of 1 km$^2$ and at the temporal resolution of 2 minutes with a latency in the order of seconds. MetNet takes as input radar and satellite data and forecast lead time and produces a probabilistic precipitation map. The architecture uses axial self-attention to aggregate the global context from a large input patch corresponding to a million square kilometers. We evaluate the performance of MetNet at various precipitation thresholds and find that MetNet outperforms Numerical Weather Prediction at forecasts of up to 7 to 8 hours on the scale of the continental United States.


Google details MetNet, an AI model better than NOAA at predicting precipitation

#artificialintelligence

In a blog post and accompanying paper, researchers at Google detail an AI system -- MetNet -- that can predict precipitation up to eight hours into the future. They say that it outperforms the current state-of-the-art physics model in use by the U.S. National Oceanic and Atmospheric Administration (NOAA) and that it makes a prediction over the entire U.S. in seconds as opposed to an hour. It builds on previous work from Google, which entailed an AI system that ingested satellite images to produce forecasts with a roughly one-kilometer resolution and a latency of only 5-10 minutes. And while it's early days, it could the runway for a forecasting tool that could help businesses, residents, and local governments better prepare for inclement weather. MetNet takes a data-driven and physics-free approach to weather modeling, meaning it learns to approximate atmospheric physics from examples and not by incorporating prior knowledge.