Goto

Collaborating Authors

 tempo


This lightweight e-bike lets you decide what kind of rider you are today

Popular Science

Whether you want a heart-pumping workout or a leisurely winding ride, the Velotric Tempo adapts to the moment rather than locking you into a single riding style. More information Adding us as a Preferred Source in Google by using this link indicates that you would like to see more of our content in Google News results. The Velotric Tempo, shown with a mid-step frame in sunset tangerine, has become my go-to for getting some air and clearing my head. We may earn revenue from the products available on this page and participate in affiliate programs. By signing up, you confirm you are 16+, will receive newsletters and promotional content and agree to our Terms of Use and acknowledge the data practices in our Privacy Policy .


Sea shanties actually help people work together better

Popular Science

Centuries-old work songs still possess real psychological benefits today. More information Adding us as a Preferred Source in Google by using this link indicates that you would like to see more of our content in Google News results. Work songs composed to keep rhythm during labor can be found around the world. Breakthroughs, discoveries, and DIY tips sent six days a week. A few years' back, a viral trend overtook social media that nobody saw coming: ShantyTok .







Task-aware world model learning with meta weighting via bi-level optimization

Neural Information Processing Systems

Aligning the world model with the environment for the agent's specific task is crucial in model-based reinforcement learning. While value-equivalent models may achieve better task awareness than maximum-likelihood models, they sacrifice a large amount of semantic information and face implementation issues. To combine the benefits of both types of models, we propose Task-aware Environment Modeling Pipeline with bi-level Optimization (TEMPO), a bi-level model learning framework that introduces an additional level of optimization on top of a maximum-likelihood model by incorporating a meta weighter network that weights each training sample. The meta weighter in the upper level learns to generate novel sample weights by minimizing a proposed task-aware model loss. The model in the lower level focuses on important samples while maintaining rich semantic information in state representations. We evaluate TEMPO on a variety of continuous and discrete control tasks from the DeepMind Control Suite and Atari video games. Our results demonstrate that TEMPO achieves state-of-the-art performance regarding asymptotic performance, training stability, and convergence speed.


Tempo: Accelerating Transformer-Based Model Training through Memory Footprint Reduction

Neural Information Processing Systems

Training deep learning models can be computationally expensive. Prior works have shown that increasing the batch size can potentially lead to better overall throughput. However, the batch size is frequently limited by the accelerator memory capacity due to the activations/feature maps stored for the training backward pass, as larger batch sizes require larger feature maps to be stored. Transformer-based models, which have recently seen a surge in popularity due to their good performance and applicability to a variety of tasks, have a similar problem. To remedy this issue, we propose Tempo, a new approach to efficiently use accelerator (e.g., GPU) memory resources for training Transformer-based models. Our approach provides drop-in replacements for the GELU, LayerNorm, and Attention layers, reducing the memory usage and ultimately leading to more efficient training. We implement Tempo and evaluate the throughput, memory usage, and accuracy/loss on the BERT Large pre-training task. We demonstrate that Tempo enables up to 2 higher batch sizes and 16% higher training throughput over the state-of-the-art baseline. We also evaluate Tempo on GPT2 and RoBERTa models, showing 19% and 26% speedup over the baseline.


TEMPO: Global Temporal Building Density and Height Estimation from Satellite Imagery

arXiv.org Artificial Intelligence

We present TEMPO, a global, temporally resolved dataset of building density and height derived from high-resolution satellite imagery using deep learning models. We pair building footprint and height data from existing datasets with quarterly PlanetScope basemap satellite images to train a multi-task deep learning model that predicts building density and building height at a 37.6-meter per pixel resolution. We apply this model to global PlanetScope basemaps from Q1 2018 through Q2 2025 to create global, temporal maps of building density and height. We validate these maps by comparing against existing building footprint datasets. Our estimates achieve an F1 score between 85% and 88% on different hand-labeled subsets, and are temporally stable, with a 0.96 five-year trend-consistency score. TEMPO captures quarterly changes in built settlements at a fraction of the computational cost of comparable approaches, unlocking large-scale monitoring of development patterns and climate impacts essential for global resilience and adaptation efforts.