aqr
Test Time Adaptation Using Adaptive Quantile Recalibration
Mehrbod, Paria, Vianna, Pedro, Nanfack, Geraldin, Wolf, Guy, Belilovsky, Eugene
Domain adaptation is a key strategy for enhancing the generalizability of deep learning models in real-world scenarios, where test distributions often diverge significantly from the training domain. However, conventional approaches typically rely on prior knowledge of the target domain or require model retraining, limiting their practicality in dynamic or resource-constrained environments. Recent test-time adaptation methods based on batch normalization statistic updates allow for unsupervised adaptation, but they often fail to capture complex activation distributions and are constrained to specific normalization layers. We propose Adaptive Quantile Recalibration (AQR), a test-time adaptation technique that modifies pre-activation distributions by aligning quantiles on a channel-wise basis. AQR captures the full shape of activation distributions and generalizes across architectures employing BatchNorm, GroupNorm, or LayerNorm. To address the challenge of estimating distribution tails under varying batch sizes, AQR incorporates a robust tail calibration strategy that improves stability and precision. Our method leverages source-domain statistics computed at training time, enabling unsupervised adaptation without retraining models. Experiments on CIFAR-10-C, CIFAR-100-C, and ImageNet-C across multiple architectures demonstrate that AQR achieves robust adaptation across diverse settings, outperforming existing test-time adaptation baselines. These results highlight AQR's potential for deployment in real-world scenarios with dynamic and unpredictable data distributions.
- North America > Canada > Ontario > Toronto (0.14)
- North America > Canada > Quebec (0.04)
- Europe > Austria (0.04)
- Research Report > New Finding (0.68)
- Research Report > Promising Solution (0.46)
AQR's Problem With Machine Learning: Cats Morph Into Dogs
Machine learning has done magic, such as beating human chess champions. But in finance, expectations for the technology may need to come down a notch or two, according to quantitative firm AQR. In a report published Monday, AQR argues that the benefits of machine learning will likely apply to problems involving optimizing portfolio construction, such as risk management, transaction cost analysis, and factor construction -- at least at first. That's because markets are different from other areas where machine learning has come to offer up breakthrough research, according to "Can Machines Learn Finance?" Machine learning changes the way problems are solved. Traditional computer programmers define all of the rules or parameters of a game.
- Banking & Finance > Trading (0.76)
- Leisure & Entertainment > Games > Chess (0.57)