Unraveling Batch Normalization for Realistic Test-Time Adaptation