The Reversible Residual Network: Backpropagation Without Storing Activations

Aidan N. Gomez, Mengye Ren, Raquel Urtasun, Roger B. Grosse

Nov-21-2025, 13:57:50 GMT–Neural Information Processing Systems 

Therefore, the activations for most layers need not be stored in memory during backpropagation.