Time-, Memory- and Parameter-Efficient Visual Adaptation