On Adaptivity in Information-constrained Online Learning