Adaptive Learning for the Resource-Constrained Classification Problem