Gradientbasedsampleselectionforonlinecontinual learning

Acontinual learning agent learns online with anon-stationary andnever-ending stream ofdata. Thekeytosuch learning process istoovercome thecatastrophic forgetting of previously seen data, which is a well known problem of neuralnetworks.