Continual learning aims to improve the ability of modern learning systems todeal with non-stationary distributions, typically by attempting to learn a seriesof tasks sequentially.
We therefore assume that the algorithm has access to an oracle that knows intuitively what it means to be fair, but cannot explicitly enunciate the fairness metric.