Where is the Truth? The Risk of Getting Confounded in a Continual World