Elastic Weight Consolidation Improves the Robustness of Self-Supervised Learning Methods under Transfer