Teaching Wav2Vec2 the Language of the Brain