775226eaa2a36c543e2bd6cc9eae1b6a-Paper-Conference.pdf

Inthis work, we show that the reason for this deficiency is that language models are biased to learn word co-occurrence statistics instead of true factual associations.