Context versus Prior Knowledge in Language Models