What is a Number, That a Large Language Model May Know It?