Animate, or Inanimate, That is the Question for Large Language Models