Is Your Large Language Model Knowledgeable or a Choices-Only Cheater?