Are Large Language Models Chameleons?