The Curious Case of Nonverbal Abstract Reasoning with Multi-Modal Large Language Models