Planning with Adaptive World Models for Autonomous Driving