World Models with Hints of Large Language Models for Goal Achieving