Frog Soup: Zero-Shot, In-Context, and Sample-Efficient Frogger Agents