Planning from Pixels in Environments with Combinatorially Hard Search Spaces