What's Left? Concept Grounding with Logic-Enhanced Foundation Models