Sound and Complete Neurosymbolic Reasoning with LLM-Grounded Interpretations