Grounding Object Relations in Language-Conditioned Robotic Manipulation with Semantic-Spatial Reasoning