Mean-Field Simulation-Based Inference for Cosmological Initial Conditions