Were Residual Penalty and Neural Operators All We Needed for Solving Optimal Control Problems?