Scalable Inference in SDEs by Direct Matching of the Fokker-Planck-Kolmogorov Equation