On the Ergodicity, Bias and Asymptotic Normality of Randomized Midpoint Sampling Method