Analytical Mean Squared Error Curves in Temporal Difference Learning