Unraveling the Black-box Magic: An Analysis of Neural Networks' Dynamic Local Extrema