Unveiling the Dynamics of Information Interplay in Supervised Learning