Towards the Fundamental Limits of Knowledge Transfer over Finite Domains