[D] Tips for conversations with stakeholders around model evaluation metrics?

Generally the conversations I've had are around memorization vs. learning. If I give a student a test in a subject over and over again, chances are they will memorize answers rather than learn the material. If I give a student a project that they need to use the skills I teach them in order to create something new, and they succeed, I know I have taught them something rather than just asked them to answer questions that they memorized. If they fail I know I need to go back and teach them a different way. ML models behave in a similar fashion.