Machines Learn Better if We Teach Them the Basics