Alice: Proactive Learning with Teacher's Demonstrations for Weak-to-Strong Generalization