Industry
Switching Temporary Teachers for Semi-Supervised Semantic Segmentation
The teacher-student framework, prevalent in semi-supervised semantic segmentation, mainly employs the exponential moving average (EMA) to update a single teacher's weights based on the student's. However, EMA updates raise a problem in that the weights of the teacher and student are getting coupled, causing a potential performance bottleneck. Furthermore, this problem may become more severe when training with more complicated labels such as segmentation masks but with few annotated data. This paper introduces Dual Teacher, a simple yet effective approach that employs dual temporary teachers aiming to alleviate the coupling problem for the student.
The Nothing That Has the Potential to Be Anything
You can never truly empty a box. Suppose you want to empty a box. You remove all its visible contents, pump out any gases, and--applying some science-fiction technology--evacuate any unseeable material such as dark matter. According to quantum mechanics, what's left inside? It sounds like a trick question.