Supplementary Material for " AttendLight: Universal Attention-Based Reinforcement Learning Model for Traffic Signal Control "