Supervising the Transfer of Reasoning Patterns in VQA