GLAN: A Graph-based Linear Assignment Network