Scaling Face Interaction Graph Networks to Real World Scenes