Referee Can Play: An Alternative Approach to Conditional Generation via Model Inversion