Causal Inference in Possibly Nonlinear Factor Models