Thank you for pointing to the interesting question regarding

Neural Information Processing Systems 

We thank the reviewers for their valuable feedback, and we address raised questions and comments below. We will discuss these limitations explicitly in our revised text. In this work we learn only diffuse textures. We will clarify this in the text. We will better define this in the text.