DEFT: Distilling Entangled Factors