I Prefer not to Say: Protecting User Consent in Models with Optional Personal Data