Towards Auditability for Fairness in Deep Learning