Goto

Collaborating Authors

 gestaltmatcher


Improving Deep Facial Phenotyping for Ultra-rare Disorder Verification Using Model Ensembles

Hustinx, Alexander, Hellmann, Fabio, Sümer, Ömer, Javanmardi, Behnam, André, Elisabeth, Krawitz, Peter, Hsieh, Tzung-Chien

arXiv.org Artificial Intelligence

Rare genetic disorders affect more than 6% of the global population. Reaching a diagnosis is challenging because rare disorders are very diverse. Many disorders have recognizable facial features that are hints for clinicians to diagnose patients. Previous work, such as GestaltMatcher, utilized representation vectors produced by a DCNN similar to AlexNet to match patients in high-dimensional feature space to support "unseen" ultra-rare disorders. However, the architecture and dataset used for transfer learning in GestaltMatcher have become outdated. Moreover, a way to train the model for generating better representation vectors for unseen ultra-rare disorders has not yet been studied. Because of the overall scarcity of patients with ultra-rare disorders, it is infeasible to directly train a model on them. Therefore, we first analyzed the influence of replacing GestaltMatcher DCNN with a state-of-the-art face recognition approach, iResNet with ArcFace. Additionally, we experimented with different face recognition datasets for transfer learning. Furthermore, we proposed test-time augmentation, and model ensembles that mix general face verification models and models specific for verifying disorders to improve the disorder verification accuracy of unseen ultra-rare disorders. Our proposed ensemble model achieves state-of-the-art performance on both seen and unseen disorders.


Global Big Data Conference

#artificialintelligence

Rare genetic diseases can sometimes be recognized through facial features, such as characteristically shaped brows, nose or cheeks. Researchers at the University of Bonn have now trained software that uses portrait photos to better diagnose such diseases. The improved version "GestaltMatcher" can now also detect diseases that are not yet known to it. It also manages to diagnose known diseases with very small numbers of patients. The study has now been published in the journal "Nature Genetics".