When Not to Choose the Best NLP Model

In the book "Deep Survival", Laurence Gonzales notes that pilots often warn each other against trying to "land the model instead of the plane". This reminds pilots not to get too obsessed with their expected models of the world and, as a result, ignore the most relevant information right in front of them. Statisticians echo a similar fear when they note that all models are wrong, but some are useful. We need to have similar vigilance in Natural Language Processing (NLP) now due to the explosion of new model availability. While these models are indeed incredible and do show unparalleled results, they may not be suited for your NLP task or your business.