NLP Model Serving with Deepset's Haystack and FastAPI on AWS App Runner

In this blogpost, we will walkthrough how make use of AWS App Runner, a managed container service to deploy an NLP model inference service. This service uses deepset's haystack for a simple Q&A application and a REST API. Anyone with interests in football transfers can make use of the simple Q&A application. To stay updated with the latest news on football transfers, I noticed that I spend a lot scrolling through tons of tweets to stay updated. Transfer news are part of the excitement in football -- fans want to know which players are joining or leaving.