Serving PyTorch Models Using TorchServe - Supertype

Model serving has always been a crucial process in MLOps as it decides whether an AI product will be accessible to the user. Upon developing a model that can perform a certain task, the next step is to serve the model so that it is accessible through an API, hence enabling applications to incorporate AI into the system. This process also includes model monitoring and management, which gives the ability to ensure that the model can function properly and scale the model on demand. Various tools have been built as a solution to serve models. Don't worry if some of the terms does not make any sense to you yet.