Creating a Modern, Open Source MLOps Stack at Home

Over the past few years, many organisations have found that although they train great models, they don't always gain long-term value from them. The reason for this is deployment and monitoring. How long does inference take? You might need a GPU. Do you want to predict in batches?