Accelerate and Productionize ML Model Inferencing Using Open-Source Tools

You've finally got that perfect trained model for your data set. To run and deploy it to production, there's a host of issues that lie ahead. Performance latency, environments, framework compatibility, security, deployment targets…there are lots to consider! In this tutorial, we'll look at solutions for these common challenges using ONNX and related tooling. ONNX (Open Neural Network eXchange), an open-source graduate project under the Linux Foundation LF AI, defines a standard format for machine learning models that enables AI developers to use their frameworks and tools of choice to train, infer and deploy on a variety of hardware targets.