The NLP Cypher

Hey … so have you ever deployed a state-of-the-art production level inference server? Don't know how to do it? Well… last week, Michael Benesty dropped a bomb when he published one of the first ever detailed blogs on how to not only deploy a production level inference API but benchmarking some of the most widely used frameworks such as FastAPI and Triton servers and runtime engines such as ONNX runtime (ORT) and TensorRT (TRT). PyTorch Lite Inference Toolkit: works with Hugging Face pipeline. Create graphs with your text data.