GitHub - VoltaML/voltaML: VoltaML is a lightweight library to convert and run your ML/DL deep learning models in high performance inference runtimes like TensorRT, TorchScript, ONNX and TVM.

VoltaML can optimize, compile and deploy your models to your target CPU and GPU devices, with just one line of code. Classification has been done on Imagenet data, batch size 1 and imagesize 224 on NVIDIA RTX 2080Ti. In terms of top 1% and 5% accuracy for int8 models, we have not seen an accuracy drop of more than 1%. Object Detection inference was done on a dummy data with imagesize 640 and batch size 1 on NVIDIA RTX 2080Ti. Segmentation inference was done on a dummy data with imagesize 224 and batch size 1 on NVIDIA RTX 2080Ti.