Uber ATG Open-Sources Neuropod DL Inference Engine

Every Neuropod model implements a problem definition -- a formal description of a problem for models to solve. As a result, any models that solve the same problem are interchangeable even if they use different frameworks. Existing models can be wrapped in a Neuropod package, which contains the original model along with metadata, test data, and custom ops if any. Since its internal release in early 2019, hundred of Neuropod models have been deployed across Uber ATG, Uber AI, and the core Uber business -- including models for demand forecasting, estimated time of arrival (ETA) prediction for rides, menu transcription for Uber Eats, and object detection models for self-driving vehicles. Neuropod makes it easy for researchers to build models in a framework of their choosing while also simplifying product-ionization of these models, says the company.