Operating critical machine learning models in resource constrained regimes