Ok, Google -- How do you run Deep Learning Inference on Android Using TensorFlow?

There are many situations when running deep learning inferences on local devices is preferable for both individuals and companies: imagine traveling with no reliable internet connection available or dealing with privacy concerns and latency issues on transferring data to cloud-based services. Edge computing provides solutions to these problems by processing and analyzing data at the edge of network. Take the "Ok Google" feature as an example -- by training "Ok Google" with a user's voice, that user's mobile phone will be activated when capturing the keywords. This kind of small-footprint keyword-spotting (KWS) inference usually happens on-device so you don't have to worry that the service providers are listening to you all the time. The cloud-based services will only be initiated after you make the commands.