TinyML in a Nutshell

Most Machine Learning models are created to realize that you want to see 50% Memes and 50% cute cats. To do just that they use huge clusters of computers using CPUs and GPUs and even TPUs to deliver these outstanding state-of-the-art Artificial Intelligence recommendation technologies to you. As we all know this and much more computational hardware is used when training, for example, GPT-3 which costs alone in electricity millions of dollars to train. But most of the time, running inference that means predicting on these models is computationally expensive too. Making these types of energy costly operations happen mostly in data centers far away from your phone.