Deep learning model compression

With each passing year, models are getting more complex and bigger. A lot of AI models developed in research labs never see the light of the day. We can see that from 2012 to 2015, state-of-the-art Image recognition models went from being 8 layers to 152 layers. This begs the question is there a way to keep the model lighter and still able to process more complex data. The big challenge that we face with a bigger network is the training times.