Why reducing the costs of training neural networks remains a challenge

This article is part of our reviews of AI research papers, a series of posts that explore the latest findings in artificial intelligence. In recent years, deep learning has proven to be an effective solution to many of the hard problems of artificial intelligence. But deep learning is also becoming increasingly expensive. Running deep neural networks requires a lot of compute resources, training them even more. The costs of deep learning are causing several challenges for the artificial intelligence community, including a large carbon footprint and the commercialization of AI research.