Anthony Goldbloom is cofounder and CEO of Kaggle, a platform for machine-learning competitions. Almost 500,000 of the world's top data scientists compete on Kaggle to solve important problems for industry, government, and academia. Kaggle has catalyzed breakthroughs in areas ranging from automated essay grading to automated disease diagnosis from medical images. Before cofounding Kaggle in 2010, Anthony was an econometrician at the Australian treasury. In 2013 MIT Technology Review named him one of 35 top innovators under the age of 35.
It is well-known that the precision of data, hyperparameters, and internal representations employed in learning systems directly impacts its energy, throughput, and latency. The precision requirements for the training algorithm are also important for systems that learn on-the-fly. Prior work has shown that the data and hyperparameters can be quantized heavily without incurring much penalty in classification accuracy when compared to floating point implementations. These works suffer from two key limitations. First, they assume uniform precision for the classifier and for the training algorithm and thus miss out on the opportunity to further reduce precision. Second, prior works are empirical studies. In this article, we overcome both these limitations by deriving analytical lower bounds on the precision requirements of the commonly employed stochastic gradient descent (SGD) on-line learning algorithm in the specific context of a support vector machine (SVM). Lower bounds on the data precision are derived in terms of the the desired classification accuracy and precision of the hyperparameters used in the classifier. Additionally, lower bounds on the hyperparameter precision in the SGD training algorithm are obtained. These bounds are validated using both synthetic and the UCI breast cancer dataset. Additionally, the impact of these precisions on the energy consumption of a fixed-point SVM with on-line training is studied.
Artificial Intelligence (AI) is a buzzword that has been coming up more and more in eLearning discussions. It's the next big thing as it has the potential to improve eLearning. Many people ask questions like, "Who uses AI?" "How can it be used?" and "What is its future in the eLearning industry?" This post was first published on eLearning Industry.
Andrew Ng [Co-Founder of Coursera, Stanford Professor, Chief Scientist at Baidu, and All-Around Machine Learning Expert] is writing a book during the summer of 2016. The book is titled, Machine Learning Yearning. It you visit the site and signup quickly you can get draft copies of the chapters as they become available. Andrew is an excellent teacher. His MOOCs are wildly successful, and I expect his book to be excellent as well.