Deep Learning
Supervised and Unsupervised Learning with Python
Build real-world Artificial Intelligence (AI) applications to intelligently interact with the world around you, explore real-world scenarios, and learn about the various algorithms that can be used to build AI applications. Packed with insightful examples and topics such as predictive analytics and deep learning, this course is a must-have for Python developers. Prateek Joshi is an artificial intelligence researcher, published author of five books, and TEDx speaker. He is the founder of Pluto AI, a venture-funded Silicon Valley start-up that builds analytics platforms for smart water management powered by deep learning. His work in this field has led to patents, tech demos, and research papers at major IEEE conferences.
How to build your own Neural Network from scratch in Python
Motivation: As part of my personal journey to gain a better understanding of Deep Learning, I've decided to build a Neural Network from scratch without a deep learning library like TensorFlow. I believe that understanding the inner workings of a Neural Network is important to any aspiring Data Scientist. This article contains what I've learned, and hopefully it'll be useful for you as well! Most introductory texts to Neural Networks brings up brain analogies when describing them. Without delving into brain analogies, I find it easier to simply describe Neural Networks as a mathematical function that maps a given input to a desired output.
PyTorch by Example
In this talk, Jendrik Joerdening talks about PyTorch, what it is, how to build neural networks with it, and compares it to other frameworks. This video was recorded at QCon.ai 2018: bit.ly/2piRtLl The next QCon is in New York, June 25-29, 2018. Check out the tracks and speakers: bit.ly/2JFHitG If you are a software engineer who wants to learn more about artificial intelligence, machine learning and data engineering from the industry experts and practitioners, follow the topic on InfoQ: bit.ly/2rrEicK
Rebalancing Dockless Bike Sharing Systems
Pan, Ling, Cai, Qingpeng, Fang, Zhixuan, Tang, Pingzhong, Huang, Longbo
Bike sharing provides an environment-friendly way for traveling and is booming worldwide. Yet, due to the high similarity of user travel patterns, the bike imbalance problem constantly occurs, especially for dockless bike sharing systems, causing significant impact on service quality and company revenue. Thus, it has become a critical task for bike sharing systems to resolve such imbalance efficiently. In this paper, we propose a novel deep reinforcement learning framework for incentivizing users to rebalance such sys- tems. We model this problem as a Markov decision process and take both spatial and temporal features into consideration. We develop a novel deep reinforcement learning algorithm called Hierarchical Reinforcement Pricing (HRP), which builds upon the Deep Deterministic Policy Gradient algorithm. Different from existing methods that often ignore spatial information and rely heavily on accurate prediction, HRP can capture both spatial and temporal dependencies using a divide-and-conquer structure with an embedded localized module. We conduct extensive experiments to evaluate HRP, based on a dataset from Mobike, a major Chinese dockless bike sharing company. Results show that HRP performs close to the 24-timeslot look-ahead optimization, and outperforms state-of-the-art methods in both service level and bike distribution. It also transfers well when applied to unseen areas.
GSAE: an autoencoder with embedded gene-set nodes for genomics functional characterization
Chen, Hung-I Harry, Chiu, Yu-Chiao, Zhang, Tinghe, Zhang, Songyao, Huang, Yufei, Chen, Yidong
Bioinformatics tools have been developed to interpret gene expression data at the gene set level, and these gene set based analyses improve the biologists' capability to discover functional relevance of their experiment design. While elucidating gene set individually, inter gene sets association is rarely taken into consideration. Deep learning, an emerging machine learning technique in computational biology, can be used to generate an unbiased combination of gene set, and to determine the biological relevance and analysis consistency of these combining gene sets by leveraging large genomic data sets. In this study, we proposed a gene superset autoencoder (GSAE), a multi-layer autoencoder model with the incorporation of a priori defined gene sets that retain the crucial biological features in the latent layer. We introduced the concept of the gene superset, an unbiased combination of gene sets with weights trained by the autoencoder, where each node in the latent layer is a superset. Trained with genomic data from TCGA and evaluated with their accompanying clinical parameters, we showed gene supersets' ability of discriminating tumor subtypes and their prognostic capability. We further demonstrated the biological relevance of the top component gene sets in the significant supersets. Using autoencoder model and gene superset at its latent layer, we demonstrated that gene supersets retain sufficient biological information with respect to tumor subtypes and clinical prognostic significance. Superset also provides high reproducibility on survival analysis and accurate prediction for cancer subtypes.
Improved Learning of One-hidden-layer Convolutional Neural Networks with Overlaps
We propose a new algorithm to learn a one-hidden-layer convolutional neural network where both the convolutional weights and the outputs weights are parameters to be learned. Our algorithm works for a general class of (potentially overlapping) patches, including commonly used structures for computer vision tasks. Our algorithm draws ideas from (1) isotonic regression for learning neural networks and (2) landscape analysis of non-convex matrix factorization problems. We believe these findings may inspire further development in designing provable algorithms for learning neural networks and other complex models.