Deep Learning
Cell Selection with Deep Reinforcement Learning in Sparse Mobile Crowdsensing
Wang, Leye, Liu, Wenbin, Zhang, Daqing, Wang, Yasha, Wang, En, Yang, Yongjian
Sparse Mobile CrowdSensing (MCS) is a novel MCS paradigm where data inference is incorporated into the MCS process for reducing sensing costs while its quality is guaranteed. Since the sensed data from different cells (sub-areas) of the target sensing area will probably lead to diverse levels of inference data quality, cell selection (i.e., choose which cells of the target area to collect sensed data from participants) is a critical issue that will impact the total amount of data that requires to be collected (i.e., data collection costs) for ensuring a certain level of quality. To address this issue, this paper proposes a Deep Reinforcement learning based Cell selection mechanism for Sparse MCS, called DR-Cell. First, we properly model the key concepts in reinforcement learning including state, action, and reward, and then propose to use a deep recurrent Q-network for learning the Q-function that can help decide which cell is a better choice under a certain state during cell selection. Furthermore, we leverage the transfer learning techniques to reduce the amount of data required for training the Q-function if there are multiple correlated MCS tasks that need to be conducted in the same target area. Experiments on various real-life sensing datasets verify the effectiveness of DR-Cell over the state-of-the-art cell selection mechanisms in Sparse MCS by reducing up to 15% of sensed cells with the same data inference quality guarantee.
Data2Vis: Automatic Generation of Data Visualizations Using Sequence to Sequence Recurrent Neural Networks
Dibia, Victor, Demiralp, รaฤatay
Rapidly creating effective visualizations using expressive grammars is challenging for users who have limited time and limited skills in statistics and data visualization. Even high-level, dedicated visualization tools often require users to manually select among data attributes, decide which transformations to apply, and specify mappings between visual encoding variables and raw or transformed attributes. In this paper we introduce Data2Vis, a neural translation model for automatically generating visualizations from given datasets. We formulate visualization generation as a sequence to sequence translation problem where data specifications are mapped to visualization specifications in a declarative language (Vega-Lite). To this end, we train a multilayered attention-based recurrent neural network (RNN) with long short-term memory (LSTM) units on a corpus of visualization specifications. Qualitative results show that our model learns the vocabulary and syntax for a valid visualization specification, appropriate transformations (count, bins, mean) and how to use common data selection patterns that occur within data visualizations. Data2Vis generates visualizations that are comparable to manually-created visualizations in a fraction of the time, with potential to learn more complex visualization strategies at scale.
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
Bai, Shaojie, Kolter, J. Zico, Koltun, Vladlen
For most deep learning practitioners, sequence modeling is synonymous with recurrent networks. Yet recent results indicate that convolutional architectures can outperform recurrent networks on tasks such as audio synthesis and machine translation. Given a new sequence modeling task or dataset, which architecture should one use? We conduct a systematic evaluation of generic convolutional and recurrent architectures for sequence modeling. The models are evaluated across a broad range of standard tasks that are commonly used to benchmark recurrent networks. Our results indicate that a simple convolutional architecture outperforms canonical recurrent networks such as LSTMs across a diverse range of tasks and datasets, while demonstrating longer effective memory. We conclude that the common association between sequence modeling and recurrent networks should be reconsidered, and convolutional networks should be regarded as a natural starting point for sequence modeling tasks. To assist related work, we have made code available at http://github.com/locuslab/TCN .
Teaching computers to play Doom is a blind alley for AI โ here's an alternative
Games have long been used as testbeds and benchmarks for artificial intelligence, and there has been no shortage of achievements in recent months. Google DeepMind's AlphaGo and poker bot Libratus from Carnegie Mellon University have both beaten human experts at games that have traditionally been hard for AI โ some 20 years after IBM's DeepBlue achieved the same feat in chess. Games like these have the attraction of clearly defined rules; they are relatively simple and cheap for AI researchers to work with, and they provide a variety of cognitive challenges at any desired level of difficulty. By inventing algorithms that play them well, researchers hope to gain insights into the mechanisms needed to function autonomously. With the arrival of the latest techniques in AI and machine learning, attention is now shifting to visually detailed computer games โ including the 3D shooter Doom, various 2D Atari games such as Pong and Space Invaders, and the real-time strategy game StarCraft.
Is Your Company Ready To Invest in AI?
Neither example cited by Gualtieri is science fiction-worthy, but techniques like natural language processing (NLP) and deep learning have the potential to help companies save time and improve operations on a massive scale. That's not conjecture: A DataScience.com client once leveraged NLP to parse thousands of customer support inquiries and online reviews for information about the most critical issues facing its product, eliminating hundreds of hours spent on manual searches. The improvements the company made based on that information resulted in a 500-point increase in net promoter score.
Behavioral Cloning in Deep Learning using Keras โ Harveen Singh โ Medium
I am into my first term of Udacity's Self Driving Car Nanodegree and I want to share my experiences regarding one of my recent projects. The objective of this project is to basically apply the concepts of Deep Learning and Convolutional Neural Networks to teach the machine to drive car autonomously. How is this even possible? First things first, it is not magic but it really feels like magic. With just a bunch of Python libraries, some lines of Code and huge amount of Data we can teach a car to drive itself.
Hype & Disadvantages of Neural Networks โ Towards Data Science
Deep Learning enjoys its current hype for four main reasons. These are data, computational power, the algorithms itself and marketing. We will discuss each of them in the following sections. One of the things that increased the popularity of Deep Learning is the massive amount of data that is available in 2018, which has been gathered over the last years and decades. This enables Neural Networks to really show their potential since they get better the more data you fed into them.
Deep Learning from first principles in Python, R and Octave โ Part 6
"Today you are You, that is truer than true. There is no one alive who is Youer than You." "Explanations exist; they have existed for all time; there is always a well-known solution to every human problem -- neat, plausible, and wrong." In this 6th instalment of'Deep Learning from first principles in Python, R and Octave-Part6', I look at a couple of different initialization techniques used in Deep Learning, L2 regularization and the'dropout' method. Specifically, I implement "He initialization" & "Xavier Initialization". The implementation was in vectorized Python, R and Octave 3. Part 3 -In part 3, I derive the equations and also implement a L-Layer Deep Learning network with either the relu, tanh or sigmoid activation function in Python, R and Octave.
Notes from the AI frontier: Applications and value of deep learning
An analysis of more than 400 use cases across 19 industries and nine business functions highlights the broad use and significant economic potential of advanced AI techniques. Artificial intelligence (AI) stands out as a transformational technology of our digital age--and its practical application throughout the economy is growing apace. For this briefing, Notes from the AI frontier: Insights from hundreds of use cases (PDFโ446KB), we mapped both traditional analytics and newer "deep learning" techniques and the problems they can solve to more than 400 specific use cases in companies and organizations. Drawing on McKinsey Global Institute research and the applied experience with AI of McKinsey Analytics, we assess both the practical applications and the economic potential of advanced AI techniques across industries and business functions. Our findings highlight the substantial potential of applying deep learning techniques to use cases across the economy, but we also see some continuing limitations and obstacles--along with future opportunities as the technologies continue their advance.
Big Data: Deep Learning for Financial Sentiment Analysis
These problems can be solved using deep learning models. The financial domain is a highly difficult field and non-linear with a huge number of factors affecting each other. By the use of deep learning, you can be able to conduct financial sentiment analysis from large-scaled and unlabeled data. As time passes by, every organization is now having huge amounts of Big Data. This makes deep learning a valuable tool in analyzing the data.