Asia
Dubai Health Authority launches artificial intelligence strategy
The Dubai Health Authority (DHA) has launched an artificial intelligence (AI) strategy to support its medical systems and equip medical personnel with technologies to use in the diagnosis and treatment of patients. The forecast for the future is in and, in typical British fashion, it looks like it's going to be cloudy. Our IT Priorities survey has revealed that organisations are planning on making the most of the cloud in the future. Download our IT Priorities results for more insights into where the IT industry is going. You forgot to provide an Email Address.
About
Adam Drake's professional background includes a wide range of technical and leadership roles, including: leading technical business transformations in global and multi-cultural environments, performing in-depth technical due-diligence and funding analysis for investors, and mentoring new technical and operational executives. His passion is to help companies become more productive by improving internal leadership capabilities, and accelerating product development through technology and data architecture guidance. His technical interests include online learning systems, high-frequency/low-latency data processing systems, recommender systems, distributed systems, and functional programming. Adam has a background in Applied Mathematics and has worked in technology roles since the 90s. Some talks I've given, in reverse chronological order: I was honored to be invited by DevTO to give a talk at their May meetup.
Hiroshima lives before the bomb recreated with colorized photos๏ผThe Asahi Shimbun
HIROSHIMA--Students here are recreating the lives of people devastated by the atomic bombing on Aug. 6, 1945, by vividly colorizing photos taken before the city was leveled by the nuclear attack. Students from Hiroshima Jogakuin Senior High School combine artificial intelligence technology and interviews with atomic bomb survivors to produce realistic coloring of black-and-white photos provided by hibakusha. Monochrome pictures snapped before and during World War II are automatically colorized with artificial intelligence. The processed photos are shown to hibakusha so colors can be manually adjusted based on their accounts. Converting one black-and-white photo into color takes from one week to several months, and 140 pictures have been colorized since November.
DeepTracker: Visualizing the Training Process of Convolutional Neural Networks
Liu, Dongyu, Cui, Weiwei, Jin, Kai, Guo, Yuxiao, Qu, Huamin
Deep convolutional neural networks (CNNs) have achieved remarkable success in various fields. However, training an excellent CNN is practically a trial-and-error process that consumes a tremendous amount of time and computer resources. To accelerate the training process and reduce the number of trials, experts need to understand what has occurred in the training process and why the resulting CNN behaves as such. However, current popular training platforms, such as TensorFlow, only provide very little and general information, such as training/validation errors, which is far from enough to serve this purpose. To bridge this gap and help domain experts with their training tasks in a practical environment, we propose a visual analytics system, DeepTracker, to facilitate the exploration of the rich dynamics of CNN training processes and to identify the unusual patterns that are hidden behind the huge amount of training log. Specifically,we combine a hierarchical index mechanism and a set of hierarchical small multiples to help experts explore the entire training log from different levels of detail. We also introduce a novel cube-style visualization to reveal the complex correlations among multiple types of heterogeneous training data including neuron weights, validation images, and training iterations. Three case studies are conducted to demonstrate how DeepTracker provides its users with valuable knowledge in an industry-level CNN training process, namely in our case, training ResNet-50 on the ImageNet dataset. We show that our method can be easily applied to other state-of-the-art "very deep" CNN models.
Playing 20 Question Game with Policy-Based Reinforcement Learning
Hu, Huang, Wu, Xianchao, Luo, Bingfeng, Tao, Chongyang, Xu, Can, Wu, Wei, Chen, Zhan
The 20 Questions (Q20) game is a well known game which encourages deductive reasoning and creativity. In the game, the answerer first thinks of an object such as a famous person or a kind of animal. Then the questioner tries to guess the object by asking 20 questions. In a Q20 game system, the user is considered as the answerer while the system itself acts as the questioner which requires a good strategy of question selection to figure out the correct object and win the game. However, the optimal policy of question selection is hard to be derived due to the complexity and volatility of the game environment. In this paper, we propose a novel policy-based Reinforcement Learning (RL) method, which enables the questioner agent to learn the optimal policy of question selection through continuous interactions with users. To facilitate training, we also propose to use a reward network to estimate the more informative reward. Compared to previous methods, our RL method is robust to noisy answers and does not rely on the Knowledge Base of objects. Experimental results show that our RL method clearly outperforms an entropy-based engineering system and has competitive performance in a noisy-free simulation environment.
ACVAE-VC: Non-parallel many-to-many voice conversion with auxiliary classifier variational autoencoder
Kameoka, Hirokazu, Kaneko, Takuhiro, Tanaka, Kou, Hojo, Nobukatsu
This paper proposes a non-parallel many-to-many voice conversion (VC) method using a variant of the conditional variational autoencoder (VAE) called an auxiliary classifier VAE (ACVAE). The proposed method has three key features. First, it adopts fully convolutional architectures to construct the encoder and decoder networks so that the networks can learn conversion rules that capture time dependencies in the acoustic feature sequences of source and target speech. Second, it uses an information-theoretic regularization for the model training to ensure that the information in the attribute class label will not be lost in the conversion process. With regular CVAEs, the encoder and decoder are free to ignore the attribute class label input. This can be problematic since in such a situation, the attribute class label will have little effect on controlling the voice characteristics of input speech at test time. Such situations can be avoided by introducing an auxiliary classifier and training the encoder and decoder so that the attribute classes of the decoder outputs are correctly predicted by the classifier. Third, it avoids producing buzzy-sounding speech at test time by simply transplanting the spectral details of the input speech into its converted version. Subjective evaluation experiments revealed that this simple method worked reasonably well in a non-parallel many-to-many speaker identity conversion task.
From Random to Supervised: A Novel Dropout Mechanism Integrated with Global Information
Xu, Hengru, Li, Shen, Hu, Renfen, Li, Si, Gao, Sheng
Dropout is used to avoid overfitting by randomly dropping units from the neural networks during training. Inspired by dropout, this paper presents GI-Dropout, a novel dropout method integrating with global information to improve neural networks for text classification. Unlike the traditional dropout method in which the units are dropped randomly according to the same probability, we aim to use explicit instructions based on global information of the dataset to guide the training process. With GI-Dropout, the model is supposed to pay more attention to inapparent features or patterns. Experiments demonstrate the effectiveness of the dropout with global information on seven text classification tasks, including sentiment analysis and topic classification.
NonSTOP: A NonSTationary Online Prediction Method for Time Series
Xie, Christopher, Bijral, Avleen, Ferres, Juan Lavista
We present online prediction methods for time series that let us explicitly handle nonstationary artifacts (e.g. trend and seasonality) present in most real time series. Specifically, we show that applying appropriate transformations to such time series before prediction can lead to improved theoretical and empirical prediction performance. Moreover, since these transformations are usually unknown, we employ the learning with experts setting to develop a fully online method (NonSTOP-NonSTationary Online Prediction) for predicting nonstationary time series. This framework allows for seasonality and/or other trends in univariate time series and cointegration in multivariate time series. Our algorithms and regret analysis subsume recent related work while significantly expanding the applicability of such methods. For all the methods, we provide sub-linear regret bounds using relaxed assumptions. The theoretical guarantees do not fully capture the benefits of the transformations, thus we provide a data-dependent analysis of the follow-the-leader algorithm that provides insight into the success of using such transformations. We support all of our results with experiments on simulated and real data.
Ensemble Learning Applied to Classify GPS Trajectories of Birds into Male or Female
We describe our first-place solution to the Animal Behavior Challenge (ABC 2018) on predicting gender of bird from its GPS trajectory. The task consisted in predicting the gender of shearwater based on how they navigate themselves across a big ocean. The trajectories are collected from GPS loggers attached on shearwaters' body, and represented as a variable-length sequence of GPS points (latitude and longitude), and associated meta-information, such as the sun azimuth, the sun elevation, the daytime, the elapsed time on each GPS location after starting the trip, the local time (date is trimmed), and the indicator of the day starting the from the trip. We used ensemble of several variants of Gradient Boosting Classifier along with Gaussian Process Classifier and Support Vector Classifier after extensive feature engineering and we ranked first out of 74 registered teams. The variants of Gradient Boosting Classifier we tried are CatBoost (Developed by Yandex), LightGBM (Developed by Microsoft), XGBoost (Developed by Distributed Machine Learning Community). Our approach could easily be adapted to other applications in which the goal is to predict a classification output from a variable-length sequence.
Multi-Level Network Embedding with Boosted Low-Rank Matrix Approximation
Li, Jundong, Wu, Liang, Liu, Huan
Abstract--As opposed to manual feature engineering which is tedious and difficult to scale, network representation learning has attracted a surge of research interests as it automates the process of feature learning on graphs. The learned lowdimensional node vector representation is generalizable and eases the knowledge discovery process on graphs by enabling various off-the-shelf machine learning tools to be directly applied. Recent research has shown that the past decade of network embedding approaches either explicitly factorize a carefully designed matrix to obtain the low-dimensional node vector representation or are closely related to implicit matrix factorization, with the fundamental assumption that the factorized node connectivity matrix is low-rank. Nonetheless, the global low-rank assumption does not necessarily hold especially when the factorized matrix encodes complex node interactions, and the resultant single low-rank embedding matrix is insufficient to capture all the observed connectivity patterns. In this regard, we propose a novel multilevel network embedding framework BoostNE, which can learn multiple network embedding representations of different granularity from coarse to fine without imposing the prevalent global low-rank assumption. The proposed BoostNE method is also in line with the successful gradient boosting method in ensemble learning as multiple weak embeddings lead to a stronger and more effective one. We assess the effectiveness of the proposed BoostNE framework by comparing it with existing state-of-the-art network embedding methods on various datasets, and the experimental results corroborate the superiority of the proposed BoostNE network embedding framework. Learning meaningful and discriminative representations of nodes in a network is essential for various network analytical tasks as it avoids the laborious manual feature engineering process.