Asia
Synchronous Bidirectional Neural Machine Translation
Zhou, Long, Zhang, Jiajun, Zong, Chengqing
Existing approaches to neural machine translation (NMT) generate the target language sequence token by token from left to right. However, this kind of unidirectional decoding framework cannot make full use of the target-side future contexts which can be produced in a right-to-left decoding direction, and thus suffers from the issue of unbalanced outputs. In this paper, we introduce a synchronous bidirectional neural machine translation (SB-NMT) that predicts its outputs using left-to-right and right-to-left decoding simultaneously and interactively, in order to leverage both of the history and future information at the same time. Specifically, we first propose a new algorithm that enables synchronous bidirectional decoding in a single model. Then, we present an interactive decoding model in which left-to-right (right-to-left) generation does not only depend on its previously generated outputs, but also relies on future contexts predicted by right-to-left (left-to-right) decoding. We extensively evaluate the proposed SB-NMT model on large-scale NIST Chinese-English, WMT14 English-German, and WMT18 Russian-English translation tasks. Experimental results demonstrate that our model achieves significant improvements over the strong Transformer model by 3.92, 1.49 and 1.04 BLEU points respectively, and obtains the state-of-the-art performance on Chinese-English and English-German translation tasks.
DeepIlluminance: Contextual Illuminance Estimation via Deep Neural Networks
Zhang, Jun, Zheng, Tong, Zhang, Shengping, Wang, Meng
Computational color constancy refers to the estimation of the scene illumination and makes the perceived color relatively stable under varying illumination. In the past few years, deep Convolutional Neural Networks (CNNs) have delivered superior performance in illuminant estimation. Several representative methods formulate it as a multi-label prediction problem by learning the local appearance of image patches using CNNs. However, these approaches inevitably make incorrect estimations for the ambiguous patches affected by their neighborhood contexts. Inaccurate local estimates are likely to bring in degraded performance when combining into a global prediction. To address the above issues, we propose a contextual deep network for patch-based illuminant estimation equipped with refinement. First, the contextual net with a center-surround architecture extracts local contextual features from image patches, and generates initial illuminant estimates and the corresponding color corrected patches. The patches are sampled based on the observation that pixels with large color differences describe the illumination well. Then, the refinement net integrates the input patches with the corrected patches in conjunction with the use of intermediate features to improve the performance. To train such a network with numerous parameters, we propose a stage-wise training strategy, in which the features and the predicted illuminant from previous stages are provided to the next learning stage with more finer estimates recovered. Experiments show that our approach obtains competitive performance on two illuminant estimation benchmarks.
Rough Contact in General Rough Mereology
Theories of rough mereology have originated from diverse semantic considerations from contexts relating to study of databases, to human reasoning. These ideas of origin, especially in the latter context, are intensely complex. In this research, concepts of rough contact relations are introduced and rough mereologies are situated in relation to general spatial mereology by the present author. These considerations are restricted to her rough mereologies that seek to avoid contamination.
Approximated Oracle Filter Pruning for Destructive CNN Width Optimization
Ding, Xiaohan, Ding, Guiguang, Guo, Yuchen, Han, Jungong, Yan, Chenggang
It is not easy to design and run Convolutional Neural Networks (CNNs) due to: 1) finding the optimal number of filters (i.e., the width) at each layer is tricky, given an architecture; and 2) the computational intensity of CNNs impedes the deployment on computationally limited devices. Oracle Pruning is designed to remove the unimportant filters from a well-trained CNN, which estimates the filters' importance by ablating them in turn and evaluating the model, thus delivers high accuracy but suffers from intolerable time complexity, and requires a given resulting width but cannot automatically find it. To address these problems, we propose Approximated Oracle Filter Pruning (AOFP), which keeps searching for the least important filters in a binary search manner, makes pruning attempts by masking out filters randomly, accumulates the resulting errors, and finetunes the model via a multi-path framework. As AOFP enables simultaneous pruning on multiple layers, we can prune an existing very deep CNN with acceptable time cost, negligible accuracy drop, and no heuristic knowledge, or re-design a model which exerts higher accuracy and faster inference.
Learning Phase Competition for Traffic Signal Control
Zheng, Guanjie, Xiong, Yuanhao, Zang, Xinshi, Feng, Jie, Wei, Hua, Zhang, Huichu, Li, Yong, Xu, Kai, Li, Zhenhui
Increasingly available city data and advanced learning techniques have empowered people to improve the efficiency of our city functions. Among them, improving the urban transportation efficiency is one of the most prominent topics. Recent studies have proposed to use reinforcement learning (RL) for traffic signal control. Different from traditional transportation approaches which rely heavily on prior knowledge, RL can learn directly from the feedback. On the other side, without a careful model design, existing RL methods typically take a long time to converge and the learned models may not be able to adapt to new scenarios. For example, a model that is trained well for morning traffic may not work for the afternoon traffic because the traffic flow could be reversed, resulting in a very different state representation. In this paper, we propose a novel design called FRAP, which is based on the intuitive principle of phase competition in traffic signal control: when two traffic signals conflict, priority should be given to one with larger traffic movement (i.e., higher demand). Through the phase competition modeling, our model achieves invariance to symmetrical cases such as flipping and rotation in traffic flow. By conducting comprehensive experiments, we demonstrate that our model finds better solutions than existing RL methods in the complicated all-phase selection problem, converges much faster during training, and achieves superior generalizability for different road structures and traffic conditions.
Machine Learning Cryptanalysis of a Quantum Random Number Generator
Truong, Nhan Duy, Haw, Jing Yan, Assad, Syed Muhamad, Lam, Ping Koy, Kavehei, Omid
Random number generators (RNGs) that are crucial for cryptographic applications have been the subject of adversarial attacks. These attacks exploit environmental information to predict generated random numbers that are supposed to be truly random and unpredictable. Though quantum random number generators (QRNGs) are based on the intrinsic indeterministic nature of quantum properties, the presence of classical noise in the measurement process compromises the integrity of a QRNG. In this paper, we develop a predictive machine learning (ML) analysis to investigate the impact of deterministic classical noise in different stages of an optical continuous variable QRNG. Our ML model successfully detects inherent correlations when the deterministic noise sources are prominent. After appropriate filtering and randomness extraction processes are introduced, our QRNG system, in turn, demonstrates its robustness against ML. We further demonstrate the robustness of our ML approach by applying it to uniformly distributed random numbers from the QRNG and a congruential RNG. Hence, our result shows that ML has potentials in benchmarking the quality of RNG devices.
Scientists in China develop ultra-long range camera that can photograph subjects from 28 MILES away
Chinese researchers have developed a new camera technology that can render human sized-subjects as far as 28 miles away. According to a paper from researcher Zheng-Ping Li published in the open source journal ArXiv, the camera technology can cut through smog and other pollution using a mixture of laser imaging and advanced AI software. While LIDAR technology, which stands for Light Detection and Ranging, has been used previously in other cameras and imaging techniques, researchers say a new software helps to mitigate the noise of predecessors. Chinese researchers have developed a new camera technology that can render human sized-subjects as far as 28 miles away. In a technique called'gating' software helps ignore photons reflected by other objects in the camera's field of view.
What's Ahead for Manufacturing AI
A new generation of point artificial intelligence solutions will prove themselves in the near future. They'll build new trust, urgency and understanding of what'AI' actually is and just how much it can deliver. Voice-driven solutions will lead the charge. And we'll see pick-and-place robots in smart warehouses delivering a major competitive edge, as companies advance their use of Robotic Process Automation. Here are my three key predictions for AI in manufacturing.
Artificial intelligence revolution happening now
The Turkey Artificial Intelligence Initiative (TRAI) was held for the third time this year, with participation from its founders and supporters. I also participated in it. The event posed the following questions: "Where is the private sector in Turkey in terms of artificial intelligence (AI)?" and "What stage is it at?" Private sector representatives and academics drew Turkey's artificial intelligence picture with their discussions on common platforms. Gelecekhane CEO Halil Aksu, one of the founders of the TRAI, said during the workshop that important progress has been made in Turkey in the last two to three years in terms of AI.
Training CNNs with Selective Allocation of Channels
Recent progress in deep convolutional neural networks (CNNs) have enabled a simple paradigm of architecture design: larger models typically achieve better accuracy. Due to this, in modern CNN architectures, it becomes more important to design models that generalize well under certain resource constraints, e.g. the number of parameters. In this paper, we propose a simple way to improve the capacity of any CNN model having large-scale features, without adding more parameters. In particular, we modify a standard convolutional layer to have a new functionality of channel-selectivity, so that the layer is trained to select important channels to re-distribute their parameters. Our experimental results under various CNN architectures and datasets demonstrate that the proposed new convolutional layer allows new optima that generalize better via efficient resource utilization, compared to the baseline.