Energy
Recognizing Images with at most one Spike per Neuron
Stöckl, Christoph, Maass, Wolfgang
In order to port the performance of trained artificial neural networks (ANNs) to spiking neural networks (SNNs), which can be implemented in neuromorphic hardware with a drastically reduced energy consumption, an efficient ANN to SNN conversion is needed. Previous conversion schemes focused on the representation of the analog output of a rectified linear (ReLU) gate in the ANN by the firing rate of a spiking neuron. But this is not possible for other commonly used ANN gates, and it reduces the throughput even for ReLU gates. We introduce a new conversion method where a gate in the ANN, which can basically be of any type, is emulated by a small circuit of spiking neurons, with At Most One Spike (AMOS) per neuron. We show that this AMOS conversion improves the accuracy of SNNs for ImageNet from 74.60% to 80.97%, thereby bringing it within reach of the best available ANN accuracy (85.0%). The Top5 accuracy of SNNs is raised to 95.82%, getting even closer to the best Top5 performance of 97.2% for ANNs. In addition, AMOS conversion improves latency and throughput of spike-based image classification by several orders of magnitude. Hence these results suggest that SNNs provide a viable direction for developing highly energy efficient hardware for AI that combines high performance with versatility of applications.
Artificial Intelligence for Digital Agriculture at Scale: Techniques, Policies, and Challenges
Chaterji, Somali, DeLay, Nathan, Evans, John, Mosier, Nathan, Engel, Bernard, Buckmaster, Dennis, Chandra, Ranveer
Digital agriculture has the promise to transform agricultural throughput. It can do this by applying data science and engineering for mapping input factors to crop throughput, while bounding the available resources. In addition, as the data volumes and varieties increase with the increase in sensor deployment in agricultural fields, data engineering techniques will also be instrumental in collection of distributed data as well as distributed processing of the data. These have to be done such that the latency requirements of the end users and applications are satisfied. Understanding how farm technology and big data can improve farm productivity can significantly increase the world's food production by 2050 in the face of constrained arable land and with the water levels receding. While much has been written about digital agriculture's potential, little is known about the economic costs and benefits of these emergent systems. In particular, the on-farm decision making processes, both in terms of adoption and optimal implementation, have not been adequately addressed. For example, if some algorithm needs data from multiple data owners to be pooled together, that raises the question of data ownership. This paper is the first one to bring together the important questions that will guide the end-to-end pipeline for the evolution of a new generation of digital agricultural solutions, driving the next revolution in agriculture and sustainability under one umbrella.
Learning Directed Locomotion in Modular Robots with Evolvable Morphologies
Lan, Gongjin, De Carlo, Matteo, van Diggelen, Fuda, Tomczak, Jakub M., Roijers, Diederik M., Eiben, A. E.
We generalize the well-studied problem of gait learning in modular robots in two dimensions. Firstly, we address locomotion in a given target direction that goes beyond learning a typical undirected gait. Secondly, rather than studying one fixed robot morphology we consider a test suite of different modular robots. This study is based on our interest in evolutionary robot systems where both morphologies and controllers evolve. In such a system, newborn robots have to learn to control their own body that is a random combination of the bodies of the parents. We apply and compare two learning algorithms, Bayesian optimization and HyperNEAT. The results of the experiments in simulation show that both methods successfully learn good controllers, but Bayesian optimization is more effective and efficient. We validate the best learned controllers by constructing three robots from the test suite in the real world and observe their fitness and actual trajectories. The obtained results indicate a reality gap that depends on the controllers and the shape of the robots, but overall the trajectories are adequate and follow the target directions successfully.
The Urban (Un) Seen "Artificial Intelligence as Future Space" / Bettina Zerza for the Shenzhen Biennale (UABB) 2019
What happens when the sensor-imbued city acquires the ability to see – almost as if it had eyes? Ahead of the 2019 Shenzhen Biennale of Urbanism\Architecture (UABB), titled "Urban Interactions," ArchDaily is working with the curators of the "Eyes of the City" section at the Biennial to stimulate a discussion on how new technologies – and Artificial Intelligence in particular – might impact architecture and urban life. Here you can read the "Eyes of the City" curatorial statement by Carlo Ratti, the Politecnico di Torino and SCUT. Technologies of the virtual realm present an opportunity to rethink the experience of space, society, and culture. They give us the possibility to engage with the city of the future, shaping the built environment of the 21st century.
DEWA strengthens role of AI to drive sustainability
The UAE continues to places great importance to protecting the environment and promoting a green economy, placing sustainability at the forefront of its strategic priorities. This is in line with the UAE Vision 2021, which aims to build a sustainable environment, and a diversified and sustainable competitive economy that ensures a secure future for generations to come. Under the guidance of its wise leadership, the UAE has made great progress towards sustainability, driven by significant achievements in the adoption of advanced technologies to create a new reality and to build a leading global model for sustainable development. The UAE has recognised the importance of Artificial Intelligence (AI) as the cornerstone for achieving sustainability goals, at a time when this advanced technology is expected to contribute to the growth of the country's GDP by 35% until 2031, while also reducing government expenditures by 50% annually, cutting down the number of paper transactions and saving millions of work hours annually. The aim of the UAE Strategy for Artificial Intelligence 2031 is to improve government performance, accelerate the pace of achievements, and to create innovative and productive work environments that ensure high levels of productivity.
Algorithmic Trading – From Microwave Technology to Colocation and Neural Networks The Daily Hodl
Gone are the days of a room full of traders frantically executing trades trying to follow volatile market. Computer algorithms are the technology that shape the market today. Up to 70% of all trades in the United States are now performed by machines and not humans. While algorithmic trading is continuing to grow, the technology keeps improving as well. There are a number of significant technological advancements that are already being implemented and may become a part of the near future in trading.
Intelligence, physics and information -- the tradeoff between accuracy and simplicity in machine learning
How can we enable machines to make sense of the world, and become better at learning? To approach this goal, I believe viewing intelligence in terms of many integral aspects, and also a universal two-term tradeoff between task performance and complexity, provides two feasible perspectives. In this thesis, I address several key questions in some aspects of intelligence, and study the phase transitions in the two-term tradeoff, using strategies and tools from physics and information. Firstly, how can we make the learning models more flexible and efficient, so that agents can learn quickly with fewer examples? Inspired by how physicists model the world, we introduce a paradigm and an AI Physicist agent for simultaneously learning many small specialized models (theories) and the domain they are accurate, which can then be simplified, unified and stored, facilitating few-shot learning in a continual way. Secondly, for representation learning, when can we learn a good representation, and how does learning depend on the structure of the dataset? We approach this question by studying phase transitions when tuning the tradeoff hyperparameter. In the information bottleneck, we theoretically show that these phase transitions are predictable and reveal structure in the relationships between the data, the model, the learned representation and the loss landscape. Thirdly, how can agents discover causality from observations? We address part of this question by introducing an algorithm that combines prediction and minimizing information from the input, for exploratory causal discovery from observational time series. Fourthly, to make models more robust to label noise, we introduce Rank Pruning, a robust algorithm for classification with noisy labels. I believe that building on the work of my thesis we will be one step closer to enable more intelligent machines that can make sense of the world.
S$^{2}$OMGAN: Shortcut from Remote Sensing Images to Online Maps
Chen, X., Chen, S., Xu, T., Yin, B., Mei, X., Peng, J., Li, H.
Traditional online maps, widely used on Internet such as Google map and Baidu map, are rendered from vector data. Timely updating online maps from vector data, of which the generating is time-consuming, is a difficult mission. It is a shortcut to generate online maps in time from remote sensing images, which can be acquired timely without vector data. However, this mission used to be challenging or even impossible. Inspired by image-to-image translation (img2img) techniques based on generative adversarial network (GAN), we propose a semi-supervised structure-augmented online map GAN (S$^{2}$OMGAN) model to generate online maps directly from remote sensing images. In this model, we designed a semi-supervised learning strategy to pre-train S$^{2}$OMGAN on rich unpaired samples and finetune it on limited paired samples in reality. We also designed image gradient L1 loss and image gradient structure loss to generate an online map with global topological relationship and detailed edge curves of objects, which are important in cartography. Moreover, we propose edge structural similarity index (ESSI) as a metric to evaluate the quality of topological consistency between generated online maps and ground truths. Experimental results present that S$^{2}$OMGAN outperforms state-of-the-art (SOTA) works according to mean squared error, structural similarity index and ESSI. Also, S$^{2}$OMGAN wins more approval than SOTA in the human perceptual test on visual realism of cartography. Our work shows that S$^{2}$OMGAN is potentially a new paradigm to produce online maps. Our implementation of the S$^{2}$OMGAN is available at \url{https://github.com/imcsq/S2OMGAN}.
Scientists Repurpose Living Frog Cells to Develop World's First Living Robot
Deniz Kalaslioglu is the Co-Founder & CTO of Soar Robotics a cloud-connected Robotic Intelligence platform for drones. You have over 7 years of experience in operating AI-back autonomous drones. Could you share with us some of the highlights throughout your career? Back in 2012, drones were mostly perceived as military tools by the majority. On the other hand, the improvements in mobile processors, sensors and battery technology had already started creating opportunities for consumer drones to become mainstream.
Towards Stabilizing Batch Statistics in Backward Propagation of Batch Normalization
Yan, Junjie, Wan, Ruosi, Zhang, Xiangyu, Zhang, Wei, Wei, Yichen, Sun, Jian
A BSTRACT Batch Normalization (BN) is one of the most widely used techniques in Deep Learning field. This weakness limits the usage of BN on many computer vision tasks like detection or segmentation, where batch size is usually small due to the constraint of memory consumption. Therefore many modified normalization techniques have been proposed, which either fail to restore the performance of BN completely, or have to introduce additional nonlinear operations in inference procedure and increase huge consumption. In this paper, we reveal that there are two extra batch statistics involved in backward propagation of BN, on which has never been well discussed before. The extra batch statistics associated with gradients also can severely affect the training of deep neural network. Based on our analysis, we propose a novel normalization method, named Moving Average Batch Normalization (MABN). MABN can completely restore the performance of vanilla BN in small batch cases, without introducing any additional nonlinear operations in inference procedure. We prove the benefits of MABN by both theoretical analysis and experiments. Our experiments demonstrate the effectiveness of MABN in multiple computer vision tasks including ImageNet and COCO. It has been widely proven effective in many applications, and become the indispensable part of many state of the art deep models.