Goto

Collaborating Authors

 Energy


Students develop tool to predict the carbon footprint of algorithms

#artificialintelligence

However, the rapidly evolving technology, one that has otherwise been expected to serve as an effective weapon against climate change, has a downside that many people are unaware of -- sky high energy consumption. Artificial intelligence, and particularly the subfield of deep learning, appears likely to become a significant climate culprit should industry trends continue. In only six years -- from 2012 to 2018 -- the compute needed for deep learning has grown 300,000%. However, the energy consumption and carbon footprint associated with developing algorithms is rarely measured, despite numerous studies that clearly demonstrate the growing problem. In response to the problem, two students at the University of Copenhagen's Department of Computer Science, Lasse F. Wolff Anthony and Benjamin Kanding, together with Assistant Professor Raghavendra Selvan, have developed a software programme they call Carbontracker.


Layer-wise Learning of Kernel Dependence Networks

arXiv.org Machine Learning

Due to recent debate over the biological plausibility of backpropagation (BP), finding an alternative network optimization strategy has become an active area of interest. We design a new type of kernel network, that is solved greedily, to theoretically answer several questions of interest. First, if BP is difficult to simulate in the brain, are there instead \textit{trivial network weights} (requiring minimum computation) that allow a greedily trained network to classify any pattern. Second, can a greedily trained network converge to a kernel? What kernel will it converge to? Third, is this trivial solution optimal? How is the optimal solution related to generalization? Lastly, can we theoretically identify the network width and depth without a grid search? We prove that the kernel embedding is the trivial solution that compels the greedy procedure to converge to a kernel with Universal property. Yet, this trivial solution is not even optimal. By obtaining the optimal solution spectrally, it provides insight into the generalization of the network while informing us of the network width and depth.


Electric-Car Batteries Get a Boost From Artificial Intelligence

#artificialintelligence

Researchers are using AI to speed up the development of batteries that are safer and recharge faster.


Here are 10 ways AI could help fight climate change

#artificialintelligence

Some of the biggest names in AI research have laid out a road map suggesting how machine learning can help save our planet and humanity from imminent peril. The report covers possible machine-learning interventions in 13 domains, from electricity systems to farms and forests to climate prediction. Within each domain, it breaks out the contributions for various subdisciplines within machine learning, including computer vision, natural-language processing, and reinforcement learning. Recommendations are also divided into three categories: "high leverage" for problems well suited to machine learning where such interventions may have an especially great impact; "long-term" for solutions that won't have payoffs until 2040; and "high risk" for pursuits that have less certain outcomes, either because the technology isn't mature or because not enough is known to assess the consequences. Many of the recommendations also summarize existing efforts that are already happening but not yet at scale.


Odisha space agency moots use of artificial intelligence to detect cannabis cultivation – IAM Network

#artificialintelligence

With illicit cannabis cultivation continuing to flourish in remote areas of the State, the Odisha Space Application Centre (OSAC) has proposed to help law enforcement agencies detect the activity using remote sensing and artificial intelligence technologies. The proposal submitted to the State Excise Department says high resolution satellite imagery can be used for detecting cultivation of hemp, a variety of cannabis. Apart from developing mobile-based applications for field level officials, OSAC has proposed to create a mechanism for citizen reporting by which people can take images and video of any illegal hemp cultivation and report through application.Odisha is one of the leading cannabis producing States in India. Though law enforcement agencies have intensified their raids, it is difficult to trace the cultivation on a real-time basis."Considering the increasing availability of both spatial and temporal resolution satellite images and advanced algorithms for image processing and spatial modeling, the system will be able to produce reliable geographic information for law enforcement agencies and public policy planning authorities to monitor the illegal plantation of cannabis," OSAC said.Cannabis is widely grown in forested regions of Malkangiri, Sambalpur, Deogarh, …


How machine learning improves energy consumption - IoT Agenda

#artificialintelligence

At the intersection of machine learning and energy consumption stands an incredibly powerful force with the potential to transform the way we globally produce and consume energy. So powerful in fact, that the concept of merging machine learning and renewable resources has been named the "energy internet" by economic theorist and author Jeremy Rifkin or "digital efficiency" by Intel and GE. Digital twin tech, or a virtual representation of a product, is a critical concept in IoT that's still being sorted out. You forgot to provide an Email Address. This email address doesn't appear to be valid.


Enabling certification of verification-agnostic networks via memory-efficient semidefinite programming

arXiv.org Artificial Intelligence

Convex relaxations have emerged as a promising approach for verifying desirable properties of neural networks like robustness to adversarial perturbations. Widely used Linear Programming (LP) relaxations only work well when networks are trained to facilitate verification. This precludes applications that involve verification-agnostic networks, i.e., networks not specially trained for verification. On the other hand, semidefinite programming (SDP) relaxations have successfully be applied to verification-agnostic networks, but do not currently scale beyond small networks due to poor time and space asymptotics. In this work, we propose a first-order dual SDP algorithm that (1) requires memory only linear in the total number of network activations, (2) only requires a fixed number of forward/backward passes through the network per iteration. By exploiting iterative eigenvector methods, we express all solver operations in terms of forward and backward passes through the network, enabling efficient use of hardware like GPUs/TPUs. For two verification-agnostic networks on MNIST and CIFAR-10, we significantly improve L-inf verified robust accuracy from 1% to 88% and 6% to 40% respectively. We also demonstrate tight verification of a quadratic stability specification for the decoder of a variational autoencoder.


Amortized Variational Deep Q Network

arXiv.org Artificial Intelligence

Efficient exploration is one of the most important issues in deep reinforcement learning. To address this issue, recent methods consider the value function parameters as random variables, and resort variational inference to approximate the posterior of the parameters. In this paper, we propose an amortized variational inference framework to approximate the posterior distribution of the action value function in Deep Q Network. We establish the equivalence between the loss of the new model and the amortized variational inference loss. We realize the balance of exploration and exploitation by assuming the posterior as Cauchy and Gaussian, respectively in a two-stage training process. We show that the amortized framework can results in significant less learning parameters than existing state-of-the-art method. Experimental results on classical control tasks in OpenAI Gym and chain Markov Decision Process tasks show that the proposed method performs significantly better than state-of-art methods and requires much less training time.


Bayesian Optimization of Risk Measures

arXiv.org Machine Learning

We consider Bayesian optimization of objective functions of the form $\rho[ F(x, W) ]$, where $F$ is a black-box expensive-to-evaluate function and $\rho$ denotes either the VaR or CVaR risk measure, computed with respect to the randomness induced by the environmental random variable $W$. Such problems arise in decision making under uncertainty, such as in portfolio optimization and robust systems design. We propose a family of novel Bayesian optimization algorithms that exploit the structure of the objective function to substantially improve sampling efficiency. Instead of modeling the objective function directly as is typical in Bayesian optimization, these algorithms model $F$ as a Gaussian process, and use the implied posterior on the objective function to decide which points to evaluate. We demonstrate the effectiveness of our approach in a variety of numerical experiments.


Domain-specific Knowledge Graphs: A survey

arXiv.org Artificial Intelligence

Knowledge Graphs (KGs) have made a qualitative leap and effected a real revolution in knowledge representation. This is leveraged by the underlying structure of the KG which underpins a better comprehension, reasoning and interpreting of knowledge for both human and machine. Therefore, KGs continue to be used as a main driver to tackle a plethora of real-life problems in dissimilar domains. However, there is no consensus on a plausible and inclusive definition to domain KG. Further, in conjunction with several limitations and deficiencies, various domain KG construction approaches are far from perfection. This survey is the first to provide an inclusive definition to the notion of domain KG. Also, a comprehensive review of the state-of-the-art approaches drawn from academic works relevant to seven dissimilar domains of knowledge is provided. The scrutiny of the current approaches reveals a correlated array of limitations and deficiencies. The set of improvements to address the limitations of the current approaches are introduced followed by recommendations and opportunities for future research directions.