Goto

Collaborating Authors

 Deep Learning


DuTrust: A Sentiment Analysis Dataset for Trustworthiness Evaluation

arXiv.org Artificial Intelligence

While deep learning models have greatly improved the performance of most artificial intelligence tasks, they are often criticized to be untrustworthy due to the black-box problem. Consequently, many works have been proposed to study the trustworthiness of deep learning. However, as most open datasets are designed for evaluating the accuracy of model outputs, there is still a lack of appropriate datasets for evaluating the inner workings of neural networks. The lack of datasets obviously hinders the development of trustworthiness research. Therefore, in order to systematically evaluate the factors for building trustworthy systems, we propose a novel and well-annotated sentiment analysis dataset to evaluate robustness and interpretability. To evaluate these factors, our dataset contains diverse annotations about the challenging distribution of instances, manual adversarial instances and sentiment explanations. Several evaluation metrics are further proposed for interpretability and robustness. Based on the dataset and metrics, we conduct comprehensive comparisons for the trustworthiness of three typical models, and also study the relations between accuracy, robustness and interpretability. We release this trustworthiness evaluation dataset at \url{https://github/xyz} and hope our work can facilitate the progress on building more trustworthy systems for real-world applications.


Music Composition with Deep Learning: A Review

arXiv.org Artificial Intelligence

Generating a complex work of art such as a musical composition requires exhibiting true creativity that depends on a variety of factors that are related to the hierarchy of musical language. Music generation have been faced with Algorithmic methods and recently, with Deep Learning models that are being used in other fields such as Computer Vision. In this paper we want to put into context the existing relationships between AI-based music composition models and human musical composition and creativity processes. We give an overview of the recent Deep Learning models for music composition and we compare these models to the music composition process from a theoretical point of view. We have tried to answer some of the most relevant open questions for this task by analyzing the ability of current Deep Learning models to generate music with creativity or the similarity between AI and human composition processes, among others.


Combining data assimilation and machine learning to estimate parameters of a convective-scale model

arXiv.org Machine Learning

Errors in the representation of clouds in convection-permitting numerical weather prediction models can be introduced by different sources. These can be the forcing and boundary conditions, the representation of orography, the accuracy of the numerical schemes determining the evolution of humidity and temperature, but large contributions are due to the parametrization of microphysics and the parametrization of processes in the surface and boundary layers. These schemes typically contain several tunable parameters that are either not physical or only crudely known, leading to model errors. Traditionally, the numerical values of these model parameters are chosen by manual model tuning. More objectively, they can be estimated from observations by the augmented state approach during the data assimilation. Alternatively, in this work, we look at the problem of parameter estimation through an artificial intelligence lens by training two types of artificial neural networks (ANNs) to estimate several parameters of the one-dimensional modified shallow-water model as a function of the observations or analysis of the atmospheric state. Through perfect model experiments, we show that Bayesian neural networks (BNNs) and Bayesian approximations of point estimate neural networks (NNs) are able to estimate model parameters and their relevant statistics. The estimation of parameters combined with data assimilation for the state decreases the initial state errors even when assimilating sparse and noisy observations. The sensitivity to the number of ensemble members, observation coverage, and neural network size is shown. Additionally, we use the method of layer-wise relevance propagation to gain insight into how the ANNs are learning and discover that they naturally select only a few gridpoints that are subject to strong winds and rain to make their predictions of chosen parameters.


Using Satellite Imagery and Machine Learning to Estimate the Livelihood Impact of Electricity Access

arXiv.org Machine Learning

We demonstrate how advancements in satellite imagery and machine learning can help ameliorate these data and inference challenges. In the context of an expansion of the electrical grid across Uganda, we show how a combination of satellite imagery and computer vision can be used to develop local-level livelihood measurements appropriate for inferring the causal impact of electricity access on livelihoods. We then show how ML-based inference techniques deliver more reliable estimates of the causal impact of electrification than traditional alternatives when applied to these data. We estimate that grid access improves village-level asset wealth in rural Uganda by 0.17 standard deviations, more than doubling the growth rate over our study period relative to untreated areas. Our results provide country-scale evidence on the impact of a key infrastructure investment, and provide a low-cost, generalizable approach to future policy evaluation in data sparse environments.


Awesome PyTorch Lightning template!

#artificialintelligence

Have you ever been confused about what is the best practice for PyTorch? Like, when to send your Tensor to GPU? or when to call zero_grad? Or have you tried to do something new, like adding a SimCLR-like pipeline, and having to rewrite a majority of your code because it was so poorly written? Or maybe, you are wondering what everyone else's pipeline is like? Are theirs 100% more efficient?


DeepLINK: Deep learning inference using knockoffs with applications to genomics

#artificialintelligence

Although practically attractive with high prediction and classification power, complicated learning methods often lack interpretability and reproducibility, limiting their scientific usage. A useful remedy is to select truly important variables contributing to the response of interest. We develop a method for deep learning inference using knockoffs, DeepLINK, to achieve the goal of variable selection with controlled error rate in deep learning models. We show that DeepLINK can also have high power in variable selection with a broad class of model designs. We then apply DeepLINK to three real datasets and produce statistical inference results with both reproducibility and biological meanings, demonstrating its promising usage to a broad range of scientific applications. Software data have been deposited in GitHub (). Preprocessed data matrices for the four publicly available data sets can be downloaded with the corresponding link: Zeller microbiome ([67][1]), Yu microbiome ([68][2]), murine scRNA-seq ([69][3]), and human scRNA-seq ([70][4]). [1]: #ref-67 [2]: #ref-68 [3]: #ref-69 [4]: #ref-70


Posture Detection using PoseNet with Real-time Deep Learning project

#artificialintelligence

Posenet is a real-time pose detection technique with which you can detect human poses in Image or Video. let's make a real-time project.


Real-Time Human Pose Estimation with TensorFlow.js

#artificialintelligence

PoseNet is a deep learning TensorFlow model that allows you to estimate and track human poses (known as "pose estimation") by detecting body parts such as elbows, hips, wrists, knees, and ankles. It uses the joints of these body parts to determine body postures. Nowadays, many industries use this kind of technology in order to improve work efficiency, and in technologies such as augmented reality experiences, animation & gaming, and robotics. The evolution of human-like robots, virtual gaming experiences, motion tracking, and body movement interpretations can be done with the use of these types of high-end PoseNet deep learning models. First, we need to install the dependencies needed for our project.


How Computationally Complex Is a Single Neuron?

#artificialintelligence

Our mushy brains seem a far cry from the solid silicon chips in computer processors, but scientists have a long history of comparing the two. As Alan Turing put it in 1952: "We are not interested in the fact that the brain has the consistency of cold porridge." Today, the most powerful artificial intelligence systems employ a type of machine learning called deep learning. Their algorithms learn by processing massive amounts of data through hidden layers of interconnected nodes, referred to as deep neural networks. As their name suggests, deep neural networks were inspired by the real neural networks in the brain, with the nodes modeled after real neurons -- or, at least, after what neuroscientists knew about neurons back in the 1950s, when an influential neuron model called the perceptron was born.


Why ML Attempts to Predict the Stock Market Are Meaningless

#artificialintelligence

Most of the articles about AI predicting the stock markets focus on a more or less complicated model which tries to predict the move of the next timestep. And almost all of them are just focussing on architecture and layers like LSTM or CNN. But then they are just using the Mean Squared Error (MSE) as a loss function -- and this is a problem and this article shows you why. Assume we have the following Deep Neural Network (DNN) implemented in PyTorch. Note that we use log returns because these should follow more closely a Normal Distribution which is an important detail for this article, as you will find out in a minute.