Goto

Collaborating Authors

 Deep Learning


Deep Learning-based Stress Determinator for Mouse Psychiatric Analysis using Hippocampus Activity

arXiv.org Machine Learning

Decoding neurons to extract information from transmission and employ them into other use is the goal of neuroscientists' study. Due to that the field of neuroscience is utilizing the traditional methods presently, we hence combine the state-of-the-art deep learning techniques with the theory of neuron decoding to discuss its potential of accomplishment. Besides, the stress level that is related to neuron activity in hippocampus is statistically examined as well. The experiments suggest that our state-of-the-art deep learning-based stress determinator provides good performance with respect to its model prediction accuracy and additionally, there is strong evidence against equivalence of mouse stress level under diverse environments.


On the Number of Linear Regions of Convolutional Neural Networks

arXiv.org Machine Learning

One fundamental problem in deep learning is understanding the outstanding performance of deep Neural Networks (NNs) in practice. One explanation for the superiority of NNs is that they can realize a large class of complicated functions, i.e., they have powerful expressivity. The expressivity of a ReLU NN can be quantified by the maximal number of linear regions it can separate its input space into. In this paper, we provide several mathematical results needed for studying the linear regions of CNNs, and use them to derive the maximal and average numbers of linear regions for one-layer ReLU CNNs. Furthermore, we obtain upper and lower bounds for the number of linear regions of multi-layer ReLU CNNs. Our results suggest that deeper CNNs have more powerful expressivity than their shallow counterparts, while CNNs have more expressivity than fully-connected NNs per parameter.


Graph Structure Learning for Robust Graph Neural Networks

arXiv.org Machine Learning

Graph Neural Networks (GNNs) are powerful tools in representation learning for graphs. However, recent studies show that GNNs are vulnerable to carefully-crafted perturbations, called adversarial attacks. Adversarial attacks can easily fool GNNs in making predictions for downstream tasks. The vulnerability to adversarial attacks has raised increasing concerns for applying GNNs in safety-critical applications. Therefore, developing robust algorithms to defend adversarial attacks is of great significance. A natural idea to defend adversarial attacks is to clean the perturbed graph. It is evident that real-world graphs share some intrinsic properties. For example, many real-world graphs are low-rank and sparse, and the features of two adjacent nodes tend to be similar. In fact, we find that adversarial attacks are likely to violate these graph properties. Therefore, in this paper, we explore these properties to defend adversarial attacks on graphs. In particular, we propose a general framework Pro-GNN, which can jointly learn a structural graph and a robust graph neural network model from the perturbed graph guided by these properties. Extensive experiments on real-world graphs demonstrate that the proposed framework achieves significantly better performance compared with the state-of-the-art defense methods, even when the graph is heavily perturbed. We release the implementation of Pro-GNN to our DeepRobust repository for adversarial attacks and defenses (footnote: https://github.com/DSE-MSU/DeepRobust). The specific experimental settings to reproduce our results can be found in https://github.com/ChandlerBang/Pro-GNN.


Lecture Notes in Deep Learning: Feedforward Networks -- Part 2

#artificialintelligence

How can Networks actually be trained? These are the lecture notes for FAU's YouTube Lecture "Deep Learning". This is a full transcript of the lecture video & matching slides. We hope, you enjoy this as much as the videos. Of course, this transcript was created with deep learning techniques largely automatically and only minor manual modifications were performed.


Top 30 Python Libraries for Machine Learning

#artificialintelligence

In this article, you'll see top 30 Python libraries for Machine Learning. In this article, you'll see top 30 Python libraries for Machine Learning. Today, Python is one of the most popular programming languages and it has replaced many languages in the industry. There are various reasons for its popularity and one of them is that python has a large collection of libraries. Python is one of the most widely used languages by Data Scientists and Machine Learning experts across the world. Though there is no shortage of alternatives in the form of languages like R, Julia and others, python has steadily and rightfully gained popularity. Similar to the Google Trends shown above(the plot is prepared using matplotlib and pytrends), confidence is visible year over year with python featuring way above its peers in the StackOverflow surveys for 2017 and 2018. These trends/surveys are the consequences of ease of use, shorter learning curve, widespread usage, strong community, large number of libraries covering depth and breadth of a number of research and application areas. The amazing popularity might make one think that python is the gold standard for Machine Learning.


RAAIS - Leading AI Summit

#artificialintelligence

Drug discovery and development is an incredibly important yet capital intensive, lengthy and low efficiency process. In recent years, biology and chemistry has become increasingly high-throughput and data-driven thanks to massively parallel sequencing, robotic liquid handling robots, advanced imaging techniques and more. This has opened up the opportunity for machine learning techniques to not only improve experimental analysis but also to generate novel experimental hypotheses that are worth testing. For example, machine learning models can be used in virtual screens where they generate candidate molecules that are likely to have a desired phenotypic effect. While the number of virtual screens is increasing, there are fewer studies that close the loop with empirical results.


Lynx Analytics Releases LynxKite 4.0 to Democratize Adoption of Graph AI

#artificialintelligence

Lynx Analytics announces the open source release of its Complete Graph Data Science Platform, LynxKite 4.0, after years of development and successful deployments with customers. With rapidly growing availability of network and relationship data as well as new graph deep learning technologies, Graph AI is the next frontier of machine learning as advocated by leading machine learning experts. By integrating relationship information into machine learning models, graphs are a crucial component in numerous AI applications: network based attribute prediction, fraud detection, product recommendation, infrastructure and operations optimization, drug discovery, etc. Up until today, building Graph AI solutions has been a highly technical process that involved numerous skills, tools and coding efforts. This has created a high barrier to entry and slow adoption of Graph Analytics.


This Week in AI - Issue #23

#artificialintelligence

Eager to learn how to build Deep Learning systems using Tensorflow 2 and Python? Get our'Deep Learning for Programmers' ebook here! This site uses Akismet to reduce spam. Learn how your comment data is processed. Subscribe to our newsletter and receive our Python Basics Cheatsheet! Are you afraid that AI might take your job?


Lecture Notes in Deep Learning: Loss and Optimization -- Part 2

#artificialintelligence

These are the lecture notes for FAU's YouTube Lecture "Deep Learning". This is a full transcript of the lecture video & matching slides. We hope, you enjoy this as much as the videos. Of course, this transcript was created with deep learning techniques largely automatically and only minor manual modifications were performed. If you spot mistakes, please let us know! Welcome back to deep learning! So, let's continue with our lecture.


How To Trick a Neural Network in Python 3

#artificialintelligence

The author selected Dev Color to receive a donation as part of the Write for DOnations program. Could a neural network for animal classification be fooled? Fooling an animal classifier may have few consequences, but what if our face authenticator could be fooled? Still, these risks have significant implications and are important to consider as a machine-learning practitioner. In this tutorial, you will try "fooling" or tricking an animal classifier.