Collaborating Authors

Simplest Neural Network & Activation – Long – Medium


There are three types of layer: input layer,hidden layer and output layer. Input layer is source of input data, we need normalize the data in the specific type or dimensions. Ok, this time, we implement a simplest neural network, it consist of one input layer, one hidden layer and one output layer. The previous blog, we use a linear formulation:y mx b, every variable is a number, this blog's demo, we will do matrix operation, if u unfamiliar with matrix, click this URL. Before we get start of our demo, let's see it in high level: The datasets contains of input data and output data, what we need to calculate is two weights.

How to Configure the Number of Layers and Nodes in a Neural Network


A single-layer artificial neural network, also called a single-layer, has a single layer of nodes, as its name suggests. Each node in the single layer connects directly to an input variable and contributes to an output variable. A single-layer network can be extended to a multiple-layer network, referred to as a Multilayer Perceptron. A Multilayer Perceptron, or MLP for sort, is an artificial neural network with more than a single layer.

r/MachineLearning - [R] Replace VAE dense layer with 1x1x1 Convolutional layer


I have a Variational autoencoder model created in Keras.Encoder is built with three 3D Convolutional layers Flatten Dense layer. Decoder is built with three 3D Transposed Convolutional layers to reconstruct the input 3D images. My goal is to replace Flatten and Dense layer in Encoder with 1x1x1 Convolutional layer. Any ideas how to do that?

Breaking Batch Normalization for better explainability of Deep Neural Networks through Layer-wise Relevance Propagation Artificial Intelligence

The lack of transparency of neural networks stays a major break for their use. The Layerwise Relevance Propagation technique builds heat-maps representing the relevance of each input in the model s decision. The relevance spreads backward from the last to the first layer of the Deep Neural Network. Layer-wise Relevance Propagation does not manage normalization layers, in this work we suggest a method to include normalization layers. Specifically, we build an equivalent network fusing normalization layers and convolutional or fully connected layers. Heatmaps obtained with our method on MNIST and CIFAR 10 datasets are more accurate for convolutional layers. Our study also prevents from using Layerwise Relevance Propagation with networks including a combination of connected layers and normalization layer.

What is Deep Learning?


"NEVER THINK THERE IS ANYTHING IMPOSSIBLE FOR THE SOUL. IT IS THE GREATEST HERESY TO THINK SO. IF THERE IS A SIN, THIS IS THE ONLY SIN; TO SAY THAT YOU ARE WEAK, OR OTHERS ARE WEAK" - By Swami vivekanand Is Deep Learning now overtaking the Machine Learning algorithm?? Let us first know what is Machine Learning? Machine Learning was coined by "Arthur Samuel" in the year 1959. As we know to perform any Machine Learning algorithm we require a humongous amount of data and very high computation power.