Goto

Collaborating Authors

 Perceptrons


A Basic Perceptron Model Using Least Squares Method

#artificialintelligence

Just like the billions of neurons that make up the human nervous system, the perceptron is the basic unit of artificial intelligence. Every thought, action, emotion or decision that we make reflect the activities of the nervous system which is a master system that controls and communicates with every part of your body. Biological intelligence relies on this complex mechanism of billions of neurons organized in different layers that communicate with one another through electrical and chemical signals. To understand how biological intelligence is produced, it's important to understand how the basic building block called neuron functions. Similar to biological intelligence, artificial intelligence is produced by a complex network of basic building blocks called perceptron.


Student Performance Prediction with Optimum Multilabel Ensemble Model

arXiv.org Machine Learning

One of the important measures of quality of education is the performance of students in the academic settings. Nowadays, abundant data is stored in educational institutions about students which can help to discover insight on how students are learning and how to improve their performance ahead of time using data mining techniques. In this paper, we developed a student performance prediction model that predicts the performance of high school students for the next semester for five courses. We modeled our prediction system as a multi-label classification task and used support vector machine (SVM), Random Forest (RF), K-nearest Neighbors (KNN), and Mult-layer perceptron (MLP) as base-classifiers to train our model. We further improved the performance of the prediction model using state-of-the-art partitioning schemes to divide the label space into smaller spaces and use Label Powerset (LP) transformation method to transform each labelset into a multi-class classification task. The proposed model achieved better performance in terms of different evaluation metrics when compared to other multi-label learning tasks such as binary relevance and classifier chains.


The Math behind Neural Networks: Part 1 - The Rosenblatt Perceptron

#artificialintelligence

In it we said the perceptron takes some input value \([x_1, x_2, ..., x_i, ..., x_n]\), also called features, some weights \([w_1, w_2, ..., w_i, ..., w_n]\), multiplies them with each other and takes the sum of these multiplications: This is the definition of a Linear Combination: it is the sum of some terms multiplied by constant values. In our case the terms are the features and the constants are the weights.


Graph Convolutional Networks for Road Networks

arXiv.org Machine Learning

Machine learning techniques for road networks hold the potential to facilitate many important transportation applications. Graph Convolutional Networks (GCNs) are neural networks that are capable of leveraging the structure of a road network by utilizing information of, e.g., adjacent road segments. While state-of-the-art GCNs target node classification tasks in social, citation, and biological networks, machine learning tasks in road networks differ substantially from such tasks. In road networks, prediction tasks concern edges representing road segments, and many tasks involve regression. In addition, road networks differ substantially from the networks assumed in the GCN literature in terms of the attribute information available and the network characteristics. Many implicit assumptions of GCNs do therefore not apply. We introduce the notion of Relational Fusion Network (RFN), a novel type of GCN designed specifically for machine learning on road networks. In particular, we propose methods that outperform state-of-the-art GCNs on both a road segment regression task and a road segment classification task by 32-40% and 21-24%, respectively. In addition, we provide experimental evidence of the short-comings of state-of-the-art GCNs in the context of road networks: unlike our method, they cannot effectively leverage the road network structure for road segment classification and fail to outperform a regular multi-layer perceptron.


It's a No Brainer: An Introduction to Neural Networks

#artificialintelligence

Neural Networks are an approach to artificial intelligence that was first proposed in 1944. Modeled loosely on the human brain, Neural Networks consist of a multitude of simple processing nodes (called neurons) that are highly interconnected and send data through these network connections to estimate a target variable. In this article, I will discuss the structure and training of simple neural networks (specifically Multilayer Perceptrons, aka "vanilla neural networks"), as well as demonstrate a simple neural network. Question: Why do zombies only date intelligent women? Answer: They just love a woman with brains.


High Level Introduction to Neural Networks

#artificialintelligence

Spend any time in data science, machine learning or artificial intelligence circles and you are bound to come across a mention of Neural Networks. Ask what they are, and most people say, "it's like a brain, with lots of connected neurons". But what does that mean? This relation to a human brain has an element of truth, as at their heart, neural networks were inspired by attempts at modelling a neuron (and modelling the nervous system has been a big topic for many reasons). They were found to be good for performing binary classification problems, where an object can either be of one class or not (i.e. it is a "cat" or a "dog").


Stock Price Forecasting and Hypothesis Testing Using Neural Networks

arXiv.org Machine Learning

In this work we use Recurrent Neural Networks and Multilayer Perceptrons to predict NYSE, NASDAQ and AMEX stock prices from historical data. We experiment with different architectures and compare data normalization techniques. Then, we leverage those findings to question the efficient-market hypothesis through a formal statistical test.


Learning Algebraic Models of Quantum Entanglement

arXiv.org Machine Learning

We give a thorough overview of supervised learning and network design for learning membership on algebraic varieties via deep neural networks. We show how artificial neural networks can be trained to predict the entanglement type for quantum states. We give examples for detecting degenerate states, as well as border rank classification for up to 5 binary qubits and 3 qutrits (ternary qubits).


Learning to use EasyLanguage to build profitable systems

#artificialintelligence

Every system developer has a list of rules and indicators that they want to test out. The problem every developer faces is narrowing down that list of rules and indicators to the select few that are best worth focusing on. A quite similar and related problem that every developer has to deal with is having some inputs or indicators that they believe to be relevant and important but not knowing exactly in what way they are significant. I will show you how you can quickly find the best rules and indicators to focus on using an automated search approach which will work on most traditional retail trading platforms (such as Tradestation, Multicharts, Ninjatrader, Amibroker, etc.). But first I should point out that there are two basic approaches to developing systems.


Order Matters: Alibaba's Transformer-based Recommender System

#artificialintelligence

Alibaba, the largest e-commerce platform in China, is a powerhouse not only when it comes to e-commerce, but also when it comes to recommender systems research. Their latest paper, Behaviour Sequence Transformer for E-commerce Recommendation in Alibaba, is yet another publication that pushes the state of the art in recommender systems. In this work, they make use of the popular Transformer model to capture sequential signals in user behaviour in online shopping, in order to perform next click prediction. Recommender systems often make use of a 2-stage paradigm of retrieval and ranking, and Alibaba's approach is no different. The retrieval step used at Alibaba consists of selecting, with high recall, a subset of a million relevant candidate items from the entire item set (which is of course much larger than a million possible items), and the ranking step consists of ranking these candidates with high precision.