Goto

Collaborating Authors

 neural network algorithm


Neural Networks as Linear Regression: An Introduction for Statisticians

arXiv.org Machine Learning

Summary: Neural networks are a commonly used prediction tool in computer science and statistics. However, the barrier to entry of this interesting field remains high, particularly for classical statisticians trained in a frequentist perspective. In this letter, we demystify neural networks by describing networks that approximate a linear regression and describe common customizations that provide a foundation for further study.



A Neural Network Algorithm for KL Divergence Estimation with Quantitative Error Bounds

arXiv.org Artificial Intelligence

Estimating the Kullback-Leibler (KL) divergence between random variables is a fundamental problem in statistical analysis. For continuous random variables, traditional information-theoretic estimators scale poorly with dimension and/or sample size. To mitigate this challenge, a variety of methods have been proposed to estimate KL divergences and related quantities, such as mutual information, using neural networks. The existing theoretical analyses show that neural network parameters achieving low error exist. However, since they rely on non-constructive neural network approximation theorems, they do not guarantee that the existing algorithms actually achieve low error. In this paper, we propose a KL divergence estimation algorithm using a shallow neural network with randomized hidden weights and biases (i.e. a random feature method). We show that with high probability, the algorithm achieves a KL divergence estimation error of $O(m^{-1/2}+T^{-1/3})$, where $m$ is the number of neurons and $T$ is both the number of steps of the algorithm and the number of samples.



Forecasting Imports in OECD Member Countries and Iran by Using Neural Network Algorithms of LSTM

arXiv.org Artificial Intelligence

Artificial Neural Networks (ANN) which are a branch of artificial intelligence, have shown their high value in lots of applications and are used as a suitable forecasting method. Therefore, this study aims at forecasting imports in OECD member selected countries and Iran for 20 seasons from 2021 to 2025 by means of ANN. Data related to the imports of such countries collected over 50 years from 1970 to 2019 from valid resources including World Bank, WTO, IFM,the data turned into seasonal data to increase the number of collected data for better performance and high accuracy of the network by using Diz formula that there were totally 200 data related to imports. This study has used LSTM to analyse data in Pycharm. 75% of data considered as training data and 25% considered as test data and the results of the analysis were forecasted with 99% accuracy which revealed the validity and reliability of the output. Since the imports is consumption function and since the consumption is influenced during Covid-19 Pandemic, so it is time-consuming to correct and improve it to be influential on the imports, thus the imports in the years after Covid-19 Pandemic has had a fluctuating trend.


The Ni1000: High Speed Parallel VLSI for Implementing Multilayer Perceptrons

Neural Information Processing Systems

In this paper we present a new version of the standard multilayer perceptron (MLP) algorithm for the state-of-the-art in neural net(cid:173) work VLSI implementations: the Intel Ni1000. This new version of the MLP uses a fundamental property of high dimensional spaces which allows the 12-norm to be accurately approximated by the It -norm. This approach enables the standard MLP to utilize the parallel architecture of the Ni1000 to achieve on the order of 40000, 256-dimensional classifications per second. The Nestor/Intel radial basis function neural chip (Ni1000) contains the equivalent of 1024 256-dimensional artificial digital neurons and can perform at least 40000 classifications per second [Sullivan, 1993]. To attain this great speed, the Ni1000 was designed to calculate "city block" distances (Le. the II-norm) and thus to avoid the large number of multiplication units that would be required to calculate Euclidean dot products in parallel. Thus the Nil000 is ideally suited to perform both the RCE [Reillyet al., 1982] and PRCE [Scofield et al., 1987] algorithms or any of the other commonly used radial basis function (RBF) algorithms.


Using machine learning algorithms to determine the emotional disadaptation of a person by his rhythmogram

arXiv.org Artificial Intelligence

The development of new methods and approaches to the rapid diagnosis of stress is an urgent task, taking into account the current epidemiological (Covid-19) situation [1]. Psychological stress plays a key role in the development of many physical and neurological diseases. The term "stress" is usually used to denote both a strong adverse physical and / or psychogenic external environmental impact, and for a state of psychophysiological stress that develops under their influence, initially serving to adapt a person to new environmental conditions. Stress, as a chronic psychophysiological overstrain, can provoke the manifestation or exacerbation of symptoms of the disease, serve as one of the risk factors or aggravate the severity of the disease. Emotional overstrain reduces the productivity and quality of work performed by a person.


Application of Neural Network in the Prediction of NOx Emissions from Degrading Gas Turbine

arXiv.org Artificial Intelligence

This paper is aiming to apply neural network algorithm for predicting the process response (NOx emissions) from degrading natural gas turbines. Nine different process variables, or predictors, are considered in the predictive modelling. It is found out that the model trained by neural network algorithm should use part of recent data in the training and validation sets accounting for the impact of the system degradation. R-Square values of the training and validation sets demonstrate the validity of the model. The residue plot, without any clear pattern, shows the model is appropriate. The ranking of the importance of the process variables are demonstrated and the prediction profile confirms the significance of the process variables. The model trained by using neural network algorithm manifests the optimal settings of the process variables to reach the minimum value of NOx emissions from the degrading gas turbine system.


Give this AI a few words of description and it produces a stunning image, but is it art?

#artificialintelligence

A picture may be worth a thousand words, but thanks to an artificial intelligence program called DALL-E 2, you can have a professional-looking image with far fewer. DALL-E 2 is a new neural network algorithm that creates a picture from a short phrase or sentence that you provide. The program, which was announced by the artificial intelligence research laboratory OpenAI in April 2022, hasn't been released to the public. But a small and growing number of people – myself included – have been given access to experiment with it. As a researcher studying the nexus of technology and art, I was keen to see how well the program worked.


Is It Art--or Artificial Intelligence?

#artificialintelligence

A picture may be worth a thousand words, but thanks to an artificial intelligence program called DALL-E 2, you can have a professional-looking image with far fewer. DALL-E 2 is a new neural network algorithm that creates a picture from a short phrase or sentence that you provide. The program, which was announced by the artificial intelligence research laboratory OpenAI in April 2022, hasn't been released to the public. But a small and growing number of people--myself included--have been given access to experiment with it. As a researcher studying the nexus of technology and art, I was keen to see how well the program worked.