Goto

Collaborating Authors

 chaos


Improved Particle Approximation Error for Mean Field Neural Networks

Neural Information Processing Systems

Recent works (Chen et al., 2022; Suzuki et al., 2023b) have demonstrated In this work, we improve the dependence on logarithmic Sobolev inequality (LSI) constants in their particle approximation errors which can exponentially deteriorate with the regularization coefficient. One may consider adding Gaussian noise to the gradient descent to make the method more stable.



OnScramblingPhenomena forRandomlyInitializedRecurrentNetworks

Neural Information Processing Systems

Recurrent Neural Networks (RNNs) frequently exhibit complicated dynamics, and their sensitivity to the initialization process often renders them notoriously hardtotrain.






0d9057d84a9fc37523bf826232ea6820-Paper-Conference.pdf

Neural Information Processing Systems

In the case of coupled skew tent maps, theproposedmethodconsistently outperforms afivelayerDeepNeuralNetwork (DNN) and Long Short Term Memory (LSTM) architecture for unidirectional coupling coefficient values ranging from0.1 to 0.7.