[Research] Comparison of Learning Algorithms for Neural Networks • /r/MachineLearning

I don't think 22 year old papers can be used to show what is the current state of the art, and your 2012 paper was... uhh... a weird choice. The problem with your article is that nowadays no-one really uses the sort of shallow and narrow neural nets anymore that you're talking about. In fact, those have been surpassed by SVMs ages ago, as far as the ML community is concerned. Within this community (and in /r/MachineLearning caters to it)), the only neural nets worth considering are deep networks. And 2nd order methods are essentially a non-starter for deep nets.