Goto

Collaborating Authors

 non-reproducible research


[R]How to go about non-reproducible research?

#artificialintelligence

I have been reproducing (or trying to reproduce) times series classification results for 23 years. In general, less than half the papers can be reproduced, but since the advent of deep learning, the fraction has gotten worse. A) "We made a best faith effort to reproduce the results in [x], but were unable to do so, thus we omit it from comparison" B) "We made a best faith effort to reproduce the results in [x], but were unable to do so. We do place our results using this method in Table Y with an asterisk, to denote that this is our best understanding of the algorithms performance, but just not reflect the claimed accuracy possible in [x]".