Deep Learning: Our Miraculous Year 1990-1991

Most of the results above were actually first published in TU Munich's FKI Tech Report series, for which I drew many illustrations by hand, some of them shown in the present page (Sec. The FKI series now plays an important role in the history of Artificial Intelligence, as it introduced several important concepts: Unsupervised Pre-Training for Very Deep Learning (FKI-148-91 [UN0], Sec. In particular, the report FKI-126-90 [AC90] introduced a whole bunch of concepts that are now widely used: Planning with Recurrent World Models (Sec. Later remarkable FKI Tech Reports from the 1990s describe ways of greatly compressing NNs [KO0] [FM] to improve their generalisation capability.