The Annotated ResNet-50

The ResNet architecture is considered to be among the most popular Convolutional Neural Network architectures around. Introduced by Microsoft Research in 2015, Residual Networks (ResNet in short) broke several records when it was first introduced in this paper by He. et. The requirement for a model like ResNet arose due to a number of pitfalls in modern networks at the time. Adding layers can be seen as an expansion of the function space. For example, multiple layers added together can be seen as a function F. This function F can be expressed as a representation of a function space F that it can reach/model.