Implementing ConvNext in PyTorch

Hello There!! Today we are going to implement the famous ConvNext in PyTorch proposed in A ConvNet for the 2020s . Code is here, an interactive version of this article can be downloaded from here. The paper proposes a new convolution-based architecture that not only surpasses Transformer-based model (such as Swin) but also scales with the amount of data! The following pictures show ConvNext accuracy against the different datasets/models sizes. So the authors started by taking the well know ResNet architecture and iteratively improving it following new best practices and discoveries made in the last decade.