pfnet/chainermn

ChainerMN is an additional package for Chainer, a flexible deep learning framework. This blog post provides our benchmark results using up to 128 GPUs. ChainerMN can be used for both inner-node (i.e., multiple GPUs inside a node) and inter-node settings. For inter-node settings, we highly recommend to use high-speed interconnects such as InfiniBand. In addition to Chainer, ChainerMN depends on the following software libraries: CUDA-Aware MPI, NVIDIA NCCL, and a few Python packages.