huggingface/pytorch-pretrained-BERT

This repository contains an op-for-op PyTorch reimplementation of Google's TensorFlow repository for the BERT model that was released together with the paper BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding by Jacob Devlin, Ming-Wei Chang, Kenton Lee and Kristina Toutanova. This implementation is provided with Google's pre-trained models, examples, notebooks and a command-line interface to load any pre-trained TensorFlow checkpoint for BERT is also provided. This repo was tested on Python 3.5 and PyTorch 0.4.1/1.0.0 A series of tests is included in the tests folder and can be run using pytest (install pytest if needed: pip install pytest). These examples are detailed in the Examples section of this readme.