Facebook Shares Large Data Sets to Help Improve its AI and Data Science Algorithms

After allocating books to either training, validation or test sets, we formed example'questions' from chapters in the book by enumerating 21 consecutive sentences. In each question, the first 20 sentences form the context, and a word is removed from the 21st sentence, which becomes the query. Models must identify the answer word among a selection of 10 candidate answers appearing in the context sentences and the query.