Detecting Structured Language Alternations in Historical Documents by Combining Language Identification with Fourier Analysis

Sirin, Hale, Li, Sabrina, Lippincott, Tom

arXiv.org Artificial Intelligence 

In this study, we present a generalizable workflow to identify documents in a historic language with a nonstandard language and script combination, Armeno-Turkish. We introduce the task of detecting distinct patterns of multilinguality based on the frequency of structured language alternations within a document.