Boosting word frequencies in authorship attribution
–arXiv.org Artificial Intelligence
In this paper, I introduce a simple method of computing relative word frequencies for authorship attribution and similar stylometric tasks. Rather than computing relative frequencies as the number of occurrences of a given word divided by the total number of tokens in a text, I argue that a more efficient normalization factor is the total number of relevant tokens only. The notion of relevant words includes synonyms and, usually, a few dozen other words in some ways semantically similar to a word in question. To determine such a semantic background, one of word embedding models can be used. The proposed method outperforms classical most-frequent-word approaches substantially, usually by a few percentage points depending on the input settings.
arXiv.org Artificial Intelligence
Nov-2-2022
- Country:
- Europe
- Belgium > Flanders
- Antwerp Province > Antwerp (0.04)
- Poland > Lesser Poland Province
- Kraków (0.04)
- United Kingdom > England
- Cambridgeshire > Cambridge (0.04)
- Belgium > Flanders
- Europe
- Genre:
- Research Report (1.00)
- Technology: