Can I read What Kind of Language Is Hard To Language-Model? on EtoBox?
What Kind of Language Is Hard To Language-Model? by pikachuskywars is a document available to read on EtoBox.
What is What Kind of Language Is Hard To Language-Model? about?
This paper investigates the difficulty of language modeling across 69 languages from 13 families, utilizing a multilingual Bible corpus to assess language model performance. It introduces a new paired-sample multiplicative mixed-effects model to estimate language difficulty, revealing that typological features like word inventory and character sequence length are significant indicators of modeling complexity, rather than morphological complexity. The study concludes that translationese does not simplify lan
- Author
- pikachuskywars
- Language
- EN