Can I read RoBERTurk: Adjusting RoBERTa for Turkish on EtoBox?

RoBERTurk: Adjusting RoBERTa for Turkish by Tas, Nuri is a scholarly article available to read on EtoBox.

What is RoBERTurk: Adjusting RoBERTa for Turkish about?

We pretrain RoBERTa on a Turkish corpora using BPE tokenizer. Our model outperforms BERTurk family models on the BOUN dataset for the POS task while resulting in underperformance on the IMST dataset for the same task and achieving competitive scores on the Turkish split of the XTREME dataset for the NER task - all while being pretrained on smaller data than its competitors. We release our pretrained model and tokenizer.

Author

Tas, Nuri

Published

2024

Language

EN