Can I read ChatGPT and Bard: Arabic MT Evaluation on EtoBox?
ChatGPT and Bard: Arabic MT Evaluation by Ghada is a document available to read on EtoBox.
What is ChatGPT and Bard: Arabic MT Evaluation about?
The document evaluates Bard and ChatGPT on machine translation of 10 Arabic varieties into English. It develops a new multi-Arabic machine translation test set to benchmark the models, as existing evaluation data could contain information leaked from their pretraining data. The evaluation finds that while the large language models show promise on under-resourced dialects, they trail commercial systems on Modern Standard Arabic and Classical Arabic. It also includes a human evaluation of Bard
- Author
- Ghada
- Language
- EN