Is ChatGPT a Good English to Arabic Machine Translation Tool?
Omar Banimelhem, Wlla Amayreh
Abstract
In this paper, we study the performance of using ChatGPT as a machine translation tool for translating English text to Arabic. For evaluating ChatGPT as a machine translator, it was compared with fifteen well-known commercial tools that support English to Arabic Translation. First, fourteenth prompts were suggested and evaluated in order to select the best prompt that should be used with ChatGPT. Then, 100 samples of English sentences from a well-known dataset were used in the evaluation process, in which three metrics including BLEU, chrF, and TER are used. In terms of the BLEU metric, the highest value among the tested translators was 34.71 and the lowest value was 12.06 while the ChatGPT value was 18.63, which indicates that ChatGPT according to the chosen samples used from the dataset has not a good performance as English to Arabic MT tool.