Impact of Pivot Language on Translation Quality
- Study ID:
- BACK2020
Start Date
Uses back-translations from two pivot langauges (texts were translated with NMT into Mandarin and Arabic and then post-edited by professional translators; then participants were asked to translate from Mandarin and Arabic back into English) to determine how pivot-language translations impacted translation accuracy. Automatic quality scores (such as COMET and BLEU) were compared to manual evaluations (Likert scores of human judgment of English back-translations' similarity to the original English source texts).
- Language Pairs:
- ar → en | 84 sessions العربيّة → English zh → en | 0 sessions 中文 → English
| Session File | Participant | Modality | Text | Actions |
|---|---|---|---|---|
| P01_T1.xml | 01 | T Back-translation into English | 1 | Open Aligner |
| P01_T2.xml | 01 | T Back-translation into English | 2 | Open Aligner |
| P01_T3.xml | 01 | T Back-translation into English | 3 | Open Aligner |
| P01_T4.xml | 01 | T Back-translation into English | 4 | Open Aligner |
| P01_T5.xml | 01 | T Back-translation into English | 5 | Open Aligner |
| P01_T6.xml | 01 | T Back-translation into English | 6 | Open Aligner |
| P02_T1.xml | 02 | T Back-translation into English | 1 | Open Aligner |
| P02_T2.xml | 02 | T Back-translation into English | 2 | Open Aligner |
| P02_T3.xml | 02 | T Back-translation into English | 3 | Open Aligner |
| P02_T4.xml | 02 | T Back-translation into English | 4 | Open Aligner |
| P02_T5.xml | 02 | T Back-translation into English | 5 | Open Aligner |
| P02_T6.xml | 02 | T Back-translation into English | 6 | Open Aligner |
| P03_B1.xml | 03 | B Professional Post-edit | 1 | Open Aligner |
| P03_B2.xml | 03 | B Professional Post-edit | 2 | Open Aligner |
| P03_B3.xml | 03 | B Professional Post-edit | 3 | Open Aligner |
| P03_B4.xml | 03 | B Professional Post-edit | 4 | Open Aligner |
| P03_B5.xml | 03 | B Professional Post-edit | 5 | Open Aligner |
| P03_B6.xml | 03 | B Professional Post-edit | 6 | Open Aligner |
| P04_T1.xml | 04 | T Back-translation into English | 1 | Open Aligner |
| P04_T2.xml | 04 | T Back-translation into English | 2 | Open Aligner |
| P04_T3.xml | 04 | T Back-translation into English | 3 | Open Aligner |
| P04_T4.xml | 04 | T Back-translation into English | 4 | Open Aligner |
| P04_T5.xml | 04 | T Back-translation into English | 5 | Open Aligner |
| P04_T6.xml | 04 | T Back-translation into English | 6 | Open Aligner |
| P05_T1.xml | 05 | T Back-translation into English | 1 | Open Aligner |
| P05_T2.xml | 05 | T Back-translation into English | 2 | Open Aligner |
| P05_T3.xml | 05 | T Back-translation into English | 3 | Open Aligner |
| P05_T4.xml | 05 | T Back-translation into English | 4 | Open Aligner |
| P05_T5.xml | 05 | T Back-translation into English | 5 | Open Aligner |
| P05_T6.xml | 05 | T Back-translation into English | 6 | Open Aligner |
| P06_T1.xml | 06 | T Back-translation into English | 1 | Open Aligner |
| P06_T2.xml | 06 | T Back-translation into English | 2 | Open Aligner |
| P06_T3.xml | 06 | T Back-translation into English | 3 | Open Aligner |
| P06_T4.xml | 06 | T Back-translation into English | 4 | Open Aligner |
| P06_T5.xml | 06 | T Back-translation into English | 5 | Open Aligner |
| P06_T6.xml | 06 | T Back-translation into English | 6 | Open Aligner |
| P07_T1.xml | 07 | T Back-translation into English | 1 | Open Aligner |
| P07_T2.xml | 07 | T Back-translation into English | 2 | Open Aligner |
| P07_T3.xml | 07 | T Back-translation into English | 3 | Open Aligner |
| P07_T4.xml | 07 | T Back-translation into English | 4 | Open Aligner |
| P07_T5.xml | 07 | T Back-translation into English | 5 | Open Aligner |
| P07_T6.xml | 07 | T Back-translation into English | 6 | Open Aligner |
| P08_T1.xml | 08 | T Back-translation into English | 1 | Open Aligner |
| P08_T2.xml | 08 | T Back-translation into English | 2 | Open Aligner |
| P08_T3.xml | 08 | T Back-translation into English | 3 | Open Aligner |
| P08_T4.xml | 08 | T Back-translation into English | 4 | Open Aligner |
| P08_T5.xml | 08 | T Back-translation into English | 5 | Open Aligner |
| P08_T6.xml | 08 | T Back-translation into English | 6 | Open Aligner |
| P09_T1.xml | 09 | T Back-translation into English | 1 | Open Aligner |
| P09_T2.xml | 09 | T Back-translation into English | 2 | Open Aligner |
| P09_T3.xml | 09 | T Back-translation into English | 3 | Open Aligner |
| P09_T4.xml | 09 | T Back-translation into English | 4 | Open Aligner |
| P09_T5.xml | 09 | T Back-translation into English | 5 | Open Aligner |
| P09_T6.xml | 09 | T Back-translation into English | 6 | Open Aligner |
| P10_T1.xml | 10 | T Back-translation into English | 1 | Open Aligner |
| P10_T2.xml | 10 | T Back-translation into English | 2 | Open Aligner |
| P10_T3.xml | 10 | T Back-translation into English | 3 | Open Aligner |
| P10_T4.xml | 10 | T Back-translation into English | 4 | Open Aligner |
| P10_T5.xml | 10 | T Back-translation into English | 5 | Open Aligner |
| P10_T6.xml | 10 | T Back-translation into English | 6 | Open Aligner |
| P11_T1.xml | 11 | T Back-translation into English | 1 | Open Aligner |
| P11_T2.xml | 11 | T Back-translation into English | 2 | Open Aligner |
| P11_T3.xml | 11 | T Back-translation into English | 3 | Open Aligner |
| P11_T4.xml | 11 | T Back-translation into English | 4 | Open Aligner |
| P11_T5.xml | 11 | T Back-translation into English | 5 | Open Aligner |
| P11_T6.xml | 11 | T Back-translation into English | 6 | Open Aligner |
| P12_T1.xml | 12 | T Back-translation into English | 1 | Open Aligner |
| P12_T2.xml | 12 | T Back-translation into English | 2 | Open Aligner |
| P12_T3.xml | 12 | T Back-translation into English | 3 | Open Aligner |
| P12_T4.xml | 12 | T Back-translation into English | 4 | Open Aligner |
| P12_T5.xml | 12 | T Back-translation into English | 5 | Open Aligner |
| P12_T6.xml | 12 | T Back-translation into English | 6 | Open Aligner |
| P13_T1.xml | 13 | T Back-translation into English | 1 | Open Aligner |
| P13_T2.xml | 13 | T Back-translation into English | 2 | Open Aligner |
| P13_T3.xml | 13 | T Back-translation into English | 3 | Open Aligner |
| P13_T4.xml | 13 | T Back-translation into English | 4 | Open Aligner |
| P13_T5.xml | 13 | T Back-translation into English | 5 | Open Aligner |
| P13_T6.xml | 13 | T Back-translation into English | 6 | Open Aligner |
| P15_B1.xml | 15 | B Professional Post-edit | 1 | Open Aligner |
| P15_B2.xml | 15 | B Professional Post-edit | 2 | Open Aligner |
| P15_B3.xml | 15 | B Professional Post-edit | 3 | Open Aligner |
| P15_B4.xml | 15 | B Professional Post-edit | 4 | Open Aligner |
| P15_B5.xml | 15 | B Professional Post-edit | 5 | Open Aligner |
| P15_B6.xml | 15 | B Professional Post-edit | 6 | Open Aligner |