 |
Prompt 1:
On a scale of 1 to 5, with 1 being highly disfluent and 5 being highly fluent, how would you rate the fluency of the following machine translated sentences? Disfluency means awkwardness in phrasing and grammar. Higher fluency means overall smoothness.
Source: [source_sentence]
Machine translation: [translated_sentence]
Fluency rating (1-5):
Prompt 2:
Please assess the fluency of the below machine translation by selecting one of the following categories:
5 - Highly fluent, reads like perfectly smooth natural language
4 - Moderately fluent overall despite some minor awkwardness
3 - Neutral fluency with some clearly disfluent phrases but still interpretable
2 - Somewhat disfluent, multiple phrases have significant awkwardness or grammar issues
1 - Highly disfluent, major grammatical/fluency issues impeding understanding
Source: [source_sentence]
Translation: [translated_sentence]
Fluency category:
Prompt 3:
On a 1 to 5 fluency scale, how would you rate the machine's translation from natural language phrasing into awkward, disfluent wording? 1 means major fluency errors making it unintelligible. 5 means perfectly smooth and natural wording.
Source: [source_sentence]
Machine translation: [translated_sentence]
Fluency score (1-5):
Prompt 4:
Please classify the fluency of the below machine translation into one of 5 levels:
Level 5: Flawless fluency just like a human translation
Level 4: Largely fluent with only minor awkward phrasings
Level 3: Mix of fluent and disfluent phrases, but meaning discernible
Level 2: Significant awkwardness, but main idea interpretable
Level 1: Completely disfluent and incomprehensible
Source: [source_sentence]
Translation: [translated_sentence]
Fluency level (1-5):
Prompt 5:
On a 5 point scale, please rate the machine translation from perfectly natural fluency (5) to completely unnatural and awkward (1):
Source: [source_sentence]
Translation: [translated_sentence]
Fluency rating (1-5): |
IEEE/ICACT20240321 Slide.09
[Big Slide]