 |
Step 1: Assess the fluency of the machine translation "{mt}" using the following 5-point scale:
5 - Highly fluent
4 - Moderately fluent
3 - Neutral fluency
2 - Somewhat disfluent
1 - Highly disfluent
Fluency rating (1-5):
Step 2: Assess the similarity between the source "{src}" and translation "{mt}" by evaluating token-level alignment. Use the following 5-point scale:
5 - All tokens aligned
4 - Most tokens aligned
3 - Partial token alignment
2 - Few tokens aligned
1 - No token alignment
Token alignment rating (1-5):
Step 3: Evaluate sentence-level semantic similarity between "{src}" and "{mt}" on the following 5-point scale:
5 - Identical meanings
4 - Largely similar meanings
3 - Partial similarity in meaning
2 - Little similarity in meaning
1 - Completely different meanings
Semantic similarity rating (1-5):
Step 4: Combine the step 1-3 ratings to assign an overall quality estimation (1-5):
Overall quality rating (1-5): |
IEEE/ICACT20240321 Slide.10
[Big Slide]