-
-
Notifications
You must be signed in to change notification settings - Fork 63
Language chinese simplified
Category: Asian Languages Script: Han
| Metric | Value |
|---|---|
| Average Score | 🟠 6.9/10 |
| Accuracy | 7.3/10 |
| Fluency | 7.0/10 |
| Style | 6.4/10 |
| Total Tests | 120 |
| Best Model | qwen3:30b-instruct |
| Worst Model | llama3.2 |
| Model | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| qwen3:30b-instruct | 🟡 8.0 | 8.2 | 8.0 | 7.6 |
| mistralai/mistral-medium-3.1 | 🟡 8.0 | 8.0 | 8.0 | 7.6 |
| translategemma:27b | 🟡 7.8 | 8.2 | 8.2 | 7.2 |
| qwen3:30b | 🟡 7.8 | 7.8 | 8.0 | 7.2 |
| google/gemini-3-flash-preview | 🟡 7.8 | 8.0 | 7.8 | 7.2 |
| google/gemini-2.0-flash-001 | 🟡 7.6 | 7.8 | 7.6 | 7.0 |
| qwen3:4b | 🟡 7.4 | 7.6 | 7.2 | 7.0 |
| qwen3:8b | 🟡 7.4 | 7.6 | 7.4 | 6.6 |
| gemma3:27b | 🟡 7.4 | 7.6 | 7.4 | 6.8 |
| ministral-3:14b | 🟡 7.4 | 7.4 | 7.6 | 6.6 |
| gemma3:27b-it-qat | 🟡 7.2 | 7.8 | 7.4 | 7.2 |
| translategemma:12b | 🟡 7.2 | 7.2 | 7.2 | 6.2 |
| translategemma:27b-it-q8_0 | 🟡 7.2 | 7.6 | 7.2 | 6.6 |
| qwen3:14b | 🟡 7.0 | 7.6 | 7.2 | 6.8 |
| mistral-small:24b | 🟡 7.0 | 7.6 | 7.2 | 6.6 |
| ministral-3 | 🟡 7.0 | 7.2 | 7.0 | 6.6 |
| gemma3:12b | 🟡 7.0 | 7.4 | 6.8 | 6.8 |
| translategemma:12b-it-q4_K_M | 🟡 7.0 | 7.2 | 7.0 | 6.0 |
| translategemma:4b | 🟠 6.4 | 6.6 | 6.6 | 5.4 |
| gemma3:4b | 🟠 6.0 | 6.6 | 6.0 | 5.6 |
| translategemma:4b-it-q4_K_M | 🟠 6.0 | 6.6 | 6.0 | 5.4 |
| llama3.1:8b | 🟠 5.0 | 5.8 | 5.0 | 4.6 |
| llama3.2 | ⚫ 2.2 | 3.2 | 2.2 | 2.0 |
Model: translategemma:27b Score: 🟢 9.0/10
View Translation
Original (English):
Translation (Chinese (Simplified)):
世人皆知，一个拥有财富的单身男子，必定会想找一位妻子。尽管我们对这位男子的内心想法和观点所知甚少，但他一旦踏入一个新的社区，这个道理却已深深地植根于周围家庭的观念之中，以至于他被视为某个女儿的“既定归属”。
Evaluator Feedback:
The translation accurately captures the meaning and maintains a formal tone, though it slightly softens the sharp irony of 'rightful property' by using '既定归属' (established belonging). The phrasing is natural and flows well in Chinese, effectively conveying the social satire of the original.
Model: translategemma:27b Score: 🟢 9.0/10
View Translation
Original (English):
Translation (Chinese (Simplified)):
“看来您去过阿富汗。”我说道。“您是怎么知道的？”我惊讶地问道。“这不重要，”他笑着自言自语。“现在的问题是关于血红蛋白的。您肯定也明白这项发现的重要性吧？”“从化学角度来说，这确实很有趣，”我回答道，“但从实际应用角度来看——” “我的朋友，这可是近年来最重要的医学和法医学发现。难道你没意识到，这为我们提供了一种绝对可靠的血液污迹检测方法吗？”
Evaluator Feedback:
The translation is highly accurate and captures the essence of the interaction, though 'chuckling to himself' is slightly simplified as '笑着自言自语'. The shift from '您' to '你' in the final sentence effectively reflects Holmes's sudden intensity and the shift in the dynamic.
Model: translategemma:27b Score: 🟢 9.0/10
View Translation
Original (English):
Translation (Chinese (Simplified)):
我走进森林，是因为我渴望有意识地生活，直面生活中最基本的事实，并探寻它是否能教会我一些道理。我不想在临终时才发现，我从未真正地活过。我不想活出虚伪的生活，因为生命是如此宝贵；我也不想练习忍耐，除非万不得已。我渴望深入地体验生活，尽情地吮吸生命的精华。
Evaluator Feedback:
The translation captures the philosophical weight of Thoreau's prose with excellent fluency, though 'deliberately' is rendered as '有意识地' (consciously) which slightly misses the nuance of 'purposeful intent' found in the original.
| Score Range | Count | Percentage |
|---|---|---|
| 🟢 Excellent (9-10) | 3 | 2.5% |
| 🟡 Good (7-8) | 90 | 75.0% |
| 🟠 Acceptable (5-6) | 19 | 15.8% |
| 🔴 Poor (3-4) | 4 | 3.3% |
| ⚫ Failed (1-2) | 4 | 3.3% |