German Language LLM Index
a PeerBench project

Fresh evidence

New results

Completed benchmark runs, newest first. Every entry links to a permanent static result page.

Published runs

243 canonical results across 54 models + 8 early samples.

Follow via RSS →
  1. Ling 3.1 Flash · MMLU-ProX (DE)

    inclusionAI Exact match provider-internal early sample

    79.2%ᵖ
  2. MiMo V2.6 Pro · MuSR (DE)

    Xiaomi Accuracy early sample

    77.1%ᵖ
  3. MiMo V2.6 Pro · INCLUDE (DE)

    Xiaomi Exact match early sample

    83.2%ᵖ
  4. MiMo V2.6 Pro · SB10K (DE)

    Xiaomi MCC early sample

    63.4%ᵖ
  5. MiMo V2.6 Pro · GermEval NER (DE)

    Xiaomi Micro-F1 (no MISC) early sample

    85.1%ᵖ
  6. MiMo V2.6 Pro · ScaLA (DE)

    Xiaomi MCC early sample

    72.0%ᵖ
  7. Muse Spark Open · MMLU-ProX (DE)

    Meta Exact match provider-internal early sample

    86.7%ᵖ
  8. Ling 3.1 Flash · GermEval NER (DE)

    inclusionAI Micro-F1 (no MISC) provider-internal

    80.0%
  9. Ling 3.1 Flash · INCLUDE (DE)

    inclusionAI Exact match provider-internal

    85.0%
  10. Ling 3.1 Flash · MuSR (DE)

    inclusionAI Accuracy provider-internal

    84.6%
  11. Ling 3.1 Flash · SB10K (DE)

    inclusionAI MCC provider-internal

    58.8%
  12. Ling 3.1 Flash · ScaLA (DE)

    inclusionAI MCC provider-internal

    71.3%
  13. Muse Spark Open · GermEval NER (DE)

    Meta Micro-F1 (no MISC) provider-internal

    87.7%
  14. Muse Spark Open · MuSR (DE)

    Meta Accuracy provider-internal

    87.9%
  15. Muse Spark Open · SB10K (DE)

    Meta MCC provider-internal

    66.4%
  16. Muse Spark Open · ScaLA (DE)

    Meta MCC provider-internal

    67.8%
  17. Nemotron 3.5 Bolt 74B-A9B (IQ2) · MuSR (DE)

    NVIDIA Accuracy iq2

    76.9%
  18. Qwen3.8 Flash · MMLU-ProX (DE)

    Alibaba Exact match provider-internal early sample

    80.8%ᵖ
  19. Muse Spark Open · INCLUDE (DE)

    Meta Exact match provider-internal

    86.9%
  20. Nemotron 3.5 Bolt 74B-A9B (IQ2) · GermEval NER (DE)

    NVIDIA Micro-F1 (no MISC) iq2

    73.4%
  21. Nemotron 3.5 Bolt 74B-A9B (IQ2) · INCLUDE (DE)

    NVIDIA Exact match iq2

    73.8%
  22. Nemotron 3.5 Bolt 74B-A9B (IQ2) · SB10K (DE)

    NVIDIA MCC iq2

    52.8%
  23. Nemotron 3.5 Bolt 74B-A9B (IQ2) · ScaLA (DE)

    NVIDIA MCC iq2

    58.9%
  24. Qwen3.8 Flash · GermEval NER (DE)

    Alibaba Micro-F1 (no MISC) provider-internal

    79.1%
  25. Qwen3.8 Flash · INCLUDE (DE)

    Alibaba Exact match provider-internal

    89.7%
  26. Qwen3.8 Flash · SB10K (DE)

    Alibaba MCC provider-internal

    62.5%
  27. Qwen3.8 Flash · ScaLA (DE)

    Alibaba MCC provider-internal

    67.6%
  28. Gemini 4 Argon · GermEval NER (DE)

    Google Micro-F1 (no MISC) provider-internal

    86.7%
  29. Gemini 4 Argon · INCLUDE (DE)

    Google Exact match provider-internal

    89.7%
  30. Gemini 4 Argon · MMLU-ProX (DE)

    Google Exact match provider-internal

    91.6%
  31. Gemini 4 Argon · MuSR (DE)

    Google Accuracy provider-internal

    93.5%
  32. Gemini 4 Argon · SB10K (DE)

    Google MCC provider-internal

    71.8%
  33. Gemini 4 Argon · ScaLA (DE)

    Google MCC provider-internal

    86.2%
  34. Mistral Large 4 (preview) · GermEval NER (DE)

    Mistral Micro-F1 (no MISC) provider-internal

    79.9%
  35. Mistral Large 4 (preview) · INCLUDE (DE)

    Mistral Exact match provider-internal

    83.2%
  36. Mistral Large 4 (preview) · SB10K (DE)

    Mistral MCC provider-internal

    59.9%
  37. Mistral Large 4 (preview) · ScaLA (DE)

    Mistral MCC provider-internal

    61.3%
  38. Kolibri-1 (FP8) · GermEval NER (DE)

    Aleph Alpha Micro-F1 (no MISC) fp8

    72.7%
  39. Kolibri-1 (FP8) · INCLUDE (DE)

    Aleph Alpha Exact match fp8

    75.7%
  40. Kolibri-1 (FP8) · MMLU-ProX (DE)

    Aleph Alpha Exact match fp8

    67.0%
  41. Kolibri-1 (FP8) · MuSR (DE)

    Aleph Alpha Accuracy fp8

    81.4%
  42. Kolibri-1 (FP8) · SB10K (DE)

    Aleph Alpha MCC fp8

    58.4%
  43. Kolibri-1 (FP8) · ScaLA (DE)

    Aleph Alpha MCC fp8

    59.6%
  44. Gemini 3.8 Flash · GermEval NER (DE)

    Google Micro-F1 (no MISC) provider-internal

    87.2%
  45. Gemini 3.8 Flash · MMLU-ProX (DE)

    Google Exact match provider-internal

    89.0%
  46. Gemini 3.8 Flash · SB10K (DE)

    Google MCC provider-internal

    66.9%
  47. Gemini 3.8 Flash · ScaLA (DE)

    Google MCC provider-internal

    80.6%
  48. Gemini 3.8 Flash · INCLUDE (DE)

    Google Exact match provider-internal

    93.5%
  49. Gemini 3.8 Flash · MuSR (DE)

    Google Accuracy provider-internal

    89.0%
  50. Gemini 3.5 Flash-Lite · GermEval NER (DE)

    Google Micro-F1 (no MISC) provider-internal

    85.4%
  51. Gemini 3.5 Flash-Lite · INCLUDE (DE)

    Google Exact match provider-internal

    85.0%
  52. Gemini 3.5 Flash-Lite · MuSR (DE)

    Google Accuracy provider-internal

    82.3%
  53. Gemini 3.5 Flash-Lite · SB10K (DE)

    Google MCC provider-internal

    62.5%
  54. Gemini 3.5 Flash-Lite · ScaLA (DE)

    Google MCC provider-internal

    75.1%
  55. GLM-5.3 Flash · GermEval NER (DE)

    Z.ai Micro-F1 (no MISC) fp8

    86.4%
  56. GLM-5.3 Flash · INCLUDE (DE)

    Z.ai Exact match fp8

    86.9%
  57. GLM-5.3 Flash · MuSR (DE)

    Z.ai Accuracy fp8

    81.9%
  58. GLM-5.3 Flash · SB10K (DE)

    Z.ai MCC fp8

    63.6%
  59. GLM-5.3 Flash · ScaLA (DE)

    Z.ai MCC fp8

    77.2%
  60. Tencent HY3 · GermEval NER (DE)

    Tencent Micro-F1 (no MISC) fp8

    76.1%
  61. Tencent HY3 · INCLUDE (DE)

    Tencent Exact match fp8

    83.2%
  62. Tencent HY3 · MuSR (DE)

    Tencent Accuracy

    85.0%
  63. Tencent HY3 · SB10K (DE)

    Tencent MCC fp8

    62.4%
  64. Tencent HY3 · ScaLA (DE)

    Tencent MCC fp8

    69.7%
  65. Tencent HY4-Preview · GermEval NER (DE)

    Tencent Micro-F1 (no MISC) fp8

    82.1%
  66. Tencent HY4-Preview · INCLUDE (DE)

    Tencent Exact match fp8

    86.9%
  67. Tencent HY4-Preview · MuSR (DE)

    Tencent Accuracy fp8

    80.1%
  68. Tencent HY4-Preview · SB10K (DE)

    Tencent MCC fp8

    62.4%
  69. Tencent HY4-Preview · ScaLA (DE)

    Tencent MCC fp8

    74.0%
  70. Gemini 3.1 Pro · MMLU-ProX (DE)

    Google Exact match provider-internal

    89.2%
  71. Muse Glimmer 30B · INCLUDE (DE)

    Meta Exact match

    86.0%
  72. Muse Glimmer 30B · MuSR (DE)

    Meta Accuracy

    86.1%
  73. NVIDIA Nemotron 3 Ultra 550B-A55B · INCLUDE (DE)

    NVIDIA Exact match

    86.9%
  74. Qwen3.6 27B (BF16) · GermEval NER (DE)

    Alibaba Micro-F1 (no MISC) bf16

    82.7%
  75. Qwen3.6 27B (BF16) · INCLUDE (DE)

    Alibaba Exact match bf16

    83.2%
  76. Qwen3.6 27B (BF16) · MMLU-ProX (DE)

    Alibaba Exact match bf16

    82.3%
  77. Qwen3.6 27B (BF16) · MuSR (DE)

    Alibaba Accuracy bf16

    84.4%
  78. Qwen3.6 27B (BF16) · SB10K (DE)

    Alibaba MCC bf16

    61.0%
  79. Qwen3.6 27B (BF16) · ScaLA (DE)

    Alibaba MCC bf16

    71.7%
  80. Qwen3.8 27B (BF16) · GermEval NER (DE)

    Alibaba Micro-F1 (no MISC) bf16

    81.5%
  81. Qwen3.8 27B (BF16) · INCLUDE (DE)

    Alibaba Exact match bf16

    87.9%
  82. Qwen3.8 27B (BF16) · MMLU-ProX (DE)

    Alibaba Exact match bf16

    79.9%
  83. Qwen3.8 27B (BF16) · MuSR (DE)

    Alibaba Accuracy bf16

    86.1%
  84. Qwen3.8 27B (BF16) · SB10K (DE)

    Alibaba MCC bf16

    62.6%
  85. Qwen3.8 27B (BF16) · ScaLA (DE)

    Alibaba MCC bf16

    66.9%
  86. Qwen3.8 27B (FP8) · GermEval NER (DE)

    Alibaba Micro-F1 (no MISC) fp8

    81.6%
  87. Qwen3.8 27B (FP8) · INCLUDE (DE)

    Alibaba Exact match fp8

    86.9%
  88. Qwen3.8 27B (FP8) · MMLU-ProX (DE)

    Alibaba Exact match fp8

    80.0%
  89. Qwen3.8 27B (FP8) · SB10K (DE)

    Alibaba MCC fp8

    62.7%
  90. Qwen3.8 27B (FP8) · ScaLA (DE)

    Alibaba MCC fp8

    66.3%
  91. DeepSeek V4 Pro 0813 · MMLU-ProX (DE)

    DeepSeek Exact match

    80.7%
  92. Gemini 3.7 Flash · GermEval NER (DE)

    Google Micro-F1 (no MISC) provider-internal

    86.9%
  93. Gemini 3.7 Flash · INCLUDE (DE)

    Google Exact match provider-internal

    93.5%
  94. Gemini 3.7 Flash · MMLU-ProX (DE)

    Google Exact match provider-internal

    88.2%
  95. Gemini 3.7 Flash · MuSR (DE)

    Google Accuracy provider-internal

    88.6%
  96. Gemini 3.7 Flash · SB10K (DE)

    Google MCC provider-internal

    67.5%
  97. Gemini 3.7 Flash · ScaLA (DE)

    Google MCC provider-internal

    79.1%
  98. DeepSeek V4 Pro 0813 · GermEval NER (DE)

    DeepSeek Micro-F1 (no MISC) provider-internal

    81.7%
  99. DeepSeek V4 Pro 0813 · INCLUDE (DE)

    DeepSeek Exact match provider-internal

    87.9%
  100. DeepSeek V4 Pro 0813 · MuSR (DE)

    DeepSeek Accuracy provider-internal

    82.3%
  101. DeepSeek V4 Pro 0813 · SB10K (DE)

    DeepSeek MCC provider-internal

    60.8%
  102. DeepSeek V4 Pro 0813 · ScaLA (DE)

    DeepSeek MCC provider-internal

    75.6%
  103. GPT-5.6 Luna · GermEval NER (DE)

    OpenAI Micro-F1 (no MISC) provider-internal

    81.9%
  104. GPT-5.6 Luna · INCLUDE (DE)

    OpenAI Exact match provider-internal

    86.0%
  105. GPT-5.6 Luna · MuSR (DE)

    OpenAI Accuracy provider-internal

    75.8%
  106. GPT-5.6 Luna · SB10K (DE)

    OpenAI MCC provider-internal

    61.9%
  107. GPT-5.6 Luna · ScaLA (DE)

    OpenAI MCC provider-internal

    72.2%
  108. GPT-5.6 Terra · INCLUDE (DE)

    OpenAI Exact match provider-internal

    88.8%
  109. GPT-5.6 Terra · MuSR (DE)

    OpenAI Accuracy provider-internal

    78.7%
  110. GPT-5.6 Terra · GermEval NER (DE)

    OpenAI Micro-F1 (no MISC) provider-internal

    83.3%
  111. GPT-5.6 Terra · SB10K (DE)

    OpenAI MCC provider-internal

    62.7%
  112. GPT-5.6 Terra · ScaLA (DE)

    OpenAI MCC provider-internal

    75.1%
  113. NVIDIA Nemotron 3 Ultra 550B-A55B · GermEval NER (DE)

    NVIDIA Micro-F1 (no MISC)

    80.3%
  114. DeepSeek V4 Flash 0423 · GermEval NER (DE)

    DeepSeek Micro-F1 (no MISC) fp4

    80.7%
  115. DeepSeek V4 Flash 0423 · MuSR (DE)

    DeepSeek Accuracy fp4

    85.3%
  116. DeepSeek V4 Flash 0423 · SB10K (DE)

    DeepSeek MCC fp4

    61.9%
  117. DeepSeek V4 Flash 0423 · ScaLA (DE)

    DeepSeek MCC fp4

    74.0%
  118. DeepSeek V4 Flash 0731 · GermEval NER (DE)

    DeepSeek Micro-F1 (no MISC) fp4

    82.0%
  119. DeepSeek V4 Flash 0731 · SB10K (DE)

    DeepSeek MCC fp4

    61.2%
  120. DeepSeek V4 Flash 0731 · ScaLA (DE)

    DeepSeek MCC fp4

    76.1%
  121. MiMo V2.5 · GermEval NER (DE)

    Xiaomi Micro-F1 (no MISC) fp8

    80.8%
  122. MiMo V2.5 · SB10K (DE)

    Xiaomi MCC fp8

    61.2%
  123. MiMo V2.5 · ScaLA (DE)

    Xiaomi MCC fp8

    53.4%
  124. Gemini 3.5 Flash-Lite · MMLU-ProX (DE)

    Google Exact match provider-internal

    80.2%
  125. Gemini 3.6 Flash · GermEval NER (DE)

    Google Micro-F1 (no MISC) provider-internal

    86.2%
  126. Gemini 3.6 Flash · INCLUDE (DE)

    Google Exact match provider-internal

    74.8%
  127. Gemini 3.6 Flash · MMLU-ProX (DE)

    Google Exact match provider-internal

    86.0%
  128. Gemini 3.6 Flash · MuSR (DE)

    Google Accuracy provider-internal

    80.3%
  129. Gemini 3.6 Flash · SB10K (DE)

    Google MCC provider-internal

    64.5%
  130. Gemini 3.6 Flash · ScaLA (DE)

    Google MCC provider-internal

    77.6%
  131. Claude Sonnet 5 · INCLUDE (DE)

    Anthropic Exact match provider-internal

    72.7%
  132. Claude Fable 5 · GermEval NER (DE)

    Anthropic Micro-F1 (no MISC) provider-internal

    87.7%
  133. Claude Fable 5 · SB10K (DE)

    Anthropic MCC provider-internal

    67.3%
  134. Claude Fable 5 · ScaLA (DE)

    Anthropic MCC provider-internal

    83.6%
  135. Claude Fable 5 · INCLUDE (DE)

    Anthropic Exact match provider-internal

    72.7%
  136. Claude Fable 5 · MuSR (DE)

    Anthropic Accuracy provider-internal

    89.5%
  137. GPT-5.5 · MMLU-ProX (DE)

    OpenAI Exact match provider-internal

    87.2%
  138. Gemini 3 Flash Preview · GermEval NER (DE)

    Google Micro-F1 (no MISC) provider-internal

    84.7%
  139. Gemini 3 Flash Preview · INCLUDE (DE)

    Google Exact match provider-internal

    71.9%
  140. Gemini 3 Flash Preview · MMLU-ProX (DE)

    Google Exact match provider-internal

    86.3%
  141. Gemini 3 Flash Preview · MuSR (DE)

    Google Accuracy provider-internal

    79.3%
  142. Gemini 3 Flash Preview · SB10K (DE)

    Google MCC provider-internal

    63.6%
  143. Gemini 3 Flash Preview · ScaLA (DE)

    Google MCC provider-internal

    77.0%
  144. DeepSeek V4 Pro · MuSR (DE)

    DeepSeek Accuracy provider-internal

    85.3%
  145. DeepSeek V4 Flash · MMLU-ProX (DE)

    DeepSeek Exact match provider-internal

    74.9%
  146. DeepSeek V4 Pro · MMLU-ProX (DE)

    DeepSeek Exact match provider-internal

    80.8%
  147. Claude Opus 4.8 · GermEval NER (DE)

    Anthropic Micro-F1 (no MISC) provider-internal

    85.8%
  148. Claude Opus 4.8 · MuSR (DE)

    Anthropic Accuracy provider-internal

    86.3%
  149. Claude Opus 4.8 · SB10K (DE)

    Anthropic MCC provider-internal

    64.5%
  150. Claude Opus 4.8 · ScaLA (DE)

    Anthropic MCC provider-internal

    82.6%
  151. GPT-5.5 · GermEval NER (DE)

    OpenAI Micro-F1 (no MISC) provider-internal

    85.9%
  152. GPT-5.5 · MuSR (DE)

    OpenAI Accuracy provider-internal

    86.3%
  153. GPT-5.5 · SB10K (DE)

    OpenAI MCC provider-internal

    62.5%
  154. GPT-5.5 · ScaLA (DE)

    OpenAI MCC provider-internal

    79.7%
  155. Claude Opus 4.8 · INCLUDE (DE)

    Anthropic Exact match provider-internal

    71.9%
  156. GPT-5.5 · INCLUDE (DE)

    OpenAI Exact match provider-internal

    74.8%
  157. Gemma 4 12B · GermEval NER (DE)

    Google Micro-F1 (no MISC) bf16

    79.6%
  158. Gemma 4 12B · INCLUDE (DE)

    Google Exact match bf16

    69.1%
  159. Gemma 4 12B · MMLU-ProX (DE)

    Google Exact match bf16

    73.1%
  160. Gemma 4 12B · MuSR (DE)

    Google Accuracy bf16

    81.6%
  161. Gemma 4 12B · SB10K (DE)

    Google MCC bf16

    62.2%
  162. Gemma 4 12B · ScaLA (DE)

    Google MCC bf16

    64.1%
  163. Gemma 4 31B · GermEval NER (DE)

    Google Micro-F1 (no MISC) bf16

    82.6%
  164. Gemma 4 31B · INCLUDE (DE)

    Google Exact match bf16

    68.3%
  165. Gemma 4 31B · MMLU-ProX (DE)

    Google Exact match bf16

    82.1%
  166. Gemma 4 31B · MuSR (DE)

    Google Accuracy bf16

    83.5%
  167. Gemma 4 31B · SB10K (DE)

    Google MCC bf16

    61.0%
  168. Gemma 4 31B · ScaLA (DE)

    Google MCC bf16

    71.0%
  169. Qwen3 14B · GermEval NER (DE)

    Alibaba Micro-F1 (no MISC) bf16

    73.0%
  170. Qwen3 14B · INCLUDE (DE)

    Alibaba Exact match bf16

    63.3%
  171. Qwen3 14B · MMLU-ProX (DE)

    Alibaba Exact match bf16

    64.1%
  172. Qwen3 14B · MuSR (DE)

    Alibaba Accuracy bf16

    69.7%
  173. Qwen3 14B · SB10K (DE)

    Alibaba MCC bf16

    56.1%
  174. Qwen3 14B · ScaLA (DE)

    Alibaba MCC bf16

    64.0%
  175. Qwen3.5 9B · GermEval NER (DE)

    Alibaba Micro-F1 (no MISC) bf16

    72.6%
  176. Qwen3.5 9B · INCLUDE (DE)

    Alibaba Exact match bf16

    64.7%
  177. Qwen3.5 9B · MMLU-ProX (DE)

    Alibaba Exact match bf16

    73.4%
  178. Qwen3.5 9B · MuSR (DE)

    Alibaba Accuracy bf16

    80.9%
  179. Qwen3.5 9B · SB10K (DE)

    Alibaba MCC bf16

    55.7%
  180. DeepSeek V4 Flash · MuSR (DE)

    DeepSeek Accuracy fp8

    83.5%
  181. Gemini 3.1 Flash-Lite · INCLUDE (DE)

    Google Exact match provider-internal

    71.9%
  182. Gemini 3.1 Pro · INCLUDE (DE)

    Google Exact match provider-internal

    77.7%
  183. Gemini 3.5 Flash · INCLUDE (DE)

    Google Exact match provider-internal

    74.1%
  184. Gemma 4 26B A4B · MuSR (DE)

    Google Accuracy bf16

    83.7%
  185. GLM-5.1 · MuSR (DE)

    Z.ai Accuracy fp8

    81.4%
  186. MiMo V2.5 Pro · MuSR (DE)

    Xiaomi Accuracy fp8

    80.9%
  187. Qwen3.5 9B · ScaLA (DE)

    Alibaba MCC bf16

    62.4%
  188. DeepSeek V4 Flash · GermEval NER (DE)

    DeepSeek Micro-F1 (no MISC) bf16

    80.2%
  189. DeepSeek V4 Flash · SB10K (DE)

    DeepSeek MCC bf16

    62.4%
  190. DeepSeek V4 Flash · ScaLA (DE)

    DeepSeek MCC bf16

    74.9%
  191. DeepSeek V4 Pro · GermEval NER (DE)

    DeepSeek Micro-F1 (no MISC) fp8

    82.2%
  192. DeepSeek V4 Pro · SB10K (DE)

    DeepSeek MCC fp8

    60.0%
  193. DeepSeek V4 Pro · ScaLA (DE)

    DeepSeek MCC fp8

    73.5%
  194. Gemini 2.5 Flash · GermEval NER (DE)

    Google Micro-F1 (no MISC) provider-internal

    81.8%
  195. Gemini 2.5 Flash · MuSR (DE)

    Google Accuracy provider-internal

    83.3%
  196. Gemini 2.5 Flash · SB10K (DE)

    Google MCC provider-internal

    61.6%
  197. Gemini 2.5 Flash · ScaLA (DE)

    Google MCC provider-internal

    77.1%
  198. Gemini 3.1 Flash-Lite · MuSR (DE)

    Google Accuracy provider-internal

    84.4%
  199. Gemini 3.1 Pro · GermEval NER (DE)

    Google Micro-F1 (no MISC) provider-internal

    87.3%
  200. Gemini 3.1 Pro · MuSR (DE)

    Google Accuracy provider-internal

    88.1%
  201. Gemini 3.1 Pro · SB10K (DE)

    Google MCC provider-internal

    70.1%
  202. Gemini 3.1 Pro · ScaLA (DE)

    Google MCC provider-internal

    80.4%
  203. Gemini 3.5 Flash · GermEval NER (DE)

    Google Micro-F1 (no MISC) provider-internal

    86.0%
  204. Gemini 3.5 Flash · MuSR (DE)

    Google Accuracy provider-internal

    84.2%
  205. Gemini 3.5 Flash · SB10K (DE)

    Google MCC provider-internal

    64.3%
  206. Gemini 3.5 Flash · ScaLA (DE)

    Google MCC provider-internal

    79.4%
  207. GLM-5.1 · GermEval NER (DE)

    Z.ai Micro-F1 (no MISC) fp8

    52.2%
  208. GLM-5.1 · SB10K (DE)

    Z.ai MCC fp8

    23.1%
  209. GLM-5.1 · ScaLA (DE)

    Z.ai MCC fp8

    69.9%
  210. MiMo V2.5 Pro · GermEval NER (DE)

    Xiaomi Micro-F1 (no MISC) fp8

    81.9%
  211. MiMo V2.5 Pro · SB10K (DE)

    Xiaomi MCC fp8

    61.7%
  212. MiMo V2.5 Pro · ScaLA (DE)

    Xiaomi MCC fp8

    74.8%
  213. Qwen3.6 35B-A3B · GermEval NER (DE)

    Alibaba Micro-F1 (no MISC) fp8

    79.9%
  214. Qwen3.6 35B-A3B · SB10K (DE)

    Alibaba MCC fp8

    58.4%
  215. Qwen3.6 35B-A3B · ScaLA (DE)

    Alibaba MCC fp8

    64.2%
  216. Qwen3.7 Max · GermEval NER (DE)

    Alibaba Micro-F1 (no MISC) provider-internal

    82.1%
  217. Qwen3.7 Max · SB10K (DE)

    Alibaba MCC provider-internal

    63.2%
  218. Qwen3.7 Max · ScaLA (DE)

    Alibaba MCC provider-internal

    69.8%
  219. Tencent HY3-Preview · GermEval NER (DE)

    Tencent Micro-F1 (no MISC) provider-internal

    77.3%
  220. Tencent HY3-Preview · SB10K (DE)

    Tencent MCC provider-internal

    38.9%
  221. Tencent HY3-Preview · ScaLA (DE)

    Tencent MCC provider-internal

    62.5%
  222. DeepSeek V4 Flash · INCLUDE (DE)

    DeepSeek Exact match fp8

    70.5%
  223. DeepSeek V4 Pro · INCLUDE (DE)

    DeepSeek Exact match fp8

    70.5%
  224. Gemini 3.1 Flash-Lite · GermEval NER (DE)

    Google Micro-F1 (no MISC) provider-internal

    83.2%
  225. Gemini 3.1 Flash-Lite · SB10K (DE)

    Google MCC provider-internal

    60.4%
  226. Gemini 3.1 Flash-Lite · ScaLA (DE)

    Google MCC provider-internal

    74.2%
  227. Gemma 4 26B A4B · GermEval NER (DE)

    Google Micro-F1 (no MISC) provider-internal

    81.8%
  228. Gemma 4 26B A4B · SB10K (DE)

    Google MCC provider-internal

    15.2%
  229. Gemma 4 26B A4B · ScaLA (DE)

    Google MCC provider-internal

    66.3%
  230. GLM-5.1 · INCLUDE (DE)

    Z.ai Exact match fp8

    82.2%
  231. Kimi K2.6 · INCLUDE (DE)

    Moonshot Exact match fp8

    69.8%
  232. MiMo V2.5 Pro · INCLUDE (DE)

    Xiaomi Exact match fp8

    67.6%
  233. Qwen3.7 Max · INCLUDE (DE)

    Alibaba Exact match provider-internal

    71.2%
  234. Gemma 4 26B A4B · MMLU-ProX (DE)

    Google Exact match bf16

    78.2%
  235. Claude Haiku 4.5 · MMLU-ProX (DE)

    Anthropic Exact match provider-internal

    75.3%
  236. Gemini 2.5 Flash-Lite · MMLU-ProX (DE)

    Google Exact match provider-internal

    71.2%
  237. Gemini 3.1 Flash-Lite · MMLU-ProX (DE)

    Google Exact match provider-internal

    82.2%
  238. Gemma 3 12B · INCLUDE (DE)

    Google Exact match

    53.2%
  239. Gemma 4 26B A4B · INCLUDE (DE)

    Google Exact match bf16

    64.7%
  240. Grok 4.3 · INCLUDE (DE)

    xAI Exact match

    63.3%
  241. Ministral 14B · INCLUDE (DE)

    Mistral Exact match

    58.3%
  242. Claude Haiku 4.5 · INCLUDE (DE)

    Anthropic Exact match provider-internal

    68.3%
  243. Gemini 2.5 Flash · INCLUDE (DE)

    Google Exact match provider-internal

    70.5%
  244. Qwen3.6 35B-A3B · INCLUDE (DE)

    Alibaba Exact match fp8

    68.3%
  245. Tencent HY3-Preview · INCLUDE (DE)

    Tencent Exact match provider-internal

    69.1%
  246. Qwen3.6 35B-A3B · MMLU-ProX (DE)

    Alibaba Exact match fp8

    80.0%
  247. gpt-oss-120b · INCLUDE (DE)

    OpenAI Exact match

    66.2%
  248. Tencent HY3-Preview · MMLU-ProX (DE)

    Tencent Exact match provider-internal

    73.2%
  249. Gemini 2.5 Flash · MMLU-ProX (DE)

    Google Exact match provider-internal

    79.6%
  250. Gemini 3.5 Flash · MMLU-ProX (DE)

    Google Exact match provider-internal

    86.5%
  251. Undated
    MiniMax M2.7 · INCLUDE (DE)

    MiniMax Exact match fp8

    72.7%