German Language LLM Index
a PeerBench project

Fresh evidence

New results

Completed benchmark runs, newest first. Every entry links to a permanent static result page.

Published runs

202 canonical results across 46 models.

Follow via RSS →
  1. Gemini 3.5 Flash-Lite · GermEval NER (DE)

    Google Micro-F1 (no MISC) provider-internal

    85.4%
  2. Gemini 3.5 Flash-Lite · INCLUDE (DE)

    Google Exact match provider-internal

    85.0%
  3. Gemini 3.5 Flash-Lite · MuSR (DE)

    Google Accuracy provider-internal

    82.3%
  4. Gemini 3.5 Flash-Lite · SB10K (DE)

    Google MCC provider-internal

    62.5%
  5. Gemini 3.5 Flash-Lite · ScaLA (DE)

    Google MCC provider-internal

    75.1%
  6. GLM-5.3 Flash · GermEval NER (DE)

    Z.ai Micro-F1 (no MISC) fp8

    86.4%
  7. GLM-5.3 Flash · INCLUDE (DE)

    Z.ai Exact match fp8

    86.9%
  8. GLM-5.3 Flash · MuSR (DE)

    Z.ai Accuracy fp8

    81.9%
  9. GLM-5.3 Flash · SB10K (DE)

    Z.ai MCC fp8

    63.6%
  10. GLM-5.3 Flash · ScaLA (DE)

    Z.ai MCC fp8

    77.2%
  11. Tencent HY3 · GermEval NER (DE)

    Tencent Micro-F1 (no MISC) fp8

    76.1%
  12. Tencent HY3 · INCLUDE (DE)

    Tencent Exact match fp8

    83.2%
  13. Tencent HY3 · MuSR (DE)

    Tencent Accuracy

    85.0%
  14. Tencent HY3 · SB10K (DE)

    Tencent MCC fp8

    62.4%
  15. Tencent HY3 · ScaLA (DE)

    Tencent MCC fp8

    69.7%
  16. Tencent HY4-Preview · GermEval NER (DE)

    Tencent Micro-F1 (no MISC) fp8

    82.1%
  17. Tencent HY4-Preview · INCLUDE (DE)

    Tencent Exact match fp8

    86.9%
  18. Tencent HY4-Preview · MuSR (DE)

    Tencent Accuracy fp8

    80.1%
  19. Tencent HY4-Preview · SB10K (DE)

    Tencent MCC fp8

    62.4%
  20. Tencent HY4-Preview · ScaLA (DE)

    Tencent MCC fp8

    74.0%
  21. Gemini 3.1 Pro · MMLU-ProX (DE)

    Google Exact match provider-internal

    89.2%
  22. Muse Glimmer 30B · INCLUDE (DE)

    Meta Exact match

    86.0%
  23. Muse Glimmer 30B · MuSR (DE)

    Meta Accuracy

    86.1%
  24. NVIDIA Nemotron 3 Ultra 550B-A55B · INCLUDE (DE)

    NVIDIA Exact match

    86.9%
  25. Qwen3.6 27B (BF16) · GermEval NER (DE)

    Alibaba Micro-F1 (no MISC) bf16

    82.7%
  26. Qwen3.6 27B (BF16) · INCLUDE (DE)

    Alibaba Exact match bf16

    83.2%
  27. Qwen3.6 27B (BF16) · MMLU-ProX (DE)

    Alibaba Exact match bf16

    82.3%
  28. Qwen3.6 27B (BF16) · MuSR (DE)

    Alibaba Accuracy bf16

    84.4%
  29. Qwen3.6 27B (BF16) · SB10K (DE)

    Alibaba MCC bf16

    61.0%
  30. Qwen3.6 27B (BF16) · ScaLA (DE)

    Alibaba MCC bf16

    71.7%
  31. Qwen3.8 27B (BF16) · GermEval NER (DE)

    Alibaba Micro-F1 (no MISC) bf16

    81.5%
  32. Qwen3.8 27B (BF16) · INCLUDE (DE)

    Alibaba Exact match bf16

    87.9%
  33. Qwen3.8 27B (BF16) · MMLU-ProX (DE)

    Alibaba Exact match bf16

    79.9%
  34. Qwen3.8 27B (BF16) · MuSR (DE)

    Alibaba Accuracy bf16

    86.1%
  35. Qwen3.8 27B (BF16) · SB10K (DE)

    Alibaba MCC bf16

    62.6%
  36. Qwen3.8 27B (BF16) · ScaLA (DE)

    Alibaba MCC bf16

    66.9%
  37. Qwen3.8 27B (FP8) · GermEval NER (DE)

    Alibaba Micro-F1 (no MISC) fp8

    81.6%
  38. Qwen3.8 27B (FP8) · INCLUDE (DE)

    Alibaba Exact match fp8

    86.9%
  39. Qwen3.8 27B (FP8) · MMLU-ProX (DE)

    Alibaba Exact match fp8

    80.0%
  40. Qwen3.8 27B (FP8) · SB10K (DE)

    Alibaba MCC fp8

    62.7%
  41. Qwen3.8 27B (FP8) · ScaLA (DE)

    Alibaba MCC fp8

    66.3%
  42. DeepSeek V4 Pro 0813 · MMLU-ProX (DE)

    DeepSeek Exact match

    80.7%
  43. Gemini 3.7 Flash · GermEval NER (DE)

    Google Micro-F1 (no MISC) provider-internal

    86.9%
  44. Gemini 3.7 Flash · INCLUDE (DE)

    Google Exact match provider-internal

    93.5%
  45. Gemini 3.7 Flash · MMLU-ProX (DE)

    Google Exact match provider-internal

    88.2%
  46. Gemini 3.7 Flash · MuSR (DE)

    Google Accuracy provider-internal

    88.6%
  47. Gemini 3.7 Flash · SB10K (DE)

    Google MCC provider-internal

    67.5%
  48. Gemini 3.7 Flash · ScaLA (DE)

    Google MCC provider-internal

    79.1%
  49. DeepSeek V4 Pro 0813 · GermEval NER (DE)

    DeepSeek Micro-F1 (no MISC) provider-internal

    81.7%
  50. DeepSeek V4 Pro 0813 · INCLUDE (DE)

    DeepSeek Exact match provider-internal

    87.9%
  51. DeepSeek V4 Pro 0813 · MuSR (DE)

    DeepSeek Accuracy provider-internal

    82.3%
  52. DeepSeek V4 Pro 0813 · SB10K (DE)

    DeepSeek MCC provider-internal

    60.8%
  53. DeepSeek V4 Pro 0813 · ScaLA (DE)

    DeepSeek MCC provider-internal

    75.6%
  54. GPT-5.6 Luna · GermEval NER (DE)

    OpenAI Micro-F1 (no MISC) provider-internal

    81.9%
  55. GPT-5.6 Luna · INCLUDE (DE)

    OpenAI Exact match provider-internal

    86.0%
  56. GPT-5.6 Luna · MuSR (DE)

    OpenAI Accuracy provider-internal

    75.8%
  57. GPT-5.6 Luna · SB10K (DE)

    OpenAI MCC provider-internal

    61.9%
  58. GPT-5.6 Luna · ScaLA (DE)

    OpenAI MCC provider-internal

    72.2%
  59. GPT-5.6 Terra · INCLUDE (DE)

    OpenAI Exact match provider-internal

    88.8%
  60. GPT-5.6 Terra · MuSR (DE)

    OpenAI Accuracy provider-internal

    78.7%
  61. GPT-5.6 Terra · GermEval NER (DE)

    OpenAI Micro-F1 (no MISC) provider-internal

    83.3%
  62. GPT-5.6 Terra · SB10K (DE)

    OpenAI MCC provider-internal

    62.7%
  63. GPT-5.6 Terra · ScaLA (DE)

    OpenAI MCC provider-internal

    75.1%
  64. NVIDIA Nemotron 3 Ultra 550B-A55B · GermEval NER (DE)

    NVIDIA Micro-F1 (no MISC)

    80.3%
  65. DeepSeek V4 Flash 0423 · GermEval NER (DE)

    DeepSeek Micro-F1 (no MISC) fp4

    80.7%
  66. DeepSeek V4 Flash 0423 · MuSR (DE)

    DeepSeek Accuracy fp4

    85.3%
  67. DeepSeek V4 Flash 0423 · SB10K (DE)

    DeepSeek MCC fp4

    61.9%
  68. DeepSeek V4 Flash 0423 · ScaLA (DE)

    DeepSeek MCC fp4

    74.0%
  69. DeepSeek V4 Flash 0731 · GermEval NER (DE)

    DeepSeek Micro-F1 (no MISC) fp4

    82.0%
  70. DeepSeek V4 Flash 0731 · SB10K (DE)

    DeepSeek MCC fp4

    61.2%
  71. DeepSeek V4 Flash 0731 · ScaLA (DE)

    DeepSeek MCC fp4

    76.1%
  72. MiMo V2.5 · GermEval NER (DE)

    Xiaomi Micro-F1 (no MISC) fp8

    80.8%
  73. MiMo V2.5 · SB10K (DE)

    Xiaomi MCC fp8

    61.2%
  74. MiMo V2.5 · ScaLA (DE)

    Xiaomi MCC fp8

    53.4%
  75. Gemini 3.5 Flash-Lite · MMLU-ProX (DE)

    Google Exact match provider-internal

    80.2%
  76. Gemini 3.6 Flash · GermEval NER (DE)

    Google Micro-F1 (no MISC) provider-internal

    86.2%
  77. Gemini 3.6 Flash · INCLUDE (DE)

    Google Exact match provider-internal

    74.8%
  78. Gemini 3.6 Flash · MMLU-ProX (DE)

    Google Exact match provider-internal

    86.0%
  79. Gemini 3.6 Flash · MuSR (DE)

    Google Accuracy provider-internal

    80.3%
  80. Gemini 3.6 Flash · SB10K (DE)

    Google MCC provider-internal

    64.5%
  81. Gemini 3.6 Flash · ScaLA (DE)

    Google MCC provider-internal

    77.6%
  82. Claude Sonnet 5 · INCLUDE (DE)

    Anthropic Exact match provider-internal

    72.7%
  83. Claude Fable 5 · GermEval NER (DE)

    Anthropic Micro-F1 (no MISC) provider-internal

    87.7%
  84. Claude Fable 5 · SB10K (DE)

    Anthropic MCC provider-internal

    67.3%
  85. Claude Fable 5 · ScaLA (DE)

    Anthropic MCC provider-internal

    83.6%
  86. Claude Fable 5 · INCLUDE (DE)

    Anthropic Exact match provider-internal

    72.7%
  87. Claude Fable 5 · MuSR (DE)

    Anthropic Accuracy provider-internal

    89.5%
  88. GPT-5.5 · MMLU-ProX (DE)

    OpenAI Exact match provider-internal

    87.2%
  89. Gemini 3 Flash Preview · GermEval NER (DE)

    Google Micro-F1 (no MISC) provider-internal

    84.7%
  90. Gemini 3 Flash Preview · INCLUDE (DE)

    Google Exact match provider-internal

    71.9%
  91. Gemini 3 Flash Preview · MMLU-ProX (DE)

    Google Exact match provider-internal

    86.3%
  92. Gemini 3 Flash Preview · MuSR (DE)

    Google Accuracy provider-internal

    79.3%
  93. Gemini 3 Flash Preview · SB10K (DE)

    Google MCC provider-internal

    63.6%
  94. Gemini 3 Flash Preview · ScaLA (DE)

    Google MCC provider-internal

    77.0%
  95. DeepSeek V4 Pro · MuSR (DE)

    DeepSeek Accuracy provider-internal

    85.3%
  96. DeepSeek V4 Flash · MMLU-ProX (DE)

    DeepSeek Exact match provider-internal

    74.9%
  97. DeepSeek V4 Pro · MMLU-ProX (DE)

    DeepSeek Exact match provider-internal

    80.8%
  98. Claude Opus 4.8 · GermEval NER (DE)

    Anthropic Micro-F1 (no MISC) provider-internal

    85.8%
  99. Claude Opus 4.8 · MuSR (DE)

    Anthropic Accuracy provider-internal

    86.3%
  100. Claude Opus 4.8 · SB10K (DE)

    Anthropic MCC provider-internal

    64.5%
  101. Claude Opus 4.8 · ScaLA (DE)

    Anthropic MCC provider-internal

    82.6%
  102. GPT-5.5 · GermEval NER (DE)

    OpenAI Micro-F1 (no MISC) provider-internal

    85.9%
  103. GPT-5.5 · MuSR (DE)

    OpenAI Accuracy provider-internal

    86.3%
  104. GPT-5.5 · SB10K (DE)

    OpenAI MCC provider-internal

    62.5%
  105. GPT-5.5 · ScaLA (DE)

    OpenAI MCC provider-internal

    79.7%
  106. Claude Opus 4.8 · INCLUDE (DE)

    Anthropic Exact match provider-internal

    71.9%
  107. GPT-5.5 · INCLUDE (DE)

    OpenAI Exact match provider-internal

    74.8%
  108. Gemma 4 12B · GermEval NER (DE)

    Google Micro-F1 (no MISC) bf16

    79.6%
  109. Gemma 4 12B · INCLUDE (DE)

    Google Exact match bf16

    69.1%
  110. Gemma 4 12B · MMLU-ProX (DE)

    Google Exact match bf16

    73.1%
  111. Gemma 4 12B · MuSR (DE)

    Google Accuracy bf16

    81.6%
  112. Gemma 4 12B · SB10K (DE)

    Google MCC bf16

    62.2%
  113. Gemma 4 12B · ScaLA (DE)

    Google MCC bf16

    64.1%
  114. Gemma 4 31B · GermEval NER (DE)

    Google Micro-F1 (no MISC) bf16

    82.6%
  115. Gemma 4 31B · INCLUDE (DE)

    Google Exact match bf16

    68.3%
  116. Gemma 4 31B · MMLU-ProX (DE)

    Google Exact match bf16

    82.1%
  117. Gemma 4 31B · MuSR (DE)

    Google Accuracy bf16

    83.5%
  118. Gemma 4 31B · SB10K (DE)

    Google MCC bf16

    61.0%
  119. Gemma 4 31B · ScaLA (DE)

    Google MCC bf16

    71.0%
  120. Qwen3 14B · GermEval NER (DE)

    Alibaba Micro-F1 (no MISC) bf16

    73.0%
  121. Qwen3 14B · INCLUDE (DE)

    Alibaba Exact match bf16

    63.3%
  122. Qwen3 14B · MMLU-ProX (DE)

    Alibaba Exact match bf16

    64.1%
  123. Qwen3 14B · MuSR (DE)

    Alibaba Accuracy bf16

    69.7%
  124. Qwen3 14B · SB10K (DE)

    Alibaba MCC bf16

    56.1%
  125. Qwen3 14B · ScaLA (DE)

    Alibaba MCC bf16

    64.0%
  126. Qwen3.5 9B · GermEval NER (DE)

    Alibaba Micro-F1 (no MISC) bf16

    72.6%
  127. Qwen3.5 9B · INCLUDE (DE)

    Alibaba Exact match bf16

    64.7%
  128. Qwen3.5 9B · MMLU-ProX (DE)

    Alibaba Exact match bf16

    73.4%
  129. Qwen3.5 9B · MuSR (DE)

    Alibaba Accuracy bf16

    80.9%
  130. Qwen3.5 9B · SB10K (DE)

    Alibaba MCC bf16

    55.7%
  131. DeepSeek V4 Flash · MuSR (DE)

    DeepSeek Accuracy fp8

    83.5%
  132. Gemini 3.1 Flash-Lite · INCLUDE (DE)

    Google Exact match provider-internal

    71.9%
  133. Gemini 3.1 Pro · INCLUDE (DE)

    Google Exact match provider-internal

    77.7%
  134. Gemini 3.5 Flash · INCLUDE (DE)

    Google Exact match provider-internal

    74.1%
  135. Gemma 4 26B A4B · MuSR (DE)

    Google Accuracy bf16

    83.7%
  136. GLM-5.1 · MuSR (DE)

    Z.ai Accuracy fp8

    81.4%
  137. MiMo V2.5 Pro · MuSR (DE)

    Xiaomi Accuracy fp8

    80.9%
  138. Qwen3.5 9B · ScaLA (DE)

    Alibaba MCC bf16

    62.4%
  139. DeepSeek V4 Flash · GermEval NER (DE)

    DeepSeek Micro-F1 (no MISC) bf16

    80.2%
  140. DeepSeek V4 Flash · SB10K (DE)

    DeepSeek MCC bf16

    62.4%
  141. DeepSeek V4 Flash · ScaLA (DE)

    DeepSeek MCC bf16

    74.9%
  142. DeepSeek V4 Pro · GermEval NER (DE)

    DeepSeek Micro-F1 (no MISC) fp8

    82.2%
  143. DeepSeek V4 Pro · SB10K (DE)

    DeepSeek MCC fp8

    60.0%
  144. DeepSeek V4 Pro · ScaLA (DE)

    DeepSeek MCC fp8

    73.5%
  145. Gemini 2.5 Flash · GermEval NER (DE)

    Google Micro-F1 (no MISC) provider-internal

    81.8%
  146. Gemini 2.5 Flash · MuSR (DE)

    Google Accuracy provider-internal

    83.3%
  147. Gemini 2.5 Flash · SB10K (DE)

    Google MCC provider-internal

    61.6%
  148. Gemini 2.5 Flash · ScaLA (DE)

    Google MCC provider-internal

    77.1%
  149. Gemini 3.1 Flash-Lite · MuSR (DE)

    Google Accuracy provider-internal

    84.4%
  150. Gemini 3.1 Pro · GermEval NER (DE)

    Google Micro-F1 (no MISC) provider-internal

    87.3%
  151. Gemini 3.1 Pro · MuSR (DE)

    Google Accuracy provider-internal

    88.1%
  152. Gemini 3.1 Pro · SB10K (DE)

    Google MCC provider-internal

    70.1%
  153. Gemini 3.1 Pro · ScaLA (DE)

    Google MCC provider-internal

    80.4%
  154. Gemini 3.5 Flash · GermEval NER (DE)

    Google Micro-F1 (no MISC) provider-internal

    86.0%
  155. Gemini 3.5 Flash · MuSR (DE)

    Google Accuracy provider-internal

    84.2%
  156. Gemini 3.5 Flash · SB10K (DE)

    Google MCC provider-internal

    64.3%
  157. Gemini 3.5 Flash · ScaLA (DE)

    Google MCC provider-internal

    79.4%
  158. GLM-5.1 · GermEval NER (DE)

    Z.ai Micro-F1 (no MISC) fp8

    52.2%
  159. GLM-5.1 · SB10K (DE)

    Z.ai MCC fp8

    23.1%
  160. GLM-5.1 · ScaLA (DE)

    Z.ai MCC fp8

    69.9%
  161. MiMo V2.5 Pro · GermEval NER (DE)

    Xiaomi Micro-F1 (no MISC) fp8

    81.9%
  162. MiMo V2.5 Pro · SB10K (DE)

    Xiaomi MCC fp8

    61.7%
  163. MiMo V2.5 Pro · ScaLA (DE)

    Xiaomi MCC fp8

    74.8%
  164. Qwen3.6 35B-A3B · GermEval NER (DE)

    Alibaba Micro-F1 (no MISC) fp8

    79.9%
  165. Qwen3.6 35B-A3B · SB10K (DE)

    Alibaba MCC fp8

    58.4%
  166. Qwen3.6 35B-A3B · ScaLA (DE)

    Alibaba MCC fp8

    64.2%
  167. Qwen3.7 Max · GermEval NER (DE)

    Alibaba Micro-F1 (no MISC) provider-internal

    82.1%
  168. Qwen3.7 Max · SB10K (DE)

    Alibaba MCC provider-internal

    63.2%
  169. Qwen3.7 Max · ScaLA (DE)

    Alibaba MCC provider-internal

    69.8%
  170. Tencent HY3-Preview · GermEval NER (DE)

    Tencent Micro-F1 (no MISC) provider-internal

    77.3%
  171. Tencent HY3-Preview · SB10K (DE)

    Tencent MCC provider-internal

    38.9%
  172. Tencent HY3-Preview · ScaLA (DE)

    Tencent MCC provider-internal

    62.5%
  173. DeepSeek V4 Flash · INCLUDE (DE)

    DeepSeek Exact match fp8

    70.5%
  174. DeepSeek V4 Pro · INCLUDE (DE)

    DeepSeek Exact match fp8

    70.5%
  175. Gemini 3.1 Flash-Lite · GermEval NER (DE)

    Google Micro-F1 (no MISC) provider-internal

    83.2%
  176. Gemini 3.1 Flash-Lite · SB10K (DE)

    Google MCC provider-internal

    60.4%
  177. Gemini 3.1 Flash-Lite · ScaLA (DE)

    Google MCC provider-internal

    74.2%
  178. Gemma 4 26B A4B · GermEval NER (DE)

    Google Micro-F1 (no MISC) provider-internal

    81.8%
  179. Gemma 4 26B A4B · SB10K (DE)

    Google MCC provider-internal

    15.2%
  180. Gemma 4 26B A4B · ScaLA (DE)

    Google MCC provider-internal

    66.3%
  181. GLM-5.1 · INCLUDE (DE)

    Z.ai Exact match fp8

    82.2%
  182. Kimi K2.6 · INCLUDE (DE)

    Moonshot Exact match fp8

    69.8%
  183. MiMo V2.5 Pro · INCLUDE (DE)

    Xiaomi Exact match fp8

    67.6%
  184. Qwen3.7 Max · INCLUDE (DE)

    Alibaba Exact match provider-internal

    71.2%
  185. Gemma 4 26B A4B · MMLU-ProX (DE)

    Google Exact match bf16

    78.2%
  186. Claude Haiku 4.5 · MMLU-ProX (DE)

    Anthropic Exact match provider-internal

    75.3%
  187. Gemini 2.5 Flash-Lite · MMLU-ProX (DE)

    Google Exact match provider-internal

    71.2%
  188. Gemini 3.1 Flash-Lite · MMLU-ProX (DE)

    Google Exact match provider-internal

    82.2%
  189. Gemma 3 12B · INCLUDE (DE)

    Google Exact match

    53.2%
  190. Gemma 4 26B A4B · INCLUDE (DE)

    Google Exact match bf16

    64.7%
  191. Grok 4.3 · INCLUDE (DE)

    xAI Exact match

    63.3%
  192. Ministral 14B · INCLUDE (DE)

    Mistral Exact match

    58.3%
  193. Claude Haiku 4.5 · INCLUDE (DE)

    Anthropic Exact match provider-internal

    68.3%
  194. Gemini 2.5 Flash · INCLUDE (DE)

    Google Exact match provider-internal

    70.5%
  195. Qwen3.6 35B-A3B · INCLUDE (DE)

    Alibaba Exact match fp8

    68.3%
  196. Tencent HY3-Preview · INCLUDE (DE)

    Tencent Exact match provider-internal

    69.1%
  197. Qwen3.6 35B-A3B · MMLU-ProX (DE)

    Alibaba Exact match fp8

    80.0%
  198. gpt-oss-120b · INCLUDE (DE)

    OpenAI Exact match

    66.2%
  199. Tencent HY3-Preview · MMLU-ProX (DE)

    Tencent Exact match provider-internal

    73.2%
  200. Gemini 2.5 Flash · MMLU-ProX (DE)

    Google Exact match provider-internal

    79.6%
  201. Gemini 3.5 Flash · MMLU-ProX (DE)

    Google Exact match provider-internal

    86.5%
  202. Undated
    MiniMax M2.7 · INCLUDE (DE)

    MiniMax Exact match fp8

    72.7%