MMLU-Pro
71.2%Hard academic questions across 14 subjects — STEM, law, health, economics, philosophy and more. Professionally translated to German, with up to ten answer options per question.
via li-lab/MMLU-ProX ↗German LLM Benchmark · Model Profile
avg. German score
+3.3pp above avg.
Hard academic questions across 14 subjects — STEM, law, health, economics, philosophy and more. Professionally translated to German, with up to ten answer options per question.
via li-lab/MMLU-ProX ↗OpenAI's multilingual MMLU, German split — general knowledge spanning STEM, the humanities, social sciences and other domains. Professionally translated to German.
via openai/MMMLU ↗