MMLU-ProX
71.2%Hard academic questions across 14 subjects — STEM, law, health, economics, philosophy and more. Professionally translated to German, with up to ten answer options per question.
via li-lab/MMLU-ProX ↗ View run details →German LLM Benchmark · Model Profile
Gemini 2.5 Flash-Lite
Googleprovider-internalrun 2026-06-03
1010
Elo
#43
preliminary
Benchmark breakdown
Comparable models
Cost & speed
$0.761per 1,000 questions