MMLU-ProX
71.2%Hard academic questions across 14 subjects — STEM, law, health, economics, philosophy and more. Professionally translated to German, with up to ten answer options per question.
via li-lab/MMLU-ProX ↗ View run details →German LLM Benchmark · Model Profile
Gemini 2.5 Flash-Lite
Google provider-internal run 2026-06-03
71 .2%
avg. German score
Not ranked — needs ≥3 benchmarks (has 1)
−2.3pp below avg.
Benchmark breakdown
Cost & speed
$0.761 per 1,000 questions