INCLUDE
53.2%Native German exam and licensing questions covering region-specific knowledge — history, law, civics and culture. Written by humans in German, not translated.
via CohereLabs/include-base-44 ↗ View run details →German LLM Benchmark · Model Profile
Gemma 3 12B
Google unverified run 2026-06-03
53 .2%
avg. German score
Not ranked — needs ≥3 benchmarks (has 1)
−20.2pp below avg.
Benchmark breakdown
Cost & speed
$0.053 per 1,000 questions