INCLUDE
53.2%Native German exam and licensing questions covering region-specific knowledge — history, law, civics and culture. Written by humans in German, not translated.
via CohereLabs/include-base-44 ↗German LLM Benchmark · Model Profile
gemma-3-12b-it
Unknown unverified run 2026-06-03
53 .2%
avg. German score
#30 of 30 models
−18.9pp below avg.
Benchmark breakdown
Cost & speed
$0.053 per 1,000 questions