INCLUDE
72.7%Native German exam and licensing questions covering region-specific knowledge — history, law, civics and culture. Written by humans in German, not translated.
via CohereLabs/include-base-44 ↗ View run details →German LLM Benchmark · Model Profile
Claude Sonnet 5
Anthropic provider-internal run 2026-07-21
72 .7%
avg. German score
Not ranked — needs ≥3 benchmarks (has 1)
−0.8pp below avg.
Benchmark breakdown
Cost & speed
$4.608 per 1,000 questions