INCLUDE
72.7%Native German exam and licensing questions covering region-specific knowledge — history, law, civics and culture. Written by humans in German, not translated.
via CohereLabs/include-base-44 ↗ View run details →German LLM Benchmark · Model Profile
Claude Sonnet 5
Anthropicprovider-internalrun 2026-07-21
1469
Elo
#32
preliminary
Benchmark breakdown
Comparable models
Cost & speed
$4.608per 1,000 questions