German LLM Benchmark · Model Profile

Muse Glimmer 30B

Meta unverified run 2026-08-15

86 .0%

avg. German score

Not ranked — needs ≥3 benchmarks (has 2)

+12.5pp above avg.

Benchmark breakdown

INCLUDE

86.0%

Native German exam and licensing questions covering region-specific knowledge — history, law, civics and culture. Written by humans in German, not translated.

4-option multiple choice native · Native German

via CohereLabs/include-base-44 ↗ View run details →

MuSR

86.1%

Multi-step soft reasoning over long narrative contexts — murder mysteries, object placement and team allocation. Requires chaining clues across several paragraphs to reach the correct answer. Translated to German from the original English MuSR benchmark. Public results use the corrected v1.1 evaluation with 553 effective test cases.

2–5 option multiple choice translated · German translation

via TAUR-Lab/MuSR ↗ View run details →

Cost & speed

$1.575 per 1,000 questions

Compare with other models → ← View leaderboard