German Language LLM Index
a PeerBench project

German LLM Benchmark · Model Profile

Muse Glimmer 30B

Metaunverifiedrun 2026-08-15
1842

Elo

#7
preliminary

Benchmark breakdown

INCLUDE

86.0%

n=107reasoning

Native German exam and licensing questions covering region-specific knowledge — history, law, civics and culture. Written by humans in German, not translated.

4-option multiple choicenative · Native German
via CohereLabs/include-base-44 ↗ View run details →

MuSR

86.1%

n=553reasoning

Multi-step soft reasoning over long narrative contexts — murder mysteries, object placement and team allocation. Requires chaining clues across several paragraphs to reach the correct answer. Translated to German from the original English MuSR benchmark. Public results use the corrected v1.1 evaluation with 553 effective test cases.

2–5 option multiple choicetranslated · German translation
via TAUR-Lab/MuSR ↗ View run details →

Comparable models

Cost & speed

$1.575per 1,000 questions