Individual experiment result

MuSR (DE)

Accuracy reasoning on / locked

86.1%

Accuracy

Run details

Date: 2026-08-15
Test cases: 553
Median latency: 10.15s
Total cost: $1.00
Avg. prompt tokens: 1,500
Avg. answer tokens: 511
Avg. reasoning tokens: 426.4
Quantization: Unverified

About this benchmark

German MuSR v1.1 defect-filtered benchmark: 553 questions (11 truncated team-allocation translations excluded), generate_until cot+; primary metric accuracy.

2–5 option multiple choice translated · German translation Source ↗

Subject breakdown

Subject	Score
murder mystery	88.4%
object placements	76.6%
team allocation	86.2%

Provenance

Canonical model: meta/muse-glimmer-30b
Run ID: 2026-08-14T22-26-02__openrouter__meta__muse-glimmer-30b__musr_de

All Muse Glimmer 30B results → ← New results