German Language LLM Index
a PeerBench project

Individual experiment result

ScaLA (DE)

MiMo V2.6 Pro Xiaomi

Matthews correlation coefficient reasoning off provider-internal
76.8%
Matthews correlation coefficient

Run details

Date
2026-10-16
Test cases
2,048
Median latency
1.22s
Total cost
$0.0005
Avg. prompt tokens
1,057
Avg. answer tokens
2.5
Avg. reasoning tokens
—
Quantization
provider-internal

About this benchmark

Native German linguistic acceptability — is the sentence grammatical (ja/nein)? generate_until; primary metric MCC (accuracy recorded as secondary).

Binary acceptability native · Native German Source ↗

Provenance

Canonical model
xiaomi/mimo-v2.6-pro
Run ID
2026-10-16T17-44-26__openrouter__xiaomi__mimo-v2.6-pro__scala_de