German Language LLM Index
a PeerBench project

Individual experiment result

INCLUDE (DE)

MiMo V2.6 Pro Xiaomi

Exact match reasoning off provider-internal
83.2%
Exact match

Run details

Date
2026-10-16
Test cases
107
Median latency
8.44s
Total cost
—
Avg. prompt tokens
130.9
Avg. answer tokens
266.3
Avg. reasoning tokens
—
Quantization
provider-internal

About this benchmark

INCLUDE-DE v1.2: 107 valid German questions after a blinded semantic audit excluded 32 duplicate, wrong-keyed, non-unique, corrupted, or underspecified source rows consistently; strict final-answer parsing; primary metric exact match.

4-option multiple choice native · Native German Source ↗

Provenance

Canonical model
xiaomi/mimo-v2.6-pro
Run ID
2026-10-16T11-24-25__openrouter__xiaomi__mimo-v2.6-pro__include_de