German Language LLM Index
a PeerBench project

Individual experiment result

INCLUDE (DE)

Kimi K2.6 Moonshot

Exact match reasoning off fp8
69.8%
Exact match

Run details

Date
2026-06-08
Test cases
139
Median latency
13.65s
Total cost
$0.58
Avg. prompt tokens
138.7
Avg. answer tokens
527.1
Avg. reasoning tokens
Quantization
fp8

About this benchmark

INCLUDE-DE v1.2: 107 valid German questions after a blinded semantic audit excluded 32 duplicate, wrong-keyed, non-unique, corrupted, or underspecified source rows consistently; strict final-answer parsing; primary metric exact match.

4-option multiple choice native · Native German Source ↗

Provenance

Canonical model
moonshotai/kimi-k2.6
Run ID
2026-06-08T12-01-03__openrouter__moonshotai__kimi-k2.6__include_de