German Language LLM Index
a PeerBench project

Individual experiment result

SB10K (DE)

Mistral Large 4 (preview) Mistral

Matthews correlation coefficient reasoning off provider-internal
59.9%
Matthews correlation coefficient

Run details

Date
2026-10-06
Test cases
1,024
Median latency
0.67s
Total cost
$0.47
Avg. prompt tokens
669.3
Avg. answer tokens
2.7
Avg. reasoning tokens
—
Quantization
provider-internal

About this benchmark

Native German Twitter sentiment (positive/neutral/negative), generate_until variant; primary metric MCC.

3-class sentiment native · Native German Source ↗

Provenance

Run ID
2026-10-06T17-21-55__openrouter__mistralai__mistral-large-4-0__sb10k_de