German Language LLM Index
a PeerBench project

Individual experiment result

SB10K (DE)

Qwen3 14B Alibaba

Matthews correlation coefficient reasoning off bf16
56.1%
Matthews correlation coefficient

Run details

Date
2026-06-11
Test cases
1,024
Median latency
13.26s
Total cost
Avg. prompt tokens
899.3
Avg. answer tokens
2.7
Avg. reasoning tokens
Quantization
bf16

About this benchmark

Native German Twitter sentiment (positive/neutral/negative), generate_until variant; primary metric MCC.

3-class sentiment native · Native German Source ↗

Provenance

Canonical model
qwen/qwen3-14b
Run ID
2026-06-11T14-27-27__openai__qwen3-14b-bf16__sb10k_de