German Language LLM Index
a PeerBench project

Individual experiment result

SB10K (DE)

Qwen3.6 35B-A3B Alibaba

Matthews correlation coefficient reasoning off fp8
58.4%
Matthews correlation coefficient

Run details

Date
2026-06-09
Test cases
1,024
Median latency
0.45s
Total cost
$0.12
Avg. prompt tokens
771.9
Avg. answer tokens
2.7
Avg. reasoning tokens
Quantization
fp8

About this benchmark

Native German Twitter sentiment (positive/neutral/negative), generate_until variant; primary metric MCC.

3-class sentiment native · Native German Source ↗

Provenance

Canonical model
qwen/qwen3.6-35b-a3b
Run ID
2026-06-09T16-50-36__openrouter__qwen__qwen3.6-35b-a3b__sb10k_de