German Language LLM Index
a PeerBench project

Individual experiment result

GermEval NER (DE)

GPT-5.6 Luna OpenAI

Micro-F1 excluding MISC reasoning off provider-internal
81.9%
Micro-F1 excluding MISC

Run details

Date
2026-08-13
Test cases
1,024
Median latency
0.95s
Total cost
$0.16
Avg. prompt tokens
1,121.7
Avg. answer tokens
29.5
Avg. reasoning tokens
Quantization
provider-internal

About this benchmark

Native German named-entity recognition (person/location/org/misc) emitted as JSON; seqeval micro-F1 excluding MISC.

Named-entity recognition native · Native German Source ↗

Provenance

Canonical model
openai/gpt-5.6-luna
Run ID
2026-08-13T11-04-16__openrouter__openai__gpt-5.6-luna__germeval_de