German Language LLM Index
a PeerBench project

Individual experiment result

GermEval NER (DE)

Gemini 4 Argon Google

Micro-F1 excluding MISC reasoning off provider-internal
86.7%
Micro-F1 excluding MISC

Run details

Date
2026-10-13
Test cases
1,024
Median latency
1.73s
Total cost
$2.68
Avg. prompt tokens
1,170.1
Avg. answer tokens
27.8
Avg. reasoning tokens
—
Quantization
provider-internal

About this benchmark

Native German named-entity recognition (person/location/org/misc) emitted as JSON; seqeval micro-F1 excluding MISC.

Named-entity recognition native · Native German Source ↗

Provenance

Canonical model
google/gemini-4-argon
Run ID
2026-10-13T19-10-53__vertex_ai__gemini-4-argon__germeval_de