German Language LLM Index
a PeerBench project

German LLM Benchmark · Model Profile

NVIDIA Nemotron 3 Ultra 550B-A55B

NVIDIA unverified run 2026-08-15
83 .6%

avg. German score

Not ranked — needs ≥3 benchmarks (has 2)

+10.1pp above avg.

Benchmark breakdown

GermEval

80.3%

Native German named-entity recognition — identify persons, locations, organisations and misc entities in German text, emitted as JSON. Scored with seqeval micro-F1 excluding the noisy MISC class. Run reasoning-off.

Named-entity recognition native · Native German
via GermEval (via EuroEval) ↗ View run details →

INCLUDE

86.9%

Native German exam and licensing questions covering region-specific knowledge — history, law, civics and culture. Written by humans in German, not translated.

4-option multiple choice native · Native German
via CohereLabs/include-base-44 ↗ View run details →