Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)

llama-3-1-nemotron-ultra-253b-v1-reasoning · 4 samples · combined / raw

Scoring

Choose the quality benchmark and final score formula for this model.

Cost adjustment

Tune formulas that account for benchmark cost.

Score over time

11.6 9.6 #1 · 10.6 · 2026-05-11 23:17:33#2 · 10.6 · 2026-05-12 00:00:09#3 · 10.6 · 2026-05-12 01:00:09#4 · 10.6 · 2026-05-12 02:00:11

Cost over time

$488 $486 #1 · $487 · 2026-05-11 23:17:33#2 · $487 · 2026-05-12 00:00:09#3 · $487 · 2026-05-12 01:00:09#4 · $487 · 2026-05-12 02:00:11
Run?Fetched?Score?Quality?Cost?Intel?Code?Agent?MMMU%?
#4 2026-05-12 02:00:11 10.6 10.6 $487 15.0 13.1 3.8 -
#3 2026-05-12 01:00:09 10.6 10.6 $487 15.0 13.1 3.8 -
#2 2026-05-12 00:00:09 10.6 10.6 $487 15.0 13.1 3.8 -
#1 2026-05-11 23:17:33 10.6 10.6 $487 15.0 13.1 3.8 -