Claude 3.5 Haiku

claude-3-5-haiku · 4 samples · combined / raw

Scoring

Choose the quality benchmark and final score formula for this model.

Cost adjustment

Tune formulas that account for benchmark cost.

Score over time

16.7 14.7 #1 · 15.7 · 2026-05-11 23:17:33#2 · 15.7 · 2026-05-12 00:00:09#3 · 15.7 · 2026-05-12 01:00:09#4 · 15.7 · 2026-05-12 02:00:11

Cost over time

$57.5 $55.5 #1 · $56.5 · 2026-05-11 23:17:33#2 · $56.5 · 2026-05-12 00:00:09#3 · $56.5 · 2026-05-12 01:00:09#4 · $56.5 · 2026-05-12 02:00:11
Run?Fetched?Score?Quality?Cost?Intel?Code?Agent?MMMU%?
#4 2026-05-12 02:00:11 15.7 15.7 $56.5 18.7 10.7 17.7 45.6
#3 2026-05-12 01:00:09 15.7 15.7 $56.5 18.7 10.7 17.7 45.6
#2 2026-05-12 00:00:09 15.7 15.7 $56.5 18.7 10.7 17.7 45.6
#1 2026-05-11 23:17:33 15.7 15.7 $56.5 18.7 10.7 17.7 45.6