KAT-Coder-Pro V1

kat-coder-pro-v1 · 39 samples · combined / raw

Scoring

Choose the quality benchmark and final score formula for this model.

Cost adjustment

Tune formulas that account for Cost per Task.

Score over time

35.735.936.136.336.506-25 09:0006-27 10:0006-29 11:0007-01 12:0007-03 13:00 Run #731 · Score · X: 2026-06-25 09:00:57 · Y: 36.1Run #734 · Score · X: 2026-06-25 14:01:00 · Y: 36.1Run #736 · Score · X: 2026-06-25 17:00:56 · Y: 36.1Run #738 · Score · X: 2026-06-26 00:00:59 · Y: 36.1Run #739 · Score · X: 2026-06-26 01:00:58 · Y: 36.1Run #741 · Score · X: 2026-06-26 05:00:57 · Y: 36.1Run #740 · Score · X: 2026-06-26 05:00:57 · Y: 36.1Run #745 · Score · X: 2026-06-26 16:01:01 · Y: 36.1Run #746 · Score · X: 2026-06-26 17:01:00 · Y: 36.1Run #749 · Score · X: 2026-06-26 22:00:59 · Y: 36.1Run #750 · Score · X: 2026-06-26 23:00:59 · Y: 36.1Run #754 · Score · X: 2026-06-27 06:00:57 · Y: 36.1Run #753 · Score · X: 2026-06-27 06:00:57 · Y: 36.1Run #758 · Score · X: 2026-06-28 04:00:56 · Y: 36.1Run #757 · Score · X: 2026-06-28 04:00:57 · Y: 36.1Run #760 · Score · X: 2026-06-29 16:00:58 · Y: 36.1Run #762 · Score · X: 2026-06-29 23:00:59 · Y: 36.1Run #764 · Score · X: 2026-06-30 03:00:56 · Y: 36.1Run #766 · Score · X: 2026-06-30 05:00:59 · Y: 36.1Run #768 · Score · X: 2026-06-30 07:00:59 · Y: 36.1Run #769 · Score · X: 2026-06-30 08:01:00 · Y: 36.1Run #770 · Score · X: 2026-06-30 11:01:01 · Y: 36.1Run #772 · Score · X: 2026-06-30 20:00:56 · Y: 36.1Run #771 · Score · X: 2026-06-30 20:00:56 · Y: 36.1Run #776 · Score · X: 2026-07-01 03:00:59 · Y: 36.1Run #777 · Score · X: 2026-07-01 04:01:02 · Y: 36.1Run #780 · Score · X: 2026-07-01 09:01:00 · Y: 36.1Run #781 · Score · X: 2026-07-01 11:01:00 · Y: 36.1Run #784 · Score · X: 2026-07-01 20:01:00 · Y: 36.1Run #785 · Score · X: 2026-07-01 21:01:00 · Y: 36.1Run #788 · Score · X: 2026-07-02 01:01:00 · Y: 36.1Run #789 · Score · X: 2026-07-02 02:00:58 · Y: 36.1Run #792 · Score · X: 2026-07-02 05:00:59 · Y: 36.1Run #793 · Score · X: 2026-07-02 08:00:58 · Y: 36.1Run #796 · Score · X: 2026-07-02 12:00:49 · Y: 36.1Run #797 · Score · X: 2026-07-02 15:00:46 · Y: 36.1Run #801 · Score · X: 2026-07-03 08:00:45 · Y: 36.1Run #803 · Score · X: 2026-07-03 12:00:49 · Y: 36.1Run #804 · Score · X: 2026-07-03 13:00:47 · Y: 36.1

Cost per task over time

$38.5$38.7$38.8$39.0$39.106-25 09:0006-27 10:0006-29 11:0007-01 12:0007-03 13:00 Run #731 · Cost per task · X: 2026-06-25 09:00:57 · Y: $38.5Run #734 · Cost per task · X: 2026-06-25 14:01:00 · Y: $38.5Run #736 · Cost per task · X: 2026-06-25 17:00:56 · Y: $38.5Run #738 · Cost per task · X: 2026-06-26 00:00:59 · Y: $38.5Run #739 · Cost per task · X: 2026-06-26 01:00:58 · Y: $39.1Run #741 · Cost per task · X: 2026-06-26 05:00:57 · Y: $39.1Run #740 · Cost per task · X: 2026-06-26 05:00:57 · Y: $39.1Run #745 · Cost per task · X: 2026-06-26 16:01:01 · Y: $39.1Run #746 · Cost per task · X: 2026-06-26 17:01:00 · Y: $39.1Run #749 · Cost per task · X: 2026-06-26 22:00:59 · Y: $39.1Run #750 · Cost per task · X: 2026-06-26 23:00:59 · Y: $39.1Run #754 · Cost per task · X: 2026-06-27 06:00:57 · Y: $39.1Run #753 · Cost per task · X: 2026-06-27 06:00:57 · Y: $39.1Run #758 · Cost per task · X: 2026-06-28 04:00:56 · Y: $39.1Run #757 · Cost per task · X: 2026-06-28 04:00:57 · Y: $39.1Run #760 · Cost per task · X: 2026-06-29 16:00:58 · Y: $39.1Run #762 · Cost per task · X: 2026-06-29 23:00:59 · Y: $39.1Run #764 · Cost per task · X: 2026-06-30 03:00:56 · Y: $39.1Run #766 · Cost per task · X: 2026-06-30 05:00:59 · Y: $39.1Run #768 · Cost per task · X: 2026-06-30 07:00:59 · Y: $39.1Run #769 · Cost per task · X: 2026-06-30 08:01:00 · Y: $39.1Run #770 · Cost per task · X: 2026-06-30 11:01:01 · Y: $39.1Run #772 · Cost per task · X: 2026-06-30 20:00:56 · Y: $39.1Run #771 · Cost per task · X: 2026-06-30 20:00:56 · Y: $39.1Run #776 · Cost per task · X: 2026-07-01 03:00:59 · Y: $39.1Run #777 · Cost per task · X: 2026-07-01 04:01:02 · Y: $39.1Run #780 · Cost per task · X: 2026-07-01 09:01:00 · Y: $39.1Run #781 · Cost per task · X: 2026-07-01 11:01:00 · Y: $39.1Run #784 · Cost per task · X: 2026-07-01 20:01:00 · Y: $39.1Run #785 · Cost per task · X: 2026-07-01 21:01:00 · Y: $39.1Run #788 · Cost per task · X: 2026-07-02 01:01:00 · Y: $39.1Run #789 · Cost per task · X: 2026-07-02 02:00:58 · Y: $39.1Run #792 · Cost per task · X: 2026-07-02 05:00:59 · Y: $39.1Run #793 · Cost per task · X: 2026-07-02 08:00:58 · Y: $39.1Run #796 · Cost per task · X: 2026-07-02 12:00:49 · Y: $39.1Run #797 · Cost per task · X: 2026-07-02 15:00:46 · Y: $39.1Run #801 · Cost per task · X: 2026-07-03 08:00:45 · Y: $39.1Run #803 · Cost per task · X: 2026-07-03 12:00:49 · Y: $39.1Run #804 · Cost per task · X: 2026-07-03 13:00:47 · Y: $39.1

Time per task over time

No chart data.

Run?Fetched?Score?Quality?Cost/task?Time/task?Intel?Code?Agent?MMMU%?
#804 2026-07-03 13:00:47 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#803 2026-07-03 12:00:49 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#801 2026-07-03 08:00:45 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#797 2026-07-02 15:00:46 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#796 2026-07-02 12:00:49 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#793 2026-07-02 08:00:58 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#792 2026-07-02 05:00:59 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#789 2026-07-02 02:00:58 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#788 2026-07-02 01:01:00 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#785 2026-07-01 21:01:00 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#784 2026-07-01 20:01:00 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#781 2026-07-01 11:01:00 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#780 2026-07-01 09:01:00 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#777 2026-07-01 04:01:02 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#776 2026-07-01 03:00:59 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#771 2026-06-30 20:00:56 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#772 2026-06-30 20:00:56 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#770 2026-06-30 11:01:01 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#769 2026-06-30 08:01:00 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#768 2026-06-30 07:00:59 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#766 2026-06-30 05:00:59 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#764 2026-06-30 03:00:56 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#762 2026-06-29 23:00:59 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#760 2026-06-29 16:00:58 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#757 2026-06-28 04:00:57 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#758 2026-06-28 04:00:56 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#753 2026-06-27 06:00:57 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#754 2026-06-27 06:00:57 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#750 2026-06-26 23:00:59 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#749 2026-06-26 22:00:59 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#746 2026-06-26 17:01:00 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#745 2026-06-26 16:01:01 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#740 2026-06-26 05:00:57 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#741 2026-06-26 05:00:57 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#739 2026-06-26 01:00:58 36.1 36.1 $39.1 - 34.6 58.9 14.9 -
#738 2026-06-26 00:00:59 36.1 36.1 $38.5 - 34.6 58.9 14.9 -
#736 2026-06-25 17:00:56 36.1 36.1 $38.5 - 34.6 58.9 14.9 -
#734 2026-06-25 14:01:00 36.1 36.1 $38.5 - 34.6 58.9 14.9 -
#731 2026-06-25 09:00:57 36.1 36.1 $38.5 - 34.6 58.9 14.9 -