DeepSeek V4 Pro 0813 (High)

deepseek-v4-pro-high · 53 samples · intelligence / raw

Scoring

Choose the quality benchmark and final score formula for this model.

Cost adjustment

Tune formulas that account for Cost per Task.

Score over time

20.620.720.820.921.011-13 21:0111-14 13:4611-15 06:3111-15 23:1511-16 16:00 Run #3673 · Score · X: 2026-11-13 21:01:02 · Y: 20.8Run #3674 · Score · X: 2026-11-13 22:01:01 · Y: 20.8Run #3675 · Score · X: 2026-11-13 23:01:01 · Y: 20.8Run #3676 · Score · X: 2026-11-14 00:01:01 · Y: 20.8Run #3677 · Score · X: 2026-11-14 01:01:01 · Y: 20.8Run #3678 · Score · X: 2026-11-14 02:01:01 · Y: 20.8Run #3679 · Score · X: 2026-11-14 03:01:01 · Y: 20.8Run #3680 · Score · X: 2026-11-14 04:01:01 · Y: 20.8Run #3681 · Score · X: 2026-11-14 05:01:01 · Y: 20.8Run #3682 · Score · X: 2026-11-14 06:01:01 · Y: 20.8Run #3683 · Score · X: 2026-11-14 07:01:01 · Y: 20.8Run #3684 · Score · X: 2026-11-14 08:01:01 · Y: 20.8Run #3685 · Score · X: 2026-11-14 09:01:01 · Y: 20.8Run #3686 · Score · X: 2026-11-14 10:01:01 · Y: 20.8Run #3687 · Score · X: 2026-11-14 11:01:01 · Y: 20.8Run #3688 · Score · X: 2026-11-14 12:01:02 · Y: 20.8Run #3689 · Score · X: 2026-11-14 13:00:58 · Y: 20.8Run #3690 · Score · X: 2026-11-14 14:00:57 · Y: 20.8Run #3691 · Score · X: 2026-11-14 15:00:58 · Y: 20.8Run #3692 · Score · X: 2026-11-14 16:00:57 · Y: 20.8Run #3693 · Score · X: 2026-11-14 17:00:58 · Y: 20.8Run #3694 · Score · X: 2026-11-14 18:00:58 · Y: 20.8Run #3695 · Score · X: 2026-11-14 19:00:58 · Y: 20.8Run #3696 · Score · X: 2026-11-14 20:00:58 · Y: 20.8Run #3697 · Score · X: 2026-11-14 21:00:58 · Y: 20.8Run #3698 · Score · X: 2026-11-14 22:00:58 · Y: 20.8Run #3699 · Score · X: 2026-11-14 23:00:58 · Y: 20.8Run #3700 · Score · X: 2026-11-15 00:00:57 · Y: 20.8Run #3701 · Score · X: 2026-11-15 01:00:57 · Y: 20.8Run #3702 · Score · X: 2026-11-15 02:00:57 · Y: 20.8Run #3703 · Score · X: 2026-11-15 03:00:57 · Y: 20.8Run #3704 · Score · X: 2026-11-15 04:00:57 · Y: 20.8Run #3705 · Score · X: 2026-11-15 05:00:57 · Y: 20.8Run #3706 · Score · X: 2026-11-15 06:00:56 · Y: 20.8Run #3707 · Score · X: 2026-11-15 07:00:57 · Y: 20.8Run #3708 · Score · X: 2026-11-15 08:00:57 · Y: 20.8Run #3709 · Score · X: 2026-11-15 09:00:57 · Y: 20.8Run #3710 · Score · X: 2026-11-15 10:00:57 · Y: 20.8Run #3711 · Score · X: 2026-11-15 11:00:58 · Y: 20.8Run #3712 · Score · X: 2026-11-15 12:00:57 · Y: 20.8Run #3713 · Score · X: 2026-11-15 13:00:57 · Y: 20.8Run #3714 · Score · X: 2026-11-15 14:00:57 · Y: 20.8Run #3715 · Score · X: 2026-11-15 15:00:57 · Y: 20.8Run #3716 · Score · X: 2026-11-15 16:00:57 · Y: 20.8Run #3717 · Score · X: 2026-11-15 17:00:58 · Y: 20.8Run #3718 · Score · X: 2026-11-15 18:00:57 · Y: 20.8Run #3719 · Score · X: 2026-11-16 10:00:58 · Y: 20.8Run #3720 · Score · X: 2026-11-16 11:00:58 · Y: 20.8Run #3721 · Score · X: 2026-11-16 12:00:58 · Y: 20.8Run #3722 · Score · X: 2026-11-16 13:00:59 · Y: 20.8Run #3723 · Score · X: 2026-11-16 14:00:58 · Y: 20.8Run #3724 · Score · X: 2026-11-16 15:00:57 · Y: 20.8Run #3725 · Score · X: 2026-11-16 16:00:58 · Y: 20.8

Cost per task over time

$0.839$0.844$0.849$0.854$0.85911-13 21:0111-14 13:4611-15 06:3111-15 23:1511-16 16:00 Run #3673 · Cost per task · X: 2026-11-13 21:01:02 · Y: $0.849Run #3674 · Cost per task · X: 2026-11-13 22:01:01 · Y: $0.849Run #3675 · Cost per task · X: 2026-11-13 23:01:01 · Y: $0.849Run #3676 · Cost per task · X: 2026-11-14 00:01:01 · Y: $0.849Run #3677 · Cost per task · X: 2026-11-14 01:01:01 · Y: $0.849Run #3678 · Cost per task · X: 2026-11-14 02:01:01 · Y: $0.849Run #3679 · Cost per task · X: 2026-11-14 03:01:01 · Y: $0.849Run #3680 · Cost per task · X: 2026-11-14 04:01:01 · Y: $0.849Run #3681 · Cost per task · X: 2026-11-14 05:01:01 · Y: $0.849Run #3682 · Cost per task · X: 2026-11-14 06:01:01 · Y: $0.849Run #3683 · Cost per task · X: 2026-11-14 07:01:01 · Y: $0.849Run #3684 · Cost per task · X: 2026-11-14 08:01:01 · Y: $0.849Run #3685 · Cost per task · X: 2026-11-14 09:01:01 · Y: $0.849Run #3686 · Cost per task · X: 2026-11-14 10:01:01 · Y: $0.849Run #3687 · Cost per task · X: 2026-11-14 11:01:01 · Y: $0.849Run #3688 · Cost per task · X: 2026-11-14 12:01:02 · Y: $0.849Run #3689 · Cost per task · X: 2026-11-14 13:00:58 · Y: $0.849Run #3690 · Cost per task · X: 2026-11-14 14:00:57 · Y: $0.849Run #3691 · Cost per task · X: 2026-11-14 15:00:58 · Y: $0.849Run #3692 · Cost per task · X: 2026-11-14 16:00:57 · Y: $0.849Run #3693 · Cost per task · X: 2026-11-14 17:00:58 · Y: $0.849Run #3694 · Cost per task · X: 2026-11-14 18:00:58 · Y: $0.849Run #3695 · Cost per task · X: 2026-11-14 19:00:58 · Y: $0.849Run #3696 · Cost per task · X: 2026-11-14 20:00:58 · Y: $0.849Run #3697 · Cost per task · X: 2026-11-14 21:00:58 · Y: $0.849Run #3698 · Cost per task · X: 2026-11-14 22:00:58 · Y: $0.849Run #3699 · Cost per task · X: 2026-11-14 23:00:58 · Y: $0.849Run #3700 · Cost per task · X: 2026-11-15 00:00:57 · Y: $0.849Run #3701 · Cost per task · X: 2026-11-15 01:00:57 · Y: $0.849Run #3702 · Cost per task · X: 2026-11-15 02:00:57 · Y: $0.849Run #3703 · Cost per task · X: 2026-11-15 03:00:57 · Y: $0.849Run #3704 · Cost per task · X: 2026-11-15 04:00:57 · Y: $0.849Run #3705 · Cost per task · X: 2026-11-15 05:00:57 · Y: $0.849Run #3706 · Cost per task · X: 2026-11-15 06:00:56 · Y: $0.849Run #3707 · Cost per task · X: 2026-11-15 07:00:57 · Y: $0.849Run #3708 · Cost per task · X: 2026-11-15 08:00:57 · Y: $0.849Run #3709 · Cost per task · X: 2026-11-15 09:00:57 · Y: $0.849Run #3710 · Cost per task · X: 2026-11-15 10:00:57 · Y: $0.849Run #3711 · Cost per task · X: 2026-11-15 11:00:58 · Y: $0.849Run #3712 · Cost per task · X: 2026-11-15 12:00:57 · Y: $0.849Run #3713 · Cost per task · X: 2026-11-15 13:00:57 · Y: $0.849Run #3714 · Cost per task · X: 2026-11-15 14:00:57 · Y: $0.849Run #3715 · Cost per task · X: 2026-11-15 15:00:57 · Y: $0.849Run #3716 · Cost per task · X: 2026-11-15 16:00:57 · Y: $0.849Run #3717 · Cost per task · X: 2026-11-15 17:00:58 · Y: $0.849Run #3718 · Cost per task · X: 2026-11-15 18:00:57 · Y: $0.849Run #3719 · Cost per task · X: 2026-11-16 10:00:58 · Y: $0.849Run #3720 · Cost per task · X: 2026-11-16 11:00:58 · Y: $0.849Run #3721 · Cost per task · X: 2026-11-16 12:00:58 · Y: $0.849Run #3722 · Cost per task · X: 2026-11-16 13:00:59 · Y: $0.849Run #3723 · Cost per task · X: 2026-11-16 14:00:58 · Y: $0.849Run #3724 · Cost per task · X: 2026-11-16 15:00:57 · Y: $0.849Run #3725 · Cost per task · X: 2026-11-16 16:00:58 · Y: $0.849

Time per task over time

14.6m14.8m15.1m15.4m15.6m11-13 21:0111-14 13:4611-15 06:3111-15 23:1511-16 16:00 Run #3674 · Time per task · X: 2026-11-13 22:01:01 · Y: 15.6mRun #3675 · Time per task · X: 2026-11-13 23:01:01 · Y: 15.6mRun #3676 · Time per task · X: 2026-11-14 00:01:01 · Y: 15.6mRun #3677 · Time per task · X: 2026-11-14 01:01:01 · Y: 15.6mRun #3678 · Time per task · X: 2026-11-14 02:01:01 · Y: 15.4mRun #3679 · Time per task · X: 2026-11-14 03:01:01 · Y: 15.4mRun #3680 · Time per task · X: 2026-11-14 04:01:01 · Y: 15.4mRun #3681 · Time per task · X: 2026-11-14 05:01:01 · Y: 15.4mRun #3682 · Time per task · X: 2026-11-14 06:01:01 · Y: 15.4mRun #3683 · Time per task · X: 2026-11-14 07:01:01 · Y: 15.4mRun #3684 · Time per task · X: 2026-11-14 08:01:01 · Y: 15.4mRun #3685 · Time per task · X: 2026-11-14 09:01:01 · Y: 15.4mRun #3686 · Time per task · X: 2026-11-14 10:01:01 · Y: 15.4mRun #3687 · Time per task · X: 2026-11-14 11:01:01 · Y: 15.4mRun #3688 · Time per task · X: 2026-11-14 12:01:02 · Y: 15.4mRun #3689 · Time per task · X: 2026-11-14 13:00:58 · Y: 15.4mRun #3690 · Time per task · X: 2026-11-14 14:00:57 · Y: 15.4mRun #3691 · Time per task · X: 2026-11-14 15:00:58 · Y: 15.4mRun #3692 · Time per task · X: 2026-11-14 16:00:57 · Y: 15.4mRun #3693 · Time per task · X: 2026-11-14 17:00:58 · Y: 15.4mRun #3694 · Time per task · X: 2026-11-14 18:00:58 · Y: 15.4mRun #3695 · Time per task · X: 2026-11-14 19:00:58 · Y: 15.4mRun #3696 · Time per task · X: 2026-11-14 20:00:58 · Y: 15.4mRun #3697 · Time per task · X: 2026-11-14 21:00:58 · Y: 15.4mRun #3698 · Time per task · X: 2026-11-14 22:00:58 · Y: 15.4mRun #3699 · Time per task · X: 2026-11-14 23:00:58 · Y: 15.4mRun #3700 · Time per task · X: 2026-11-15 00:00:57 · Y: 15.4mRun #3701 · Time per task · X: 2026-11-15 01:00:57 · Y: 15.4mRun #3702 · Time per task · X: 2026-11-15 02:00:57 · Y: 15.4mRun #3703 · Time per task · X: 2026-11-15 03:00:57 · Y: 15.4mRun #3704 · Time per task · X: 2026-11-15 04:00:57 · Y: 15.1mRun #3705 · Time per task · X: 2026-11-15 05:00:57 · Y: 15.1mRun #3706 · Time per task · X: 2026-11-15 06:00:56 · Y: 15.1mRun #3707 · Time per task · X: 2026-11-15 07:00:57 · Y: 15.1mRun #3708 · Time per task · X: 2026-11-15 08:00:57 · Y: 15.1mRun #3709 · Time per task · X: 2026-11-15 09:00:57 · Y: 15.1mRun #3710 · Time per task · X: 2026-11-15 10:00:57 · Y: 15.1mRun #3711 · Time per task · X: 2026-11-15 11:00:58 · Y: 15.1mRun #3712 · Time per task · X: 2026-11-15 12:00:57 · Y: 15.1mRun #3713 · Time per task · X: 2026-11-15 13:00:57 · Y: 15.1mRun #3714 · Time per task · X: 2026-11-15 14:00:57 · Y: 15.1mRun #3715 · Time per task · X: 2026-11-15 15:00:57 · Y: 15.1mRun #3716 · Time per task · X: 2026-11-15 16:00:57 · Y: 15.1mRun #3717 · Time per task · X: 2026-11-15 17:00:58 · Y: 15.1mRun #3718 · Time per task · X: 2026-11-15 18:00:57 · Y: 15.1mRun #3719 · Time per task · X: 2026-11-16 10:00:58 · Y: 14.6mRun #3720 · Time per task · X: 2026-11-16 11:00:58 · Y: 14.6mRun #3721 · Time per task · X: 2026-11-16 12:00:58 · Y: 14.6mRun #3722 · Time per task · X: 2026-11-16 13:00:59 · Y: 14.6mRun #3723 · Time per task · X: 2026-11-16 14:00:58 · Y: 14.6mRun #3724 · Time per task · X: 2026-11-16 15:00:57 · Y: 14.6mRun #3725 · Time per task · X: 2026-11-16 16:00:58 · Y: 14.6m
Run?Fetched?Score?Quality?Cost/task?Time/task?Intel?Agent?MMMU%?
#3725 2026-11-16 16:00:58 20.8 20.8 $0.849 14.6m 20.8 - -
#3724 2026-11-16 15:00:57 20.8 20.8 $0.849 14.6m 20.8 - -
#3723 2026-11-16 14:00:58 20.8 20.8 $0.849 14.6m 20.8 - -
#3722 2026-11-16 13:00:59 20.8 20.8 $0.849 14.6m 20.8 - -
#3721 2026-11-16 12:00:58 20.8 20.8 $0.849 14.6m 20.8 - -
#3720 2026-11-16 11:00:58 20.8 20.8 $0.849 14.6m 20.8 - -
#3719 2026-11-16 10:00:58 20.8 20.8 $0.849 14.6m 20.8 - -
#3718 2026-11-15 18:00:57 20.8 20.8 $0.849 15.1m 20.8 - -
#3717 2026-11-15 17:00:58 20.8 20.8 $0.849 15.1m 20.8 - -
#3716 2026-11-15 16:00:57 20.8 20.8 $0.849 15.1m 20.8 - -
#3715 2026-11-15 15:00:57 20.8 20.8 $0.849 15.1m 20.8 - -
#3714 2026-11-15 14:00:57 20.8 20.8 $0.849 15.1m 20.8 - -
#3713 2026-11-15 13:00:57 20.8 20.8 $0.849 15.1m 20.8 - -
#3712 2026-11-15 12:00:57 20.8 20.8 $0.849 15.1m 20.8 - -
#3711 2026-11-15 11:00:58 20.8 20.8 $0.849 15.1m 20.8 - -
#3710 2026-11-15 10:00:57 20.8 20.8 $0.849 15.1m 20.8 - -
#3709 2026-11-15 09:00:57 20.8 20.8 $0.849 15.1m 20.8 - -
#3708 2026-11-15 08:00:57 20.8 20.8 $0.849 15.1m 20.8 - -
#3707 2026-11-15 07:00:57 20.8 20.8 $0.849 15.1m 20.8 - -
#3706 2026-11-15 06:00:56 20.8 20.8 $0.849 15.1m 20.8 - -
#3705 2026-11-15 05:00:57 20.8 20.8 $0.849 15.1m 20.8 - -
#3704 2026-11-15 04:00:57 20.8 20.8 $0.849 15.1m 20.8 - -
#3703 2026-11-15 03:00:57 20.8 20.8 $0.849 15.4m 20.8 - -
#3702 2026-11-15 02:00:57 20.8 20.8 $0.849 15.4m 20.8 - -
#3701 2026-11-15 01:00:57 20.8 20.8 $0.849 15.4m 20.8 - -
#3700 2026-11-15 00:00:57 20.8 20.8 $0.849 15.4m 20.8 - -
#3699 2026-11-14 23:00:58 20.8 20.8 $0.849 15.4m 20.8 - -
#3698 2026-11-14 22:00:58 20.8 20.8 $0.849 15.4m 20.8 - -
#3697 2026-11-14 21:00:58 20.8 20.8 $0.849 15.4m 20.8 - -
#3696 2026-11-14 20:00:58 20.8 20.8 $0.849 15.4m 20.8 - -
#3695 2026-11-14 19:00:58 20.8 20.8 $0.849 15.4m 20.8 - -
#3694 2026-11-14 18:00:58 20.8 20.8 $0.849 15.4m 20.8 - -
#3693 2026-11-14 17:00:58 20.8 20.8 $0.849 15.4m 20.8 - -
#3692 2026-11-14 16:00:57 20.8 20.8 $0.849 15.4m 20.8 - -
#3691 2026-11-14 15:00:58 20.8 20.8 $0.849 15.4m 20.8 - -
#3690 2026-11-14 14:00:57 20.8 20.8 $0.849 15.4m 20.8 - -
#3689 2026-11-14 13:00:58 20.8 20.8 $0.849 15.4m 20.8 - -
#3688 2026-11-14 12:01:02 20.8 20.8 $0.849 15.4m 20.8 - -
#3687 2026-11-14 11:01:01 20.8 20.8 $0.849 15.4m 20.8 - -
#3686 2026-11-14 10:01:01 20.8 20.8 $0.849 15.4m 20.8 - -
#3685 2026-11-14 09:01:01 20.8 20.8 $0.849 15.4m 20.8 - -
#3684 2026-11-14 08:01:01 20.8 20.8 $0.849 15.4m 20.8 - -
#3683 2026-11-14 07:01:01 20.8 20.8 $0.849 15.4m 20.8 - -
#3682 2026-11-14 06:01:01 20.8 20.8 $0.849 15.4m 20.8 - -
#3681 2026-11-14 05:01:01 20.8 20.8 $0.849 15.4m 20.8 - -
#3680 2026-11-14 04:01:01 20.8 20.8 $0.849 15.4m 20.8 - -
#3679 2026-11-14 03:01:01 20.8 20.8 $0.849 15.4m 20.8 - -
#3678 2026-11-14 02:01:01 20.8 20.8 $0.849 15.4m 20.8 - -
#3677 2026-11-14 01:01:01 20.8 20.8 $0.849 15.6m 20.8 - -
#3676 2026-11-14 00:01:01 20.8 20.8 $0.849 15.6m 20.8 - -
#3675 2026-11-13 23:01:01 20.8 20.8 $0.849 15.6m 20.8 - -
#3674 2026-11-13 22:01:01 20.8 20.8 $0.849 15.6m 20.8 - -
#3673 2026-11-13 21:01:02 20.8 20.8 $0.849 - 20.8 - -