Gemini 4 Carbon (Medium)

gemini-4-carbon-medium · 66 samples · intelligence / raw

Scoring

Choose the quality benchmark and final score formula for this model.

Cost adjustment

Tune formulas that account for Cost per Task.

Score over time

57.757.958.058.158.311-02 08:0011-03 00:1511-03 16:3011-04 08:4511-05 01:00 Run #3396 · Score · X: 2026-11-02 08:00:14 · Y: 57.7Run #3397 · Score · X: 2026-11-02 09:00:14 · Y: 57.7Run #3398 · Score · X: 2026-11-02 10:00:14 · Y: 57.7Run #3399 · Score · X: 2026-11-02 11:00:14 · Y: 57.7Run #3400 · Score · X: 2026-11-02 12:00:14 · Y: 57.7Run #3401 · Score · X: 2026-11-02 13:00:14 · Y: 57.7Run #3402 · Score · X: 2026-11-02 14:00:14 · Y: 57.7Run #3403 · Score · X: 2026-11-02 15:00:14 · Y: 57.7Run #3404 · Score · X: 2026-11-02 16:00:15 · Y: 57.7Run #3405 · Score · X: 2026-11-02 17:00:14 · Y: 57.7Run #3406 · Score · X: 2026-11-02 18:00:14 · Y: 57.7Run #3407 · Score · X: 2026-11-02 19:00:14 · Y: 57.7Run #3408 · Score · X: 2026-11-02 20:00:14 · Y: 57.7Run #3409 · Score · X: 2026-11-02 21:00:14 · Y: 57.7Run #3410 · Score · X: 2026-11-02 22:00:14 · Y: 57.7Run #3411 · Score · X: 2026-11-02 23:00:14 · Y: 57.7Run #3412 · Score · X: 2026-11-03 00:00:14 · Y: 57.7Run #3413 · Score · X: 2026-11-03 01:00:14 · Y: 57.7Run #3414 · Score · X: 2026-11-03 02:00:14 · Y: 57.7Run #3415 · Score · X: 2026-11-03 03:00:14 · Y: 57.7Run #3416 · Score · X: 2026-11-03 04:00:14 · Y: 57.7Run #3417 · Score · X: 2026-11-03 05:00:14 · Y: 57.7Run #3418 · Score · X: 2026-11-03 06:00:14 · Y: 57.7Run #3419 · Score · X: 2026-11-03 07:00:14 · Y: 57.7Run #3420 · Score · X: 2026-11-03 08:00:14 · Y: 57.7Run #3421 · Score · X: 2026-11-03 09:00:14 · Y: 57.7Run #3422 · Score · X: 2026-11-03 10:00:14 · Y: 57.7Run #3423 · Score · X: 2026-11-03 11:00:14 · Y: 57.7Run #3424 · Score · X: 2026-11-03 12:00:14 · Y: 57.7Run #3425 · Score · X: 2026-11-03 13:00:14 · Y: 57.7Run #3426 · Score · X: 2026-11-03 14:00:14 · Y: 57.7Run #3427 · Score · X: 2026-11-03 15:00:59 · Y: 57.7Run #3428 · Score · X: 2026-11-03 16:01:01 · Y: 57.7Run #3429 · Score · X: 2026-11-03 17:00:58 · Y: 57.7Run #3430 · Score · X: 2026-11-03 18:00:55 · Y: 57.7Run #3431 · Score · X: 2026-11-03 19:00:54 · Y: 57.7Run #3432 · Score · X: 2026-11-03 20:00:53 · Y: 57.7Run #3433 · Score · X: 2026-11-03 21:00:54 · Y: 57.7Run #3434 · Score · X: 2026-11-03 22:00:53 · Y: 58.3Run #3435 · Score · X: 2026-11-03 23:00:53 · Y: 58.3Run #3436 · Score · X: 2026-11-04 00:00:53 · Y: 58.3Run #3437 · Score · X: 2026-11-04 01:00:53 · Y: 58.3Run #3438 · Score · X: 2026-11-04 02:00:53 · Y: 58.3Run #3439 · Score · X: 2026-11-04 03:00:54 · Y: 58.3Run #3440 · Score · X: 2026-11-04 04:00:53 · Y: 58.3Run #3441 · Score · X: 2026-11-04 05:00:53 · Y: 58.3Run #3442 · Score · X: 2026-11-04 06:00:53 · Y: 58.3Run #3443 · Score · X: 2026-11-04 07:00:54 · Y: 58.3Run #3444 · Score · X: 2026-11-04 08:00:55 · Y: 58.3Run #3445 · Score · X: 2026-11-04 09:00:53 · Y: 58.3Run #3446 · Score · X: 2026-11-04 10:00:54 · Y: 58.3Run #3447 · Score · X: 2026-11-04 11:00:53 · Y: 58.3Run #3448 · Score · X: 2026-11-04 12:00:56 · Y: 58.3Run #3449 · Score · X: 2026-11-04 13:00:56 · Y: 58.3Run #3450 · Score · X: 2026-11-04 14:00:58 · Y: 58.3Run #3451 · Score · X: 2026-11-04 15:00:57 · Y: 58.3Run #3452 · Score · X: 2026-11-04 16:00:56 · Y: 58.3Run #3453 · Score · X: 2026-11-04 17:00:56 · Y: 58.3Run #3454 · Score · X: 2026-11-04 18:00:58 · Y: 58.3Run #3455 · Score · X: 2026-11-04 19:00:53 · Y: 58.3Run #3456 · Score · X: 2026-11-04 20:00:53 · Y: 58.3Run #3457 · Score · X: 2026-11-04 21:00:54 · Y: 58.3Run #3458 · Score · X: 2026-11-04 22:00:54 · Y: 58.3Run #3459 · Score · X: 2026-11-04 23:00:53 · Y: 58.3Run #3460 · Score · X: 2026-11-05 00:00:53 · Y: 58.3Run #3461 · Score · X: 2026-11-05 01:00:54 · Y: 58.3

Cost per task over time

$6.52$6.55$6.59$6.62$6.6511-02 08:0011-03 00:1511-03 16:3011-04 08:4511-05 01:00 Run #3396 · Cost per task · X: 2026-11-02 08:00:14 · Y: $6.59Run #3397 · Cost per task · X: 2026-11-02 09:00:14 · Y: $6.59Run #3398 · Cost per task · X: 2026-11-02 10:00:14 · Y: $6.59Run #3399 · Cost per task · X: 2026-11-02 11:00:14 · Y: $6.59Run #3400 · Cost per task · X: 2026-11-02 12:00:14 · Y: $6.59Run #3401 · Cost per task · X: 2026-11-02 13:00:14 · Y: $6.59Run #3402 · Cost per task · X: 2026-11-02 14:00:14 · Y: $6.59Run #3403 · Cost per task · X: 2026-11-02 15:00:14 · Y: $6.59Run #3404 · Cost per task · X: 2026-11-02 16:00:15 · Y: $6.59Run #3405 · Cost per task · X: 2026-11-02 17:00:14 · Y: $6.59Run #3406 · Cost per task · X: 2026-11-02 18:00:14 · Y: $6.59Run #3407 · Cost per task · X: 2026-11-02 19:00:14 · Y: $6.59Run #3408 · Cost per task · X: 2026-11-02 20:00:14 · Y: $6.59Run #3409 · Cost per task · X: 2026-11-02 21:00:14 · Y: $6.59Run #3410 · Cost per task · X: 2026-11-02 22:00:14 · Y: $6.59Run #3411 · Cost per task · X: 2026-11-02 23:00:14 · Y: $6.59Run #3412 · Cost per task · X: 2026-11-03 00:00:14 · Y: $6.59Run #3413 · Cost per task · X: 2026-11-03 01:00:14 · Y: $6.59Run #3414 · Cost per task · X: 2026-11-03 02:00:14 · Y: $6.59Run #3415 · Cost per task · X: 2026-11-03 03:00:14 · Y: $6.59Run #3416 · Cost per task · X: 2026-11-03 04:00:14 · Y: $6.59Run #3417 · Cost per task · X: 2026-11-03 05:00:14 · Y: $6.59Run #3418 · Cost per task · X: 2026-11-03 06:00:14 · Y: $6.59Run #3419 · Cost per task · X: 2026-11-03 07:00:14 · Y: $6.59Run #3420 · Cost per task · X: 2026-11-03 08:00:14 · Y: $6.59Run #3421 · Cost per task · X: 2026-11-03 09:00:14 · Y: $6.59Run #3422 · Cost per task · X: 2026-11-03 10:00:14 · Y: $6.59Run #3423 · Cost per task · X: 2026-11-03 11:00:14 · Y: $6.59Run #3424 · Cost per task · X: 2026-11-03 12:00:14 · Y: $6.59Run #3425 · Cost per task · X: 2026-11-03 13:00:14 · Y: $6.59Run #3426 · Cost per task · X: 2026-11-03 14:00:14 · Y: $6.59Run #3427 · Cost per task · X: 2026-11-03 15:00:59 · Y: $6.59Run #3428 · Cost per task · X: 2026-11-03 16:01:01 · Y: $6.59Run #3429 · Cost per task · X: 2026-11-03 17:00:58 · Y: $6.59Run #3430 · Cost per task · X: 2026-11-03 18:00:55 · Y: $6.59Run #3431 · Cost per task · X: 2026-11-03 19:00:54 · Y: $6.59Run #3432 · Cost per task · X: 2026-11-03 20:00:53 · Y: $6.59Run #3433 · Cost per task · X: 2026-11-03 21:00:54 · Y: $6.59Run #3434 · Cost per task · X: 2026-11-03 22:00:53 · Y: $6.59Run #3435 · Cost per task · X: 2026-11-03 23:00:53 · Y: $6.59Run #3436 · Cost per task · X: 2026-11-04 00:00:53 · Y: $6.59Run #3437 · Cost per task · X: 2026-11-04 01:00:53 · Y: $6.59Run #3438 · Cost per task · X: 2026-11-04 02:00:53 · Y: $6.59Run #3439 · Cost per task · X: 2026-11-04 03:00:54 · Y: $6.59Run #3440 · Cost per task · X: 2026-11-04 04:00:53 · Y: $6.59Run #3441 · Cost per task · X: 2026-11-04 05:00:53 · Y: $6.59Run #3442 · Cost per task · X: 2026-11-04 06:00:53 · Y: $6.59Run #3443 · Cost per task · X: 2026-11-04 07:00:54 · Y: $6.59Run #3444 · Cost per task · X: 2026-11-04 08:00:55 · Y: $6.59Run #3445 · Cost per task · X: 2026-11-04 09:00:53 · Y: $6.59Run #3446 · Cost per task · X: 2026-11-04 10:00:54 · Y: $6.59Run #3447 · Cost per task · X: 2026-11-04 11:00:53 · Y: $6.59Run #3448 · Cost per task · X: 2026-11-04 12:00:56 · Y: $6.59Run #3449 · Cost per task · X: 2026-11-04 13:00:56 · Y: $6.59Run #3450 · Cost per task · X: 2026-11-04 14:00:58 · Y: $6.59Run #3451 · Cost per task · X: 2026-11-04 15:00:57 · Y: $6.59Run #3452 · Cost per task · X: 2026-11-04 16:00:56 · Y: $6.59Run #3453 · Cost per task · X: 2026-11-04 17:00:56 · Y: $6.59Run #3454 · Cost per task · X: 2026-11-04 18:00:58 · Y: $6.59Run #3455 · Cost per task · X: 2026-11-04 19:00:53 · Y: $6.59Run #3456 · Cost per task · X: 2026-11-04 20:00:53 · Y: $6.59Run #3457 · Cost per task · X: 2026-11-04 21:00:54 · Y: $6.59Run #3458 · Cost per task · X: 2026-11-04 22:00:54 · Y: $6.59Run #3459 · Cost per task · X: 2026-11-04 23:00:53 · Y: $6.59Run #3460 · Cost per task · X: 2026-11-05 00:00:53 · Y: $6.59Run #3461 · Cost per task · X: 2026-11-05 01:00:54 · Y: $6.59

Time per task over time

16.8m19.9m23.0m26.1m29.2m11-02 08:0011-03 00:1511-03 16:3011-04 08:4511-05 01:00 Run #3417 · Time per task · X: 2026-11-03 05:00:14 · Y: 29.2mRun #3418 · Time per task · X: 2026-11-03 06:00:14 · Y: 29.2mRun #3419 · Time per task · X: 2026-11-03 07:00:14 · Y: 20.1mRun #3420 · Time per task · X: 2026-11-03 08:00:14 · Y: 20.1mRun #3421 · Time per task · X: 2026-11-03 09:00:14 · Y: 20.1mRun #3422 · Time per task · X: 2026-11-03 10:00:14 · Y: 16.8mRun #3423 · Time per task · X: 2026-11-03 11:00:14 · Y: 16.8mRun #3424 · Time per task · X: 2026-11-03 12:00:14 · Y: 16.8mRun #3425 · Time per task · X: 2026-11-03 13:00:14 · Y: 16.8mRun #3426 · Time per task · X: 2026-11-03 14:00:14 · Y: 16.8mRun #3427 · Time per task · X: 2026-11-03 15:00:59 · Y: 16.8mRun #3428 · Time per task · X: 2026-11-03 16:01:01 · Y: 16.8mRun #3429 · Time per task · X: 2026-11-03 17:00:58 · Y: 16.8mRun #3430 · Time per task · X: 2026-11-03 18:00:55 · Y: 16.8mRun #3431 · Time per task · X: 2026-11-03 19:00:54 · Y: 16.8mRun #3432 · Time per task · X: 2026-11-03 20:00:53 · Y: 18.7mRun #3433 · Time per task · X: 2026-11-03 21:00:54 · Y: 18.7mRun #3434 · Time per task · X: 2026-11-03 22:00:53 · Y: 20.2mRun #3435 · Time per task · X: 2026-11-03 23:00:53 · Y: 20.2mRun #3436 · Time per task · X: 2026-11-04 00:00:53 · Y: 20.2mRun #3437 · Time per task · X: 2026-11-04 01:00:53 · Y: 18.7mRun #3438 · Time per task · X: 2026-11-04 02:00:53 · Y: 18.7mRun #3439 · Time per task · X: 2026-11-04 03:00:54 · Y: 18.7mRun #3440 · Time per task · X: 2026-11-04 04:00:53 · Y: 18.7mRun #3441 · Time per task · X: 2026-11-04 05:00:53 · Y: 18.7mRun #3442 · Time per task · X: 2026-11-04 06:00:53 · Y: 17.4mRun #3443 · Time per task · X: 2026-11-04 07:00:54 · Y: 17.4mRun #3444 · Time per task · X: 2026-11-04 08:00:55 · Y: 24.5mRun #3445 · Time per task · X: 2026-11-04 09:00:53 · Y: 24.5mRun #3446 · Time per task · X: 2026-11-04 10:00:54 · Y: 24.5mRun #3447 · Time per task · X: 2026-11-04 11:00:53 · Y: 24.5mRun #3448 · Time per task · X: 2026-11-04 12:00:56 · Y: 25.9mRun #3449 · Time per task · X: 2026-11-04 13:00:56 · Y: 25.9mRun #3450 · Time per task · X: 2026-11-04 14:00:58 · Y: 25.9mRun #3451 · Time per task · X: 2026-11-04 15:00:57 · Y: 25.9mRun #3452 · Time per task · X: 2026-11-04 16:00:56 · Y: 25.9mRun #3453 · Time per task · X: 2026-11-04 17:00:56 · Y: 25.9mRun #3454 · Time per task · X: 2026-11-04 18:00:58 · Y: 22.5mRun #3455 · Time per task · X: 2026-11-04 19:00:53 · Y: 22.5mRun #3456 · Time per task · X: 2026-11-04 20:00:53 · Y: 22.5mRun #3457 · Time per task · X: 2026-11-04 21:00:54 · Y: 22.5mRun #3458 · Time per task · X: 2026-11-04 22:00:54 · Y: 22.1mRun #3459 · Time per task · X: 2026-11-04 23:00:53 · Y: 22.1mRun #3460 · Time per task · X: 2026-11-05 00:00:53 · Y: 22.1mRun #3461 · Time per task · X: 2026-11-05 01:00:54 · Y: 22.1m
Run?Fetched?Score?Quality?Cost/task?Time/task?Intel?Agent?MMMU%?
#3461 2026-11-05 01:00:54 58.3 58.3 $6.59 22.1m 58.3 - 89.2
#3460 2026-11-05 00:00:53 58.3 58.3 $6.59 22.1m 58.3 - 89.2
#3459 2026-11-04 23:00:53 58.3 58.3 $6.59 22.1m 58.3 - 89.2
#3458 2026-11-04 22:00:54 58.3 58.3 $6.59 22.1m 58.3 - 89.2
#3457 2026-11-04 21:00:54 58.3 58.3 $6.59 22.5m 58.3 - 89.2
#3456 2026-11-04 20:00:53 58.3 58.3 $6.59 22.5m 58.3 - 89.2
#3455 2026-11-04 19:00:53 58.3 58.3 $6.59 22.5m 58.3 - 89.2
#3454 2026-11-04 18:00:58 58.3 58.3 $6.59 22.5m 58.3 - 89.2
#3453 2026-11-04 17:00:56 58.3 58.3 $6.59 25.9m 58.3 - 89.2
#3452 2026-11-04 16:00:56 58.3 58.3 $6.59 25.9m 58.3 - 89.2
#3451 2026-11-04 15:00:57 58.3 58.3 $6.59 25.9m 58.3 - 89.2
#3450 2026-11-04 14:00:58 58.3 58.3 $6.59 25.9m 58.3 - 89.2
#3449 2026-11-04 13:00:56 58.3 58.3 $6.59 25.9m 58.3 - 89.2
#3448 2026-11-04 12:00:56 58.3 58.3 $6.59 25.9m 58.3 - 89.2
#3447 2026-11-04 11:00:53 58.3 58.3 $6.59 24.5m 58.3 - 89.2
#3446 2026-11-04 10:00:54 58.3 58.3 $6.59 24.5m 58.3 - 89.2
#3445 2026-11-04 09:00:53 58.3 58.3 $6.59 24.5m 58.3 - 89.2
#3444 2026-11-04 08:00:55 58.3 58.3 $6.59 24.5m 58.3 - 89.2
#3443 2026-11-04 07:00:54 58.3 58.3 $6.59 17.4m 58.3 - 89.2
#3442 2026-11-04 06:00:53 58.3 58.3 $6.59 17.4m 58.3 - 89.2
#3441 2026-11-04 05:00:53 58.3 58.3 $6.59 18.7m 58.3 - 89.2
#3440 2026-11-04 04:00:53 58.3 58.3 $6.59 18.7m 58.3 - 89.2
#3439 2026-11-04 03:00:54 58.3 58.3 $6.59 18.7m 58.3 - 89.2
#3438 2026-11-04 02:00:53 58.3 58.3 $6.59 18.7m 58.3 - 89.2
#3437 2026-11-04 01:00:53 58.3 58.3 $6.59 18.7m 58.3 - 89.2
#3436 2026-11-04 00:00:53 58.3 58.3 $6.59 20.2m 58.3 - 89.2
#3435 2026-11-03 23:00:53 58.3 58.3 $6.59 20.2m 58.3 - 89.2
#3434 2026-11-03 22:00:53 58.3 58.3 $6.59 20.2m 58.3 - 89.2
#3433 2026-11-03 21:00:54 57.7 57.7 $6.59 18.7m 57.7 - 89.2
#3432 2026-11-03 20:00:53 57.7 57.7 $6.59 18.7m 57.7 - 89.2
#3431 2026-11-03 19:00:54 57.7 57.7 $6.59 16.8m 57.7 - 89.2
#3430 2026-11-03 18:00:55 57.7 57.7 $6.59 16.8m 57.7 - 89.2
#3429 2026-11-03 17:00:58 57.7 57.7 $6.59 16.8m 57.7 - 89.2
#3428 2026-11-03 16:01:01 57.7 57.7 $6.59 16.8m 57.7 - 89.2
#3427 2026-11-03 15:00:59 57.7 57.7 $6.59 16.8m 57.7 - 89.2
#3426 2026-11-03 14:00:14 57.7 57.7 $6.59 16.8m 57.7 - 89.2
#3425 2026-11-03 13:00:14 57.7 57.7 $6.59 16.8m 57.7 - 89.2
#3424 2026-11-03 12:00:14 57.7 57.7 $6.59 16.8m 57.7 - 89.2
#3423 2026-11-03 11:00:14 57.7 57.7 $6.59 16.8m 57.7 - 89.2
#3422 2026-11-03 10:00:14 57.7 57.7 $6.59 16.8m 57.7 - 89.2
#3421 2026-11-03 09:00:14 57.7 57.7 $6.59 20.1m 57.7 - 89.2
#3420 2026-11-03 08:00:14 57.7 57.7 $6.59 20.1m 57.7 - 89.2
#3419 2026-11-03 07:00:14 57.7 57.7 $6.59 20.1m 57.7 - 89.2
#3418 2026-11-03 06:00:14 57.7 57.7 $6.59 29.2m 57.7 - 89.2
#3417 2026-11-03 05:00:14 57.7 57.7 $6.59 29.2m 57.7 - 89.2
#3416 2026-11-03 04:00:14 57.7 57.7 $6.59 - 57.7 - 89.2
#3415 2026-11-03 03:00:14 57.7 57.7 $6.59 - 57.7 - 89.2
#3414 2026-11-03 02:00:14 57.7 57.7 $6.59 - 57.7 - 89.2
#3413 2026-11-03 01:00:14 57.7 57.7 $6.59 - 57.7 - 89.2
#3412 2026-11-03 00:00:14 57.7 57.7 $6.59 - 57.7 - 89.2
#3411 2026-11-02 23:00:14 57.7 57.7 $6.59 - 57.7 - 89.2
#3410 2026-11-02 22:00:14 57.7 57.7 $6.59 - 57.7 - 89.2
#3409 2026-11-02 21:00:14 57.7 57.7 $6.59 - 57.7 - 89.2
#3408 2026-11-02 20:00:14 57.7 57.7 $6.59 - 57.7 - 89.2
#3407 2026-11-02 19:00:14 57.7 57.7 $6.59 - 57.7 - 89.2
#3406 2026-11-02 18:00:14 57.7 57.7 $6.59 - 57.7 - 89.2
#3405 2026-11-02 17:00:14 57.7 57.7 $6.59 - 57.7 - 89.2
#3404 2026-11-02 16:00:15 57.7 57.7 $6.59 - 57.7 - 89.2
#3403 2026-11-02 15:00:14 57.7 57.7 $6.59 - 57.7 - 89.2
#3402 2026-11-02 14:00:14 57.7 57.7 $6.59 - 57.7 - 89.2
#3401 2026-11-02 13:00:14 57.7 57.7 $6.59 - 57.7 - 89.2
#3400 2026-11-02 12:00:14 57.7 57.7 $6.59 - 57.7 - 89.2
#3399 2026-11-02 11:00:14 57.7 57.7 $6.59 - 57.7 - 89.2
#3398 2026-11-02 10:00:14 57.7 57.7 $6.59 - 57.7 - 89.2
#3397 2026-11-02 09:00:14 57.7 57.7 $6.59 - 57.7 - 89.2
#3396 2026-11-02 08:00:14 57.7 57.7 $6.59 - 57.7 - 89.2