Agnes 2.5 Pro Beta

agnes-2-5-pro-beta · 45 samples · intelligence / raw

Scoring

Choose the quality benchmark and final score formula for this model.

Cost adjustment

Tune formulas that account for Cost per Task.

Score over time

48.648.949.149.349.609-01 03:0009-02 01:4509-03 00:3009-03 23:1509-04 22:00 Run #1995 · Score · X: 2026-09-01 03:00:35 · Y: 49.1Run #1996 · Score · X: 2026-09-01 04:00:35 · Y: 49.1Run #1997 · Score · X: 2026-09-01 05:00:35 · Y: 49.1Run #1998 · Score · X: 2026-09-01 06:00:35 · Y: 49.1Run #1999 · Score · X: 2026-09-01 07:00:35 · Y: 49.1Run #2000 · Score · X: 2026-09-01 08:00:35 · Y: 49.1Run #2001 · Score · X: 2026-09-01 09:00:35 · Y: 49.1Run #2002 · Score · X: 2026-09-01 10:00:35 · Y: 49.1Run #2003 · Score · X: 2026-09-01 11:00:35 · Y: 49.1Run #2004 · Score · X: 2026-09-01 12:00:35 · Y: 49.1Run #2005 · Score · X: 2026-09-01 13:00:36 · Y: 49.1Run #2006 · Score · X: 2026-09-01 14:01:09 · Y: 49.1Run #2007 · Score · X: 2026-09-02 00:01:06 · Y: 49.1Run #2008 · Score · X: 2026-09-02 01:00:59 · Y: 49.1Run #2009 · Score · X: 2026-09-02 02:01:02 · Y: 49.1Run #2010 · Score · X: 2026-09-02 03:01:05 · Y: 49.1Run #2011 · Score · X: 2026-09-02 04:01:00 · Y: 49.1Run #2012 · Score · X: 2026-09-03 00:00:25 · Y: 49.1Run #2013 · Score · X: 2026-09-03 01:00:25 · Y: 49.1Run #2014 · Score · X: 2026-09-03 02:00:26 · Y: 49.1Run #2015 · Score · X: 2026-09-03 03:00:24 · Y: 49.1Run #2016 · Score · X: 2026-09-03 04:00:24 · Y: 49.1Run #2017 · Score · X: 2026-09-04 00:00:27 · Y: 49.1Run #2018 · Score · X: 2026-09-04 01:00:14 · Y: 49.1Run #2019 · Score · X: 2026-09-04 02:00:13 · Y: 49.1Run #2020 · Score · X: 2026-09-04 03:00:14 · Y: 49.1Run #2021 · Score · X: 2026-09-04 04:00:13 · Y: 49.1Run #2022 · Score · X: 2026-09-04 05:00:13 · Y: 49.1Run #2023 · Score · X: 2026-09-04 06:00:13 · Y: 49.1Run #2024 · Score · X: 2026-09-04 07:00:13 · Y: 49.1Run #2025 · Score · X: 2026-09-04 08:00:15 · Y: 49.1Run #2026 · Score · X: 2026-09-04 09:00:14 · Y: 49.1Run #2027 · Score · X: 2026-09-04 10:00:14 · Y: 49.1Run #2028 · Score · X: 2026-09-04 11:00:13 · Y: 49.1Run #2029 · Score · X: 2026-09-04 12:00:15 · Y: 49.1Run #2030 · Score · X: 2026-09-04 13:00:14 · Y: 49.1Run #2031 · Score · X: 2026-09-04 14:00:15 · Y: 49.1Run #2032 · Score · X: 2026-09-04 15:00:14 · Y: 49.1Run #2033 · Score · X: 2026-09-04 16:00:13 · Y: 49.1Run #2034 · Score · X: 2026-09-04 17:00:14 · Y: 49.1Run #2035 · Score · X: 2026-09-04 18:00:13 · Y: 49.1Run #2036 · Score · X: 2026-09-04 19:00:14 · Y: 49.1Run #2037 · Score · X: 2026-09-04 20:00:13 · Y: 49.1Run #2038 · Score · X: 2026-09-04 21:00:14 · Y: 49.1Run #2039 · Score · X: 2026-09-04 22:00:13 · Y: 49.1

Cost per task over time

$0.0268$0.0269$0.0270$0.0271$0.027309-01 03:0009-02 01:4509-03 00:3009-03 23:1509-04 22:00 Run #1995 · Cost per task · X: 2026-09-01 03:00:35 · Y: $0.0268Run #1996 · Cost per task · X: 2026-09-01 04:00:35 · Y: $0.0268Run #1997 · Cost per task · X: 2026-09-01 05:00:35 · Y: $0.0268Run #1998 · Cost per task · X: 2026-09-01 06:00:35 · Y: $0.0268Run #1999 · Cost per task · X: 2026-09-01 07:00:35 · Y: $0.0268Run #2000 · Cost per task · X: 2026-09-01 08:00:35 · Y: $0.0268Run #2001 · Cost per task · X: 2026-09-01 09:00:35 · Y: $0.0268Run #2002 · Cost per task · X: 2026-09-01 10:00:35 · Y: $0.0268Run #2003 · Cost per task · X: 2026-09-01 11:00:35 · Y: $0.0268Run #2004 · Cost per task · X: 2026-09-01 12:00:35 · Y: $0.0268Run #2005 · Cost per task · X: 2026-09-01 13:00:36 · Y: $0.0268Run #2006 · Cost per task · X: 2026-09-01 14:01:09 · Y: $0.0268Run #2007 · Cost per task · X: 2026-09-02 00:01:06 · Y: $0.0268Run #2008 · Cost per task · X: 2026-09-02 01:00:59 · Y: $0.0268Run #2009 · Cost per task · X: 2026-09-02 02:01:02 · Y: $0.0268Run #2010 · Cost per task · X: 2026-09-02 03:01:05 · Y: $0.0268Run #2011 · Cost per task · X: 2026-09-02 04:01:00 · Y: $0.0268Run #2012 · Cost per task · X: 2026-09-03 00:00:25 · Y: $0.0268Run #2013 · Cost per task · X: 2026-09-03 01:00:25 · Y: $0.0268Run #2014 · Cost per task · X: 2026-09-03 02:00:26 · Y: $0.0268Run #2015 · Cost per task · X: 2026-09-03 03:00:24 · Y: $0.0268Run #2016 · Cost per task · X: 2026-09-03 04:00:24 · Y: $0.0268Run #2017 · Cost per task · X: 2026-09-04 00:00:27 · Y: $0.0268Run #2018 · Cost per task · X: 2026-09-04 01:00:14 · Y: $0.0268Run #2019 · Cost per task · X: 2026-09-04 02:00:13 · Y: $0.0268Run #2020 · Cost per task · X: 2026-09-04 03:00:14 · Y: $0.0268Run #2021 · Cost per task · X: 2026-09-04 04:00:13 · Y: $0.0268Run #2022 · Cost per task · X: 2026-09-04 05:00:13 · Y: $0.0268Run #2023 · Cost per task · X: 2026-09-04 06:00:13 · Y: $0.0268Run #2024 · Cost per task · X: 2026-09-04 07:00:13 · Y: $0.0268Run #2025 · Cost per task · X: 2026-09-04 08:00:15 · Y: $0.0268Run #2026 · Cost per task · X: 2026-09-04 09:00:14 · Y: $0.0268Run #2027 · Cost per task · X: 2026-09-04 10:00:14 · Y: $0.0268Run #2028 · Cost per task · X: 2026-09-04 11:00:13 · Y: $0.0268Run #2029 · Cost per task · X: 2026-09-04 12:00:15 · Y: $0.0273Run #2030 · Cost per task · X: 2026-09-04 13:00:14 · Y: $0.0273Run #2031 · Cost per task · X: 2026-09-04 14:00:15 · Y: $0.0273Run #2032 · Cost per task · X: 2026-09-04 15:00:14 · Y: $0.0273Run #2033 · Cost per task · X: 2026-09-04 16:00:13 · Y: $0.0273Run #2034 · Cost per task · X: 2026-09-04 17:00:14 · Y: $0.0273Run #2035 · Cost per task · X: 2026-09-04 18:00:13 · Y: $0.0273Run #2036 · Cost per task · X: 2026-09-04 19:00:14 · Y: $0.0273Run #2037 · Cost per task · X: 2026-09-04 20:00:13 · Y: $0.0273Run #2038 · Cost per task · X: 2026-09-04 21:00:14 · Y: $0.0273Run #2039 · Cost per task · X: 2026-09-04 22:00:13 · Y: $0.0273

Time per task over time

4.21m4.49m4.77m5.06m5.34m09-01 03:0009-02 01:4509-03 00:3009-03 23:1509-04 22:00 Run #1995 · Time per task · X: 2026-09-01 03:00:35 · Y: 5.34mRun #1996 · Time per task · X: 2026-09-01 04:00:35 · Y: 5.34mRun #1997 · Time per task · X: 2026-09-01 05:00:35 · Y: 5.34mRun #1998 · Time per task · X: 2026-09-01 06:00:35 · Y: 5.34mRun #1999 · Time per task · X: 2026-09-01 07:00:35 · Y: 5.34mRun #2000 · Time per task · X: 2026-09-01 08:00:35 · Y: 5.34mRun #2001 · Time per task · X: 2026-09-01 09:00:35 · Y: 5.34mRun #2002 · Time per task · X: 2026-09-01 10:00:35 · Y: 5.34mRun #2003 · Time per task · X: 2026-09-01 11:00:35 · Y: 5.34mRun #2004 · Time per task · X: 2026-09-01 12:00:35 · Y: 5.34mRun #2005 · Time per task · X: 2026-09-01 13:00:36 · Y: 5.34mRun #2006 · Time per task · X: 2026-09-01 14:01:09 · Y: 5.34mRun #2007 · Time per task · X: 2026-09-02 00:01:06 · Y: 5.34mRun #2008 · Time per task · X: 2026-09-02 01:00:59 · Y: 5.34mRun #2009 · Time per task · X: 2026-09-02 02:01:02 · Y: 5.34mRun #2010 · Time per task · X: 2026-09-02 03:01:05 · Y: 5.34mRun #2011 · Time per task · X: 2026-09-02 04:01:00 · Y: 5.34mRun #2012 · Time per task · X: 2026-09-03 00:00:25 · Y: 5.32mRun #2013 · Time per task · X: 2026-09-03 01:00:25 · Y: 5.32mRun #2014 · Time per task · X: 2026-09-03 02:00:26 · Y: 5.32mRun #2015 · Time per task · X: 2026-09-03 03:00:24 · Y: 5.32mRun #2016 · Time per task · X: 2026-09-03 04:00:24 · Y: 5.25mRun #2017 · Time per task · X: 2026-09-04 00:00:27 · Y: 4.82mRun #2018 · Time per task · X: 2026-09-04 01:00:14 · Y: 4.63mRun #2019 · Time per task · X: 2026-09-04 02:00:13 · Y: 4.63mRun #2020 · Time per task · X: 2026-09-04 03:00:14 · Y: 4.63mRun #2021 · Time per task · X: 2026-09-04 04:00:13 · Y: 4.21mRun #2022 · Time per task · X: 2026-09-04 05:00:13 · Y: 4.21mRun #2023 · Time per task · X: 2026-09-04 06:00:13 · Y: 4.21m
Run?Fetched?Score?Quality?Cost/task?Time/task?Intel?Agent?MMMU%?
#2039 2026-09-04 22:00:13 49.1 49.1 $0.0273 - 49.1 - 75.4
#2038 2026-09-04 21:00:14 49.1 49.1 $0.0273 - 49.1 - 75.4
#2037 2026-09-04 20:00:13 49.1 49.1 $0.0273 - 49.1 - 75.4
#2036 2026-09-04 19:00:14 49.1 49.1 $0.0273 - 49.1 - 75.4
#2035 2026-09-04 18:00:13 49.1 49.1 $0.0273 - 49.1 - 75.4
#2034 2026-09-04 17:00:14 49.1 49.1 $0.0273 - 49.1 - 75.4
#2033 2026-09-04 16:00:13 49.1 49.1 $0.0273 - 49.1 - 75.4
#2032 2026-09-04 15:00:14 49.1 49.1 $0.0273 - 49.1 - 75.4
#2031 2026-09-04 14:00:15 49.1 49.1 $0.0273 - 49.1 - 75.4
#2030 2026-09-04 13:00:14 49.1 49.1 $0.0273 - 49.1 - 75.4
#2029 2026-09-04 12:00:15 49.1 49.1 $0.0273 - 49.1 - 75.4
#2028 2026-09-04 11:00:13 49.1 49.1 $0.0268 - 49.1 - 75.4
#2027 2026-09-04 10:00:14 49.1 49.1 $0.0268 - 49.1 43.8 75.4
#2026 2026-09-04 09:00:14 49.1 49.1 $0.0268 - 49.1 43.8 75.4
#2025 2026-09-04 08:00:15 49.1 49.1 $0.0268 - 49.1 43.8 75.4
#2024 2026-09-04 07:00:13 49.1 49.1 $0.0268 - 49.1 43.8 75.4
#2023 2026-09-04 06:00:13 49.1 49.1 $0.0268 4.21m 49.1 43.8 75.4
#2022 2026-09-04 05:00:13 49.1 49.1 $0.0268 4.21m 49.1 43.8 75.4
#2021 2026-09-04 04:00:13 49.1 49.1 $0.0268 4.21m 49.1 43.8 75.4
#2020 2026-09-04 03:00:14 49.1 49.1 $0.0268 4.63m 49.1 43.8 75.4
#2019 2026-09-04 02:00:13 49.1 49.1 $0.0268 4.63m 49.1 43.8 75.4
#2018 2026-09-04 01:00:14 49.1 49.1 $0.0268 4.63m 49.1 43.8 75.4
#2017 2026-09-04 00:00:27 49.1 49.1 $0.0268 4.82m 49.1 43.8 75.4
#2016 2026-09-03 04:00:24 49.1 49.1 $0.0268 5.25m 49.1 43.8 75.4
#2015 2026-09-03 03:00:24 49.1 49.1 $0.0268 5.32m 49.1 43.8 75.4
#2014 2026-09-03 02:00:26 49.1 49.1 $0.0268 5.32m 49.1 43.8 75.4
#2013 2026-09-03 01:00:25 49.1 49.1 $0.0268 5.32m 49.1 43.8 75.4
#2012 2026-09-03 00:00:25 49.1 49.1 $0.0268 5.32m 49.1 43.8 75.4
#2011 2026-09-02 04:01:00 49.1 49.1 $0.0268 5.34m 49.1 43.8 75.4
#2010 2026-09-02 03:01:05 49.1 49.1 $0.0268 5.34m 49.1 43.8 75.4
#2009 2026-09-02 02:01:02 49.1 49.1 $0.0268 5.34m 49.1 43.8 75.4
#2008 2026-09-02 01:00:59 49.1 49.1 $0.0268 5.34m 49.1 43.8 75.4
#2007 2026-09-02 00:01:06 49.1 49.1 $0.0268 5.34m 49.1 43.8 75.4
#2006 2026-09-01 14:01:09 49.1 49.1 $0.0268 5.34m 49.1 43.8 75.4
#2005 2026-09-01 13:00:36 49.1 49.1 $0.0268 5.34m 49.1 43.8 75.4
#2004 2026-09-01 12:00:35 49.1 49.1 $0.0268 5.34m 49.1 43.8 75.4
#2003 2026-09-01 11:00:35 49.1 49.1 $0.0268 5.34m 49.1 43.8 75.4
#2002 2026-09-01 10:00:35 49.1 49.1 $0.0268 5.34m 49.1 43.8 75.4
#2001 2026-09-01 09:00:35 49.1 49.1 $0.0268 5.34m 49.1 43.8 75.4
#2000 2026-09-01 08:00:35 49.1 49.1 $0.0268 5.34m 49.1 43.8 75.4
#1999 2026-09-01 07:00:35 49.1 49.1 $0.0268 5.34m 49.1 43.8 75.4
#1998 2026-09-01 06:00:35 49.1 49.1 $0.0268 5.34m 49.1 43.8 75.4
#1997 2026-09-01 05:00:35 49.1 49.1 $0.0268 5.34m 49.1 43.8 75.4
#1996 2026-09-01 04:00:35 49.1 49.1 $0.0268 5.34m 49.1 43.8 75.4
#1995 2026-09-01 03:00:35 49.1 49.1 $0.0268 5.34m 49.1 43.8 75.4