Claude Fable 5.1 (Adaptive Reasoning, Medium Effort, Default Fallback)

claude-fable-5-1-medium · 38 samples · intelligence / raw

Scoring

Choose the quality benchmark and final score formula for this model.

Cost adjustment

Tune formulas that account for Cost per Task.

Score over time

52.854.756.658.660.509-02 00:0109-03 06:1509-04 12:3009-05 18:4509-07 01:00 Run #2007 · Score · X: 2026-09-02 00:01:06 · Y: 60.5Run #2008 · Score · X: 2026-09-02 01:00:59 · Y: 60.5Run #2009 · Score · X: 2026-09-02 02:01:02 · Y: 60.5Run #2010 · Score · X: 2026-09-02 03:01:05 · Y: 60.5Run #2011 · Score · X: 2026-09-02 04:01:00 · Y: 60.5Run #2012 · Score · X: 2026-09-03 00:00:25 · Y: 60.5Run #2013 · Score · X: 2026-09-03 01:00:25 · Y: 60.5Run #2014 · Score · X: 2026-09-03 02:00:26 · Y: 60.5Run #2015 · Score · X: 2026-09-03 03:00:24 · Y: 60.5Run #2016 · Score · X: 2026-09-03 04:00:24 · Y: 60.5Run #2017 · Score · X: 2026-09-04 00:00:27 · Y: 60.5Run #2018 · Score · X: 2026-09-04 01:00:14 · Y: 60.5Run #2019 · Score · X: 2026-09-04 02:00:13 · Y: 60.5Run #2020 · Score · X: 2026-09-04 03:00:14 · Y: 60.5Run #2021 · Score · X: 2026-09-04 04:00:13 · Y: 60.5Run #2022 · Score · X: 2026-09-04 05:00:13 · Y: 60.5Run #2023 · Score · X: 2026-09-04 06:00:13 · Y: 60.5Run #2024 · Score · X: 2026-09-04 07:00:13 · Y: 60.5Run #2025 · Score · X: 2026-09-04 08:00:15 · Y: 60.5Run #2026 · Score · X: 2026-09-04 09:00:14 · Y: 60.5Run #2027 · Score · X: 2026-09-04 10:00:14 · Y: 60.5Run #2028 · Score · X: 2026-09-04 11:00:13 · Y: 60.5Run #2029 · Score · X: 2026-09-04 12:00:15 · Y: 60.5Run #2030 · Score · X: 2026-09-04 13:00:14 · Y: 60.5Run #2031 · Score · X: 2026-09-04 14:00:15 · Y: 60.5Run #2032 · Score · X: 2026-09-04 15:00:14 · Y: 60.5Run #2033 · Score · X: 2026-09-04 16:00:13 · Y: 60.5Run #2034 · Score · X: 2026-09-04 17:00:14 · Y: 60.5Run #2035 · Score · X: 2026-09-04 18:00:13 · Y: 60.5Run #2036 · Score · X: 2026-09-04 19:00:14 · Y: 60.5Run #2037 · Score · X: 2026-09-04 20:00:13 · Y: 60.5Run #2038 · Score · X: 2026-09-04 21:00:14 · Y: 60.5Run #2039 · Score · X: 2026-09-04 22:00:13 · Y: 60.5Run #2085 · Score · X: 2026-09-06 21:00:22 · Y: 52.8Run #2086 · Score · X: 2026-09-06 22:00:23 · Y: 52.8Run #2087 · Score · X: 2026-09-06 23:00:20 · Y: 52.8Run #2088 · Score · X: 2026-09-07 00:00:19 · Y: 52.8Run #2089 · Score · X: 2026-09-07 01:00:18 · Y: 52.8

Cost per task over time

$1.00$1.29$1.57$1.85$2.1409-02 00:0109-03 06:1509-04 12:3009-05 18:4509-07 01:00 Run #2007 · Cost per task · X: 2026-09-02 00:01:06 · Y: $1.00Run #2008 · Cost per task · X: 2026-09-02 01:00:59 · Y: $1.00Run #2009 · Cost per task · X: 2026-09-02 02:01:02 · Y: $1.00Run #2010 · Cost per task · X: 2026-09-02 03:01:05 · Y: $1.00Run #2011 · Cost per task · X: 2026-09-02 04:01:00 · Y: $1.00Run #2012 · Cost per task · X: 2026-09-03 00:00:25 · Y: $1.00Run #2013 · Cost per task · X: 2026-09-03 01:00:25 · Y: $1.00Run #2014 · Cost per task · X: 2026-09-03 02:00:26 · Y: $1.00Run #2015 · Cost per task · X: 2026-09-03 03:00:24 · Y: $1.00Run #2016 · Cost per task · X: 2026-09-03 04:00:24 · Y: $1.00Run #2017 · Cost per task · X: 2026-09-04 00:00:27 · Y: $1.00Run #2018 · Cost per task · X: 2026-09-04 01:00:14 · Y: $1.00Run #2019 · Cost per task · X: 2026-09-04 02:00:13 · Y: $1.00Run #2020 · Cost per task · X: 2026-09-04 03:00:14 · Y: $1.00Run #2021 · Cost per task · X: 2026-09-04 04:00:13 · Y: $1.00Run #2022 · Cost per task · X: 2026-09-04 05:00:13 · Y: $1.00Run #2023 · Cost per task · X: 2026-09-04 06:00:13 · Y: $1.00Run #2024 · Cost per task · X: 2026-09-04 07:00:13 · Y: $1.00Run #2025 · Cost per task · X: 2026-09-04 08:00:15 · Y: $1.00Run #2026 · Cost per task · X: 2026-09-04 09:00:14 · Y: $1.00Run #2027 · Cost per task · X: 2026-09-04 10:00:14 · Y: $1.00Run #2028 · Cost per task · X: 2026-09-04 11:00:13 · Y: $1.00Run #2029 · Cost per task · X: 2026-09-04 12:00:15 · Y: $1.00Run #2030 · Cost per task · X: 2026-09-04 13:00:14 · Y: $1.00Run #2031 · Cost per task · X: 2026-09-04 14:00:15 · Y: $1.00Run #2032 · Cost per task · X: 2026-09-04 15:00:14 · Y: $1.00Run #2033 · Cost per task · X: 2026-09-04 16:00:13 · Y: $1.00Run #2034 · Cost per task · X: 2026-09-04 17:00:14 · Y: $1.00Run #2035 · Cost per task · X: 2026-09-04 18:00:13 · Y: $1.00Run #2036 · Cost per task · X: 2026-09-04 19:00:14 · Y: $1.00Run #2037 · Cost per task · X: 2026-09-04 20:00:13 · Y: $1.00Run #2038 · Cost per task · X: 2026-09-04 21:00:14 · Y: $1.00Run #2039 · Cost per task · X: 2026-09-04 22:00:13 · Y: $1.00Run #2085 · Cost per task · X: 2026-09-06 21:00:22 · Y: $2.14Run #2086 · Cost per task · X: 2026-09-06 22:00:23 · Y: $2.14Run #2087 · Cost per task · X: 2026-09-06 23:00:20 · Y: $2.14Run #2088 · Cost per task · X: 2026-09-07 00:00:19 · Y: $2.14Run #2089 · Cost per task · X: 2026-09-07 01:00:18 · Y: $2.14

Time per task over time

1.84m2.29m2.75m3.21m3.67m09-02 00:0109-03 06:1509-04 12:3009-05 18:4509-07 01:00 Run #2007 · Time per task · X: 2026-09-02 00:01:06 · Y: 2.12mRun #2008 · Time per task · X: 2026-09-02 01:00:59 · Y: 2.07mRun #2009 · Time per task · X: 2026-09-02 02:01:02 · Y: 2.07mRun #2010 · Time per task · X: 2026-09-02 03:01:05 · Y: 2.07mRun #2011 · Time per task · X: 2026-09-02 04:01:00 · Y: 2.08mRun #2012 · Time per task · X: 2026-09-03 00:00:25 · Y: 2.02mRun #2013 · Time per task · X: 2026-09-03 01:00:25 · Y: 2.02mRun #2014 · Time per task · X: 2026-09-03 02:00:26 · Y: 2.02mRun #2015 · Time per task · X: 2026-09-03 03:00:24 · Y: 2.02mRun #2016 · Time per task · X: 2026-09-03 04:00:24 · Y: 2.01mRun #2017 · Time per task · X: 2026-09-04 00:00:27 · Y: 1.84mRun #2018 · Time per task · X: 2026-09-04 01:00:14 · Y: 1.84mRun #2019 · Time per task · X: 2026-09-04 02:00:13 · Y: 1.84mRun #2020 · Time per task · X: 2026-09-04 03:00:14 · Y: 1.84mRun #2021 · Time per task · X: 2026-09-04 04:00:13 · Y: 1.84mRun #2022 · Time per task · X: 2026-09-04 05:00:13 · Y: 1.84mRun #2023 · Time per task · X: 2026-09-04 06:00:13 · Y: 1.84mRun #2024 · Time per task · X: 2026-09-04 07:00:13 · Y: 1.84mRun #2025 · Time per task · X: 2026-09-04 08:00:15 · Y: 1.84mRun #2026 · Time per task · X: 2026-09-04 09:00:14 · Y: 1.84mRun #2027 · Time per task · X: 2026-09-04 10:00:14 · Y: 1.85mRun #2028 · Time per task · X: 2026-09-04 11:00:13 · Y: 1.85mRun #2029 · Time per task · X: 2026-09-04 12:00:15 · Y: 1.85mRun #2030 · Time per task · X: 2026-09-04 13:00:14 · Y: 1.84mRun #2031 · Time per task · X: 2026-09-04 14:00:15 · Y: 1.84mRun #2032 · Time per task · X: 2026-09-04 15:00:14 · Y: 1.84mRun #2033 · Time per task · X: 2026-09-04 16:00:13 · Y: 1.84mRun #2034 · Time per task · X: 2026-09-04 17:00:14 · Y: 1.84mRun #2035 · Time per task · X: 2026-09-04 18:00:13 · Y: 1.84mRun #2036 · Time per task · X: 2026-09-04 19:00:14 · Y: 1.84mRun #2037 · Time per task · X: 2026-09-04 20:00:13 · Y: 1.84mRun #2038 · Time per task · X: 2026-09-04 21:00:14 · Y: 1.84mRun #2039 · Time per task · X: 2026-09-04 22:00:13 · Y: 1.84mRun #2085 · Time per task · X: 2026-09-06 21:00:22 · Y: 3.64mRun #2086 · Time per task · X: 2026-09-06 22:00:23 · Y: 3.64mRun #2087 · Time per task · X: 2026-09-06 23:00:20 · Y: 3.67mRun #2088 · Time per task · X: 2026-09-07 00:00:19 · Y: 3.67mRun #2089 · Time per task · X: 2026-09-07 01:00:18 · Y: 3.67m
Run?Fetched?Score?Quality?Cost/task?Time/task?Intel?Agent?MMMU%?
#2089 2026-09-07 01:00:18 52.8 52.8 $2.14 3.67m 52.8 - -
#2088 2026-09-07 00:00:19 52.8 52.8 $2.14 3.67m 52.8 - -
#2087 2026-09-06 23:00:20 52.8 52.8 $2.14 3.67m 52.8 - -
#2086 2026-09-06 22:00:23 52.8 52.8 $2.14 3.64m 52.8 - -
#2085 2026-09-06 21:00:22 52.8 52.8 $2.14 3.64m 52.8 - -
#2039 2026-09-04 22:00:13 60.5 60.5 $1.00 1.84m 60.5 - -
#2038 2026-09-04 21:00:14 60.5 60.5 $1.00 1.84m 60.5 - -
#2037 2026-09-04 20:00:13 60.5 60.5 $1.00 1.84m 60.5 - -
#2036 2026-09-04 19:00:14 60.5 60.5 $1.00 1.84m 60.5 - -
#2035 2026-09-04 18:00:13 60.5 60.5 $1.00 1.84m 60.5 - -
#2034 2026-09-04 17:00:14 60.5 60.5 $1.00 1.84m 60.5 - -
#2033 2026-09-04 16:00:13 60.5 60.5 $1.00 1.84m 60.5 - -
#2032 2026-09-04 15:00:14 60.5 60.5 $1.00 1.84m 60.5 - -
#2031 2026-09-04 14:00:15 60.5 60.5 $1.00 1.84m 60.5 - -
#2030 2026-09-04 13:00:14 60.5 60.5 $1.00 1.84m 60.5 - -
#2029 2026-09-04 12:00:15 60.5 60.5 $1.00 1.85m 60.5 - -
#2028 2026-09-04 11:00:13 60.5 60.5 $1.00 1.85m 60.5 - -
#2027 2026-09-04 10:00:14 60.5 60.5 $1.00 1.85m 60.5 52.7 -
#2026 2026-09-04 09:00:14 60.5 60.5 $1.00 1.84m 60.5 52.7 -
#2025 2026-09-04 08:00:15 60.5 60.5 $1.00 1.84m 60.5 52.7 -
#2024 2026-09-04 07:00:13 60.5 60.5 $1.00 1.84m 60.5 52.7 -
#2023 2026-09-04 06:00:13 60.5 60.5 $1.00 1.84m 60.5 52.7 -
#2022 2026-09-04 05:00:13 60.5 60.5 $1.00 1.84m 60.5 52.7 -
#2021 2026-09-04 04:00:13 60.5 60.5 $1.00 1.84m 60.5 52.7 -
#2020 2026-09-04 03:00:14 60.5 60.5 $1.00 1.84m 60.5 52.7 -
#2019 2026-09-04 02:00:13 60.5 60.5 $1.00 1.84m 60.5 52.7 -
#2018 2026-09-04 01:00:14 60.5 60.5 $1.00 1.84m 60.5 52.7 -
#2017 2026-09-04 00:00:27 60.5 60.5 $1.00 1.84m 60.5 52.7 -
#2016 2026-09-03 04:00:24 60.5 60.5 $1.00 2.01m 60.5 52.7 -
#2015 2026-09-03 03:00:24 60.5 60.5 $1.00 2.02m 60.5 52.7 -
#2014 2026-09-03 02:00:26 60.5 60.5 $1.00 2.02m 60.5 52.7 -
#2013 2026-09-03 01:00:25 60.5 60.5 $1.00 2.02m 60.5 52.7 -
#2012 2026-09-03 00:00:25 60.5 60.5 $1.00 2.02m 60.5 52.7 -
#2011 2026-09-02 04:01:00 60.5 60.5 $1.00 2.08m 60.5 52.7 -
#2010 2026-09-02 03:01:05 60.5 60.5 $1.00 2.07m 60.5 52.7 -
#2009 2026-09-02 02:01:02 60.5 60.5 $1.00 2.07m 60.5 52.7 -
#2008 2026-09-02 01:00:59 60.5 60.5 $1.00 2.07m 60.5 52.7 -
#2007 2026-09-02 00:01:06 60.5 60.5 $1.00 2.12m 60.5 52.7 -