AA score/cost/time comparison

Snapshot #1419 fetched 2026-08-05 00:00:29 · 1.21 MB raw HTML · 129 models

Snapshot

Pick the stored fetch snapshot to compare.

Run

Scoring

Choose the quality benchmark and final score formula.

Mode Calc

Cost adjustment

Tune formulas that account for Cost per Task.

Cost weight Cost floor Cost power

Result set

Control table filtering, ordering, and row count.

Sort Pareto Pareto axis Limit

Top quality model in this view: Claude Opus 5 (Adaptive Reasoning, Max Effort) (64.6 pts, $2.34/task, 7.43m/task) · sorted by score

Cost/task vs quality?

129 models · 14 on the Pareto frontier · combined quality vs Cost per Task

Historic #1 winner?

Top row for each successful snapshot using the current mode/calc/cost settings and score sort.

Latest #1 Claude Opus 5 (Adaptive Reasoning, Max Effort) 64.6

Recent winner changes

Claude Opus 5 (Adaptive Reasoning, Max Effort) 2026-07-24 18:00:45 · 64.6 GPT-5.6 Sol (max) 2026-07-13 07:00:52 · 63.4

Run?	Fetched?	Winner?	Score?	Qual?	Cost/task?	Time/task?
#1419	2026-08-05 00:00:29	Claude Opus 5 (Adaptive Reasoning, Max Effort)	64.6	64.6	$2.34	7.43m
#1418	2026-08-04 23:00:30	Claude Opus 5 (Adaptive Reasoning, Max Effort)	64.6	64.6	$2.34	7.43m
#1417	2026-08-04 22:00:29	Claude Opus 5 (Adaptive Reasoning, Max Effort)	64.6	64.6	$2.34	7.43m
#1416	2026-08-04 21:00:29	Claude Opus 5 (Adaptive Reasoning, Max Effort)	64.6	64.6	$2.34	7.43m
#1415	2026-08-04 20:00:29	Claude Opus 5 (Adaptive Reasoning, Max Effort)	64.6	64.6	$2.34	7.43m
#1414	2026-08-04 19:00:29	Claude Opus 5 (Adaptive Reasoning, Max Effort)	64.6	64.6	$2.34	7.43m
#1413	2026-08-04 18:00:29	Claude Opus 5 (Adaptive Reasoning, Max Effort)	64.6	64.6	$2.34	7.43m
#1412	2026-08-04 17:00:06	Claude Opus 5 (Adaptive Reasoning, Max Effort)	64.6	64.6	$2.34	7.43m

#?	Pareto?	Model?	Released?	Cost/task?	Time/task?	$/Q?	Qual?	ΔTop?	Intel?	Code?	Agent?	Pen?	Score?
1	✓	Claude Opus 5 (Adaptive Reasoning, Max Effort) Anthropic	2026-07-24	$2.34	7.43m	0.0361	64.6	0.0	60.7	78.0	55.3	23.7	64.6
2	✓	Claude Opus 5 (Adaptive Reasoning, Xhigh Effort) Anthropic	2026-07-24	$1.80	5.67m	0.0282	63.9	-0.8	60.1	77.0	54.5	22.6	63.9
3	✓	GPT-5.6 Sol (max) OpenAI	2026-07-09	$1.23	3.92m	0.0194	63.4	-1.2	58.9	77.4	54.0	20.9	63.4
4		Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback) Anthropic	2026-06-09	$3.15	4.99m	0.0499	63.1	-1.6	59.9	76.5	52.8	25.0	63.1
5	✓	GPT-5.6 Sol (xhigh) OpenAI	2026-07-09	$0.832	2.54m	0.0133	62.6	-2.0	57.7	78.3	51.8	19.2	62.6
6		Claude Opus 5 (Adaptive Reasoning, High Effort) Anthropic	2026-07-24	$1.23	3.99m	0.0196	62.5	-2.2	58.9	76.5	52.1	20.9	62.5
7		Kimi K3 (max) Kimi	2026-07-16	$0.855	10.6m	0.0140	61.1	-3.5	57.1	76.2	50.1	19.3	61.1
8	✓	GPT-5.6 Sol (high) OpenAI	2026-07-09	$0.549	1.91m	0.0091	60.5	-4.1	55.9	77.2	48.5	17.4	60.5
9	✓	GPT-5.6 Terra (max) OpenAI	2026-07-09	$0.510	2.67m	0.0085	59.7	-5.0	55.0	76.7	47.4	17.1	59.7
10		Claude Opus 5 (Adaptive Reasoning, Medium Effort) Anthropic	2026-07-24	$0.722	2.40m	0.0122	59.2	-5.4	56.3	74.3	47.1	18.6	59.2
11		Claude Opus 4.8 (Adaptive Reasoning, Max Effort) Anthropic	2026-05-28	$2.03	7.85m	0.0344	59.0	-5.6	55.7	74.3	47.2	23.1	59.0
12		GPT-5.5 (xhigh) OpenAI	2026-04-23	$1.17	3.24m	0.0202	58.2	-6.4	54.8	74.9	44.9	20.7	58.2
13	✓	GPT-5.6 Sol (medium) OpenAI	2026-07-09	$0.390	1.22m	0.0067	58.1	-6.5	53.6	76.3	44.5	15.9	58.1
14	✓	Grok 4.5 (high) SpaceXAI	2026-07-08	$0.365	3.89m	0.0064	57.3	-7.3	53.8	72.4	45.7	15.6	57.3
15		Claude Sonnet 5 (Adaptive Reasoning, Max Effort) Anthropic	2026-06-30	$1.72	9.29m	0.0300	57.2	-7.4	53.4	71.5	46.7	22.3	57.2
16		Claude Opus 4.7 (Adaptive Reasoning, Max Effort) Anthropic	2026-04-16	$2.22	6.57m	0.0389	57.2	-7.5	53.5	73.6	44.4	23.5	57.2
17	✓	GPT-5.6 Luna (max) OpenAI	2026-07-09	$0.0473	1.84m	0.0008	56.1	-8.5	51.2	71.4	45.6	6.8	56.1
18		GPT-5.5 (high) OpenAI	2026-04-23	$0.801	2.28m	0.0143	56.1	-8.6	53.1	71.6	43.5	19.0	56.1
19		GPT-5.6 Terra (xhigh) OpenAI	2026-07-09	$0.305	1.69m	0.0055	55.6	-9.0	51.6	70.6	44.7	14.8	55.6
20	✓	DeepSeek V4 Flash 0731 (Reasoning, Max Effort) DeepSeek	2026-07-31	$0.0271	4.82m	0.0005	54.9	-9.8	49.9	69.1	45.7	4.3	54.9
21		GPT-5.4 (xhigh) OpenAI	2026-03-05	$1.11	3.94m	0.0203	54.5	-10.1	51.4	71.1	41.1	20.4	54.5
22		GLM-5.2 (max) Z AI	2026-06-16	$0.567	4.10m	0.0104	54.3	-10.3	51.1	68.8	43.1	17.5	54.3
23		GPT-5.6 Luna (xhigh) OpenAI	2026-07-09	$0.0317	1.29m	0.0006	53.5	-11.1	49.1	68.6	42.9	5.0	53.5
24		GPT-5.5 (medium) OpenAI	2026-04-23	$0.495	1.22m	0.0093	53.2	-11.4	50.4	71.5	37.8	16.9	53.2
25		Muse Spark 1.1 (xhigh) Meta	2026-07-09	$0.292	1.41m	0.0055	53.2	-11.5	50.6	71.3	37.5	14.7	53.2
26		GPT-5.6 Sol (low) OpenAI	2026-07-09	$0.245	43s	0.0046	53.0	-11.6	49.4	69.7	40.0	13.9	53.0
27		Gemini 3.6 Flash (high) Google	2026-07-21	$0.557	1.90m	0.0106	52.7	-12.0	50.1	69.2	38.7	17.5	52.7
28		Gemini 3.5 Flash (high) Google	2026-05-19	$0.691	2.69m	0.0131	52.6	-12.0	50.2	70.1	37.4	18.4	52.6
29		GPT-5.6 Terra (high) OpenAI	2026-07-09	$0.220	1.22m	0.0042	52.5	-12.2	49.0	67.1	41.3	13.4	52.5
30		Claude Opus 5 (Adaptive Reasoning, Low Effort) Anthropic	2026-07-24	$0.426	1.27m	0.0081	52.4	-12.2	50.6	66.9	39.8	16.3	52.4
31		Kimi K3 (low) Kimi	2026-07-16	$0.243	1.94m	0.0047	51.9	-12.8	46.6	72.0	37.0	13.9	51.9
32		Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort) Anthropic	2026-02-17	$1.22	12.7m	0.0242	50.3	-14.3	47.2	63.0	40.8	20.9	50.3
33	✓	GPT-5.6 Luna (high) OpenAI	2026-07-09	$0.0216	52s	0.0004	49.8	-14.8	46.1	63.3	40.1	3.3	49.8
34		GPT-5.6 Terra (medium) OpenAI	2026-07-09	$0.119	35s	0.0024	49.1	-15.5	45.6	64.7	37.0	10.8	49.1
35		Qwen3.7 Max Alibaba	2026-05-19	$1.08	1.60m	0.0226	47.5	-17.1	46.0	66.0	30.6	20.3	47.5
36		Claude Sonnet 5 (Non-reasoning, High Effort) Anthropic	2026-06-30	$0.422	1.74m	0.0089	47.3	-17.4	41.7	66.4	33.7	16.3	47.3
37		GPT-5.6 Sol (Non-reasoning) OpenAI	2026-07-09	$0.238	36s	0.0051	47.1	-17.6	41.2	65.1	34.9	13.8	47.1
38		DeepSeek V4 Pro (Reasoning, Max Effort) DeepSeek	2026-04-24	$0.0475	7.39m	0.0010	46.7	-18.0	44.3	59.4	36.4	6.8	46.7
39		MiniMax-M3 MiniMax	2026-06-01	$0.137	3.84m	0.0030	46.1	-18.5	44.4	58.6	35.4	11.4	46.1
40		Gemini 3.1 Pro Preview Google	2026-02-19	$0.339	1.72m	0.0074	45.6	-19.1	46.5	68.8	21.4	15.3	45.6
41		Kimi K2.6 Kimi	2026-04-20	$0.365	16.8m	0.0080	45.4	-19.2	44.2	61.8	30.3	15.6	45.4
42		DeepSeek V4 Pro (Reasoning, High Effort) DeepSeek	2026-04-24	$0.0432	5.97m	0.0010	45.4	-19.2	43.1	58.7	34.4	6.4	45.4
43		GPT-5.5 (low) OpenAI	2026-04-23	$0.260	34s	0.0058	44.9	-19.7	43.5	60.9	30.4	14.1	44.9
44		Kimi K2.7 Code Kimi	2026-06-12	$0.221	6.92m	0.0050	44.1	-20.5	41.9	60.8	29.6	13.5	44.1
45		MiMo-V2.5-Pro Xiaomi	2026-04-22	$0.0340	5.86m	0.0008	43.8	-20.8	42.2	60.2	29.1	5.3	43.8
46		Hy3 Tencent	2026-07-06	$0.0357	6.72m	0.0008	43.6	-21.1	41.2	58.8	30.7	5.5	43.6
47		GPT-5.6 Terra (low) OpenAI	2026-07-09	$0.0912	22s	0.0021	43.1	-21.6	40.5	58.1	30.6	9.6	43.1
48		DeepSeek V4 Flash (Reasoning, Max Effort) DeepSeek	2026-04-24	$0.0691	-	0.0016	42.5	-22.1	40.3	56.2	31.1	8.4	42.5
49		GPT-5.4 mini (xhigh) OpenAI	2026-03-17	$0.494	7.31m	0.0117	42.1	-22.6	40.0	56.1	30.2	16.9	42.1
50		GLM-5.1 (Reasoning) Z AI	2026-04-07	$0.273	5.56m	0.0065	41.9	-22.7	40.2	55.8	29.9	14.4	41.9
51		Inkling Small Thinking Machines	2026-07-30	$0.0733	3.13m	0.0018	41.3	-23.3	40.2	52.9	30.8	8.7	41.3
52		GPT-5.4 nano (xhigh) OpenAI	2026-03-17	$0.150	7.68m	0.0037	40.6	-24.0	38.2	56.1	27.5	11.8	40.6
53		Qwen3.6 Plus Alibaba	2026-04-02	$0.357	6.43m	0.0088	40.5	-24.1	39.6	54.5	27.6	15.5	40.5
54	✓	GPT-5.6 Luna (medium) OpenAI	2026-07-09	$0.0113	25s	0.0003	39.9	-24.7	38.1	50.7	31.0	0.5	39.9
55		Grok Build 0.1 0616 SpaceXAI	2026-06-16	$0.223	3.45m	0.0056	39.8	-24.9	39.8	51.5	28.0	13.5	39.8
56		Qwen3.6 27B (Reasoning) Alibaba	2026-04-22	$0.293	7.21m	0.0075	39.3	-25.4	37.1	53.7	27.0	14.7	39.3
57	✓	MiMo-V2.5 Xiaomi	2026-04-22	$0.0104	3.37m	0.0003	39.2	-25.4	37.2	56.8	23.7	0.2	39.2
58		GPT-5.5 (Non-reasoning) OpenAI	2026-04-23	$0.206	26s	0.0053	39.2	-25.4	35.4	56.5	25.8	13.1	39.2
59		DeepSeek V4 Flash (Reasoning, High Effort) DeepSeek	2026-04-24	$0.0505	-	0.0013	39.2	-25.4	37.5	52.0	28.2	7.0	39.2
60		Qwen3.7 Plus Alibaba	2026-06-01	$0.226	6.48m	0.0059	38.5	-26.1	39.0	55.9	20.8	13.5	38.5
61		GPT-5.6 Terra (Non-reasoning) OpenAI	2026-07-09	$0.103	21s	0.0027	38.5	-26.1	34.0	52.3	29.3	10.1	38.5
62		Nemotron 3 Ultra 550B A55B (Reasoning) NVIDIA	2026-06-04	$0.376	2.76m	0.0099	38.1	-26.5	37.8	49.3	27.4	15.8	38.1
63		Claude 4.5 Sonnet (Reasoning) Anthropic	2025-09-29	$0.462	4.89m	0.0122	37.7	-26.9	36.4	52.1	24.6	16.6	37.7
64		Gemini 3.5 Flash-Lite Google	2026-07-21	$0.0961	34s	0.0026	37.5	-27.1	36.5	49.3	26.8	9.8	37.5
65		GPT-5.1 (high) OpenAI	2025-11-13	$0.300	3.56m	0.0084	35.8	-28.9	36.9	49.4	21.0	14.8	35.8
66		GLM-4.7 (Reasoning) Z AI	2025-12-22	$0.353	3.66m	0.0101	34.8	-29.9	33.7	45.3	25.4	15.5	34.8
67		Grok 4.3 (high) SpaceXAI	2026-04-30	$0.145	1.86m	0.0042	34.6	-30.0	37.6	42.2	24.1	11.6	34.6
68		Kimi K2.5 (Reasoning) Kimi	2026-01-27	$0.0957	4.44m	0.0028	34.6	-30.0	35.4	46.8	21.7	9.8	34.6
69	✓	GPT-5.6 Luna (low) OpenAI	2026-07-09	$0.00883	16s	0.0003	34.3	-30.4	33.3	44.2	25.4	0.0	34.3
70		Qwen3.5 397B A17B (Reasoning) Alibaba	2026-02-16	$0.359	3.79m	0.0106	33.9	-30.7	33.7	48.2	19.8	15.5	33.9
71		LongCat 2.0 LongCat	2026-06-29	$0.122	6.99m	0.0036	33.5	-31.1	33.5	45.3	21.8	10.9	33.5
72		Qwen3.6 27B (Non-reasoning) Alibaba	2026-04-22	$0.396	3.28m	0.0118	33.5	-31.2	30.5	46.6	23.3	16.0	33.5
73		Qwen3.5 122B A10B (Reasoning) Alibaba	2026-02-24	$0.257	2.11m	0.0078	32.9	-31.7	32.3	45.7	20.7	14.1	32.9
74		GPT-5 (high) OpenAI	2025-08-07	$0.257	2.85m	0.0079	32.7	-31.9	34.7	37.8	25.7	14.1	32.7
75		Mistral Medium 3.5 Mistral	2026-04-29	$0.460	2.77m	0.0144	31.9	-32.7	29.9	46.9	19.0	16.6	31.9
76		Qwen3.6 35B A3B (Reasoning) Alibaba	2026-04-16	$0.194	3.38m	0.0061	31.6	-33.0	31.6	41.9	21.4	12.9	31.6
77		Ring-2.6-1T InclusionAI	2026-05-08	$0.366	-	0.0119	30.8	-33.9	30.6	42.8	18.9	15.6	30.8
78		GLM-4.6 (Reasoning) Z AI	2025-09-30	$0.302	5.38m	0.0098	30.7	-33.9	28.7	45.8	17.7	14.8	30.7
79		Step 3.7 Flash StepFun	2026-05-29	$0.0906	1.72m	0.0030	30.5	-34.2	30.3	39.6	21.5	9.6	30.5
80		Claude 4.5 Haiku (Reasoning) Anthropic	2025-10-15	$0.216	3.02m	0.0072	30.0	-34.7	29.6	43.9	16.4	13.4	30.0
81		GPT-5.6 Luna (Non-reasoning) OpenAI	2026-07-09	$0.0118	14s	0.0004	29.3	-35.4	26.6	39.3	22.0	0.7	29.3
82		Qwen3.5 122B A10B (Non-reasoning) Alibaba	2026-02-24	$0.193	1.03m	0.0067	28.9	-35.7	27.6	43.3	15.8	12.9	28.9
83		Grok 4.3 (Non-reasoning) SpaceXAI	2026-04-30	$0.294	1.29m	0.0107	27.6	-37.1	24.8	35.2	22.8	14.7	27.6
84		GPT-5.5 Instant (June 2026) OpenAI	2026-06-25	$0.537	13s	0.0203	26.4	-38.2	28.9	39.4	11.0	17.3	26.4
85		Gemma 4 26B A4B (Reasoning) Google	2026-04-02	$0.0439	-	0.0017	25.3	-39.3	25.7	39.3	11.0	6.4	25.3
86		Qwen3.5 35B A3B (Non-reasoning) Alibaba	2026-02-24	$0.241	1.22m	0.0099	24.3	-40.4	24.0	37.0	11.8	13.8	24.3
87		NVIDIA Nemotron 3 Super 120B A12B (Reasoning) NVIDIA	2026-03-11	$0.231	3.02m	0.0097	23.9	-40.7	25.4	37.7	8.7	13.6	23.9
88		Qwen3.6 35B A3B (Non-reasoning) Alibaba	2026-04-16	$0.630	1.73m	0.0265	23.8	-40.8	24.2	28.1	19.1	18.0	23.8
89		gpt-oss-120b (high) OpenAI	2025-08-05	$0.0750	3.20m	0.0033	22.5	-42.2	23.8	30.4	13.2	8.8	22.5
90		Gemini 2.5 Pro Google	2025-06-05	$0.215	1.42m	0.0098	22.1	-42.6	25.8	33.3	7.1	13.3	22.1
91		Qwen3 Coder Next Alibaba	2026-02-03	$0.334	1.92m	0.0152	22.0	-42.6	21.1	36.2	8.8	15.2	22.0
92		Gemini 3.1 Flash-Lite Google	2026-03-03	$0.0431	1.04m	0.0020	22.0	-42.7	25.0	34.7	6.2	6.3	22.0
93		Gemma 4 31B (Non-reasoning) Google	2026-04-02	$0.0382	1.19m	0.0017	22.0	-42.7	21.8	33.2	11.0	5.8	22.0
94		Nova 2.0 Pro Preview (medium) Amazon	2025-11-27	$0.183	1.71m	0.0088	20.9	-43.7	21.8	34.0	7.0	12.6	20.9
95		Mercury 2 Inception	2026-02-20	$0.0793	36s	0.0038	20.7	-43.9	21.4	31.1	9.6	9.0	20.7
96		Gemma 4 12B (Reasoning) Google	2026-06-03	$0.0763	3.75m	0.0038	20.2	-44.4	21.8	31.0	7.9	8.8	20.2
97		GPT-5 mini (high) OpenAI	2025-08-07	$0.0361	2.26m	0.0018	20.1	-44.6	25.3	15.6	19.4	5.6	20.1
98		Qwen3.5 9B (Reasoning) Alibaba	2026-03-02	$0.243	6.79m	0.0127	19.2	-45.5	21.4	28.7	7.4	13.9	19.2
99		Nova 2.0 Pro Preview (low) Amazon	2025-11-27	$0.227	44s	0.0131	17.3	-47.3	19.6	25.9	6.4	13.6	17.3
100		Mistral Small 4 (Reasoning) Mistral	2026-03-16	$0.101	2.18m	0.0059	17.0	-47.7	19.6	26.6	4.7	10.0	17.0