Gemma 4 12B (Reasoning)

gemma-4-12b · 81 samples · combined / raw

Score over time

Cost over time

Run?	Fetched?	Score?	Quality?	Cost?	Intel?	Code?	Agent?	MMMU%?
#627	2026-06-15 22:00:12	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#626	2026-06-15 21:00:12	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#625	2026-06-15 18:00:13	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#624	2026-06-15 17:00:12	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#623	2026-06-15 16:00:13	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#622	2026-06-15 15:00:12	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#621	2026-06-15 13:00:12	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#620	2026-06-15 12:00:13	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#619	2026-06-15 11:00:10	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#618	2026-06-15 10:00:09	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#617	2026-06-15 09:00:11	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#616	2026-06-15 08:00:10	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#615	2026-06-15 07:00:10	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#614	2026-06-15 06:00:10	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#613	2026-06-15 05:00:09	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#612	2026-06-15 04:00:10	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#611	2026-06-15 03:00:10	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#610	2026-06-15 02:00:08	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#609	2026-06-15 01:00:09	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#608	2026-06-15 00:00:09	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#607	2026-06-14 23:00:09	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#606	2026-06-14 22:00:10	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#605	2026-06-14 21:00:09	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#604	2026-06-14 20:00:09	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#603	2026-06-14 19:00:08	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#602	2026-06-14 18:00:09	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#601	2026-06-14 17:00:10	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#600	2026-06-14 16:00:09	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#599	2026-06-14 15:00:10	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#598	2026-06-14 14:00:10	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#597	2026-06-14 13:00:10	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#596	2026-06-14 12:00:09	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#595	2026-06-14 11:00:10	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#594	2026-06-14 10:00:10	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#593	2026-06-14 09:00:10	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#592	2026-06-14 08:00:10	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#591	2026-06-14 07:00:11	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#590	2026-06-14 06:00:09	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#589	2026-06-14 05:00:08	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#588	2026-06-14 04:00:09	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#587	2026-06-14 03:00:09	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#586	2026-06-14 02:00:10	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#585	2026-06-14 01:00:09	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#584	2026-06-14 00:00:10	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#583	2026-06-13 23:00:09	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#582	2026-06-13 22:00:09	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#581	2026-06-13 21:00:11	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#580	2026-06-13 20:00:11	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#579	2026-06-13 19:00:14	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#578	2026-06-13 17:00:18	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#577	2026-06-13 16:00:19	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#576	2026-06-13 14:00:19	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#575	2026-06-13 13:00:19	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#574	2026-06-13 12:00:18	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#573	2026-06-13 11:00:17	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#572	2026-06-13 10:00:18	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#571	2026-06-13 09:00:18	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#570	2026-06-13 07:00:17	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#568	2026-06-13 05:00:18	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#567	2026-06-13 03:00:17	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#566	2026-06-13 02:00:17	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#565	2026-06-13 01:00:18	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#564	2026-06-12 22:00:18	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#563	2026-06-12 21:00:18	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#562	2026-06-12 18:00:20	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#561	2026-06-12 17:00:17	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#560	2026-06-12 02:00:17	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#559	2026-06-12 01:00:17	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#558	2026-06-12 00:00:17	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#557	2026-06-11 21:00:18	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#556	2026-06-11 20:00:19	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#555	2026-06-11 15:00:21	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#554	2026-06-11 14:00:18	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#553	2026-06-11 11:00:18	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#552	2026-06-11 10:00:18	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#551	2026-06-11 06:00:20	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#550	2026-06-11 05:00:18	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#549	2026-06-11 03:00:18	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#548	2026-06-11 02:00:17	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#547	2026-06-11 01:00:18	26.2	26.2	$48.9	29.2	24.9	24.6	69.7
#546	2026-06-11 00:00:17	26.2	26.2	$48.9	29.2	24.9	24.6	69.7