Model monitor
Google Gemini 3.5 Flash
google/gemini-3.5-flash · via openrouter
Certified claim, per family: H0: E[panel_mean_t | prior completed panels] ≥ frozen_null_floor. Fixed panel composition does not assume or establish temporal independence. Recent panels below link to their hash-committed evidence.
Task family
Structured output
- Frozen null floor
- 0.700
- Anytime level α
- 0.050
- Completed panels
- 25
- CS lower
- 0.664
- CS upper
- 1.000
Panel record — 25 completed panels
| Cycle | Completed | Member scores | Mean | Evidence |
|---|---|---|---|---|
| 41 | 2026-08-05 10:56 UTC | 1.001.001.001.001.00 | 1.000 | a304708f2bb6… |
| 40 | 2026-08-05 09:49 UTC | 1.001.001.000.381.00 | 0.875 | 086ca22c7ebb… |
| 39 | 2026-08-05 08:47 UTC | 1.001.001.000.381.00 | 0.875 | bbfae844d171… |
| 38 | 2026-08-05 07:42 UTC | 1.001.001.001.001.00 | 1.000 | 97d9a3d0f0b4… |
| 37 | 2026-08-05 06:37 UTC | 1.001.001.001.001.00 | 1.000 | f4061b1aff5e… |
| 36 | 2026-08-05 05:33 UTC | 1.001.001.001.001.00 | 1.000 | 8c6c84d51578… |
| 35 | 2026-08-05 04:32 UTC | 1.001.001.001.001.00 | 1.000 | 50e1a90d4919… |
| 34 | 2026-08-05 03:32 UTC | 1.001.001.001.001.00 | 1.000 | 61c0bfee96a5… |
| 33 | 2026-08-05 02:29 UTC | 1.001.001.001.001.00 | 1.000 | 04635ad8dde8… |
| 32 | 2026-08-05 01:29 UTC | 1.001.001.001.001.00 | 1.000 | d75d23de298b… |
| 31 | 2026-08-05 00:26 UTC | 1.001.001.001.001.00 | 1.000 | b9c72fd407b6… |
| 30 | 2026-08-04 23:27 UTC | 1.001.001.001.001.00 | 1.000 | 86064e009a07… |
| 29 | 2026-08-04 22:26 UTC | 1.001.001.001.001.00 | 1.000 | 2c7c1408e08c… |
| 28 | 2026-08-04 21:24 UTC | 1.001.001.001.001.00 | 1.000 | ce7555893331… |
| 27 | 2026-08-04 20:24 UTC | 1.001.001.001.001.00 | 1.000 | f60a34612ae1… |
| 26 | 2026-08-04 19:26 UTC | 1.001.001.001.001.00 | 1.000 | e6b011f76afa… |
| 25 | 2026-08-04 18:21 UTC | 1.001.001.000.381.00 | 0.875 | 4b83dfea972a… |
| 24 | 2026-08-04 17:17 UTC | 1.001.001.000.381.00 | 0.875 | 2c96debd58b5… |
| 23 | 2026-08-04 16:14 UTC | 1.001.001.000.381.00 | 0.875 | a7017ceca53e… |
| 22 | 2026-08-04 15:10 UTC | 1.001.001.001.001.00 | 1.000 | 987afd816f72… |
| 21 | 2026-08-04 14:06 UTC | 1.001.001.000.381.00 | 0.875 | 3f032e8a95e4… |
| 20 | 2026-08-04 13:07 UTC | 1.001.001.001.001.00 | 1.000 | d1a5e1318dc0… |
| 19 | 2026-08-04 12:06 UTC | 1.001.001.001.001.00 | 1.000 | 6436463c1ece… |
| 18 | 2026-08-04 10:59 UTC | 1.001.001.001.001.00 | 1.000 | 5558dfc21966… |
| 17 | 2026-08-04 09:55 UTC | 1.001.001.000.381.00 | 0.875 | f4d03a50905e… |
Newest first. A failed member scores 0 and stays on the record. Each evidence link opens the panel’s full hash-committed record.
Epoch & design record
- Current epoch
9f8af8e9-4c0d-419a-a3a5-146898049eae- Opened
- 2026-08-04 09:39 UTC
- Design hash
251ec78748150632b474775f6c24f44183a634a960c4798ec4afd2f1150c4a1b- Panel hash
a37ad21aa4b8c3e16dbae958c68a70064a9d95487e131d832f2c601f7fdacf14- Pool hash
8e9496011afbb949e38b3facc664e6dd560f1c5d2155fd424fcb720d084c69ee- Panel size
- 5
- Terminal failure
- zero — a failed member scores 0 and stays on the record
- Pool version
structured-output-v3- Checker version
structured_output-v1- Reference mean μ₀
- 0.700
- Minimum effect δ
- 0.000
- Evidence log e
- -0.16 · max 0.00 · alarm at 3.00 (= ln 1/α)
- Raw scores kept
- 125
- Provider spend, this epoch
- $1.0915755
The persisted monitor state is the authority a certificate replays byte-for-byte; the chart band above is a faithful replay of the same recorded panel means. Spend sums completed probe runs and includes reserved estimates where a run’s true cost was unrecoverable.
Task family
Extraction
- Frozen null floor
- 0.700
- Anytime level α
- 0.050
- Completed panels
- 7
- CS lower
- 0.000
- CS upper
- 1.000
Panel record — 7 completed panels
| Cycle | Completed | Member scores | Mean | Evidence |
|---|---|---|---|---|
| 42 | 2026-08-05 11:31 UTC | 0.000.000.000.001.00 | 0.200 | 254c33241dbd… |
| 41 | 2026-08-05 10:24 UTC | 0.000.000.000.001.00 | 0.200 | 35ce701fae5b… |
| 40 | 2026-08-05 09:21 UTC | 0.000.000.000.001.00 | 0.200 | 04a05f498931… |
| 39 | 2026-08-05 08:17 UTC | 0.000.000.000.001.00 | 0.200 | 63adaf93d743… |
| 38 | 2026-08-05 07:12 UTC | 0.000.000.000.000.00 | 0.000 | e0da63cf8935… |
| 37 | 2026-08-05 06:08 UTC | 0.000.000.000.001.00 | 0.200 | 9dd6aaa18725… |
| 36 | 2026-08-05 05:07 UTC | 0.000.000.000.000.00 | 0.000 | f4b676636291… |
Newest first. A failed member scores 0 and stays on the record. Each evidence link opens the panel’s full hash-committed record.
Epoch & design record
- Current epoch
5e30d836-6801-4180-b298-3e76762bc40b- Opened
- 2026-08-05 04:05 UTC
- Previous epoch
7f3ce0cc-85af-4e9a-92b6-4cb22ed4b6bb- Transition
- operator_rebaseline_after_reference_repair
- Design hash
e55ca7ee9c5ca6e56d79fad4592ca4081f9aec3b7db6858fbae175ff51707258- Panel hash
1703e9221c9ce6ce1a9f69974cf0fd77056ac1ee4009dec47e3e6f23be2d4351- Pool hash
51802fc8964f7d9927bcabfae23b4bd2f0905e8977c9f8fb4ce50884ab0fbba6- Panel size
- 5
- Terminal failure
- zero — a failed member scores 0 and stays on the record
- Pool version
extraction-v3- Checker version
extraction-v1- Reference mean μ₀
- 0.700
- Minimum effect δ
- 0.000
- Evidence log e
- 3.88 · max 3.88 · alarm at 3.00 (= ln 1/α)
- Raw scores kept
- 35
- Provider spend, this epoch
- $0.1561455
The persisted monitor state is the authority a certificate replays byte-for-byte; the chart band above is a faithful replay of the same recorded panel means. Spend sums completed probe runs and includes reserved estimates where a run’s true cost was unrecoverable.
Task family
Instruction following
- Frozen null floor
- 0.700
- Anytime level α
- 0.050
- Completed panels
- 24
- CS lower
- 0.592
- CS upper
- 1.000
Panel record — 24 completed panels
| Cycle | Completed | Member scores | Mean | Evidence |
|---|---|---|---|---|
| 41 | 2026-08-05 10:32 UTC | 1.001.000.00 truncated1.001.00 | 0.800 | 4e39a43e45d0… |
| 40 | 2026-08-05 09:31 UTC | 1.001.001.001.001.00 | 1.000 | d5c6926fb620… |
| 39 | 2026-08-05 08:26 UTC | 1.001.000.00 truncated1.001.00 | 0.800 | 5a8b71193cfa… |
| 38 | 2026-08-05 07:22 UTC | 1.001.001.001.001.00 | 1.000 | 47c8b46ebedd… |
| 37 | 2026-08-05 06:23 UTC | 1.001.001.001.001.00 | 1.000 | 338f24ce6107… |
| 36 | 2026-08-05 05:22 UTC | 1.001.001.001.001.00 | 1.000 | ee97bffb3f45… |
| 35 | 2026-08-05 04:17 UTC | 1.001.001.001.001.00 | 1.000 | 41b843079624… |
| 34 | 2026-08-05 03:16 UTC | 1.001.001.001.001.00 | 1.000 | 6ec429c56338… |
| 33 | 2026-08-05 02:14 UTC | 1.001.001.001.001.00 | 1.000 | ea3b4d8c767a… |
| 32 | 2026-08-05 01:15 UTC | 1.001.001.001.001.00 | 1.000 | d3e1e880cd86… |
| 31 | 2026-08-05 00:10 UTC | 1.001.000.00 truncated1.001.00 | 0.800 | 194c74f6f497… |
| 30 | 2026-08-04 23:10 UTC | 1.001.000.00 truncated1.001.00 | 0.800 | 3fa2487603e0… |
| 29 | 2026-08-04 22:09 UTC | 1.001.000.00 truncated1.001.00 | 0.800 | eb35fc53a14f… |
| 28 | 2026-08-04 21:08 UTC | 1.001.000.00 truncated1.001.00 | 0.800 | 89a1cadc59ca… |
| 27 | 2026-08-04 20:08 UTC | 1.001.001.001.001.00 | 1.000 | 917d27af4e32… |
| 26 | 2026-08-04 19:04 UTC | 1.001.001.001.001.00 | 1.000 | 062a816cf898… |
| 25 | 2026-08-04 18:01 UTC | 1.001.001.001.001.00 | 1.000 | e44010181b2c… |
| 24 | 2026-08-04 16:57 UTC | 1.001.000.00 truncated1.001.00 | 0.800 | 16d71bfee604… |
| 23 | 2026-08-04 15:54 UTC | 1.001.000.00 truncated1.001.00 | 0.800 | 944a2ce3b42c… |
| 22 | 2026-08-04 14:49 UTC | 1.001.000.00 truncated1.001.00 | 0.800 | e811af1f6a35… |
| 21 | 2026-08-04 13:44 UTC | 1.001.000.00 truncated1.001.00 | 0.800 | 72e619e44960… |
| 20 | 2026-08-04 12:42 UTC | 1.001.000.00 truncated1.001.00 | 0.800 | 508db36a65db… |
| 19 | 2026-08-04 11:42 UTC | 1.001.001.001.001.00 | 1.000 | 28ab00bd0482… |
| 18 | 2026-08-04 10:41 UTC | 1.001.001.001.001.00 | 1.000 | 1ded1545fd3a… |
Newest first. A failed member scores 0 and stays on the record. Each evidence link opens the panel’s full hash-committed record.
Epoch & design record
- Current epoch
0c9c936b-596a-49fb-bf5d-7874c4916a76- Opened
- 2026-08-04 09:39 UTC
- Design hash
4f5cc6b9ff4ce026ccab93f5a3c8241f78eb005bc8b8068e4c701e9236504412- Panel hash
e7dfea1f343f7bf37e066a1117ca21f3438e804ad61437bf72d810640cef7e71- Pool hash
9c5d065322394a6fb18c6d7f90c5bb63f00781f3e4c4aaa663536f76bb8ba7f9- Panel size
- 5
- Terminal failure
- zero — a failed member scores 0 and stays on the record
- Pool version
instruction_following-v3- Checker version
instruction_following-v1- Reference mean μ₀
- 0.700
- Minimum effect δ
- 0.000
- Evidence log e
- -0.23 · max 0.00 · alarm at 3.00 (= ln 1/α)
- Raw scores kept
- 109
- Provider spend, this epoch
- $1.138365
The persisted monitor state is the authority a certificate replays byte-for-byte; the chart band above is a faithful replay of the same recorded panel means. Spend sums completed probe runs and includes reserved estimates where a run’s true cost was unrecoverable.
Task family
Code reasoning
- Frozen null floor
- 0.700
- Anytime level α
- 0.050
- Completed panels
- 25
- CS lower
- 0.699
- CS upper
- 1.000
Panel record — 25 completed panels
| Cycle | Completed | Member scores | Mean | Evidence |
|---|---|---|---|---|
| 41 | 2026-08-05 11:23 UTC | 1.001.001.001.001.00 | 1.000 | 9b2b679d0d1a… |
| 40 | 2026-08-05 10:19 UTC | 1.001.001.001.001.00 | 1.000 | a82dd45d9c21… |
| 39 | 2026-08-05 09:19 UTC | 1.001.001.001.001.00 | 1.000 | e62e5fac5799… |
| 38 | 2026-08-05 08:12 UTC | 1.001.001.001.001.00 | 1.000 | 8bcc1414c672… |
| 37 | 2026-08-05 07:07 UTC | 1.001.001.001.001.00 | 1.000 | 5df60659915e… |
| 36 | 2026-08-05 06:03 UTC | 1.001.001.001.001.00 | 1.000 | fd93b1dc2da3… |
| 35 | 2026-08-05 05:02 UTC | 1.001.001.001.001.00 | 1.000 | c64192bdf1da… |
| 34 | 2026-08-05 04:00 UTC | 1.001.001.001.001.00 | 1.000 | 8747b7bdc255… |
| 33 | 2026-08-05 03:00 UTC | 1.001.001.001.001.00 | 1.000 | be0f8798ba2c… |
| 32 | 2026-08-05 01:56 UTC | 1.001.001.001.001.00 | 1.000 | d1fb82a49314… |
| 31 | 2026-08-05 00:51 UTC | 1.001.001.001.001.00 | 1.000 | 230b00f75eea… |
| 30 | 2026-08-04 23:51 UTC | 1.001.001.001.001.00 | 1.000 | e47e8c1a7d69… |
| 29 | 2026-08-04 22:50 UTC | 1.001.001.001.001.00 | 1.000 | 2f09e44bd874… |
| 28 | 2026-08-04 21:41 UTC | 1.001.001.001.001.00 | 1.000 | 3582a872b297… |
| 27 | 2026-08-04 20:34 UTC | 1.001.001.001.001.00 | 1.000 | df8054e48fef… |
| 26 | 2026-08-04 19:20 UTC | 1.001.001.001.001.00 | 1.000 | 7422bc61f880… |
| 25 | 2026-08-04 18:16 UTC | 1.001.001.001.001.00 | 1.000 | 0b3fec2f541a… |
| 24 | 2026-08-04 17:13 UTC | 1.001.001.001.001.00 | 1.000 | 7e4a3789c19c… |
| 23 | 2026-08-04 16:09 UTC | 1.001.001.001.001.00 | 1.000 | 389cd9d057ba… |
| 22 | 2026-08-04 15:05 UTC | 1.001.001.001.001.00 | 1.000 | a593ab47eeac… |
| 21 | 2026-08-04 14:05 UTC | 1.001.001.001.001.00 | 1.000 | fdcdbb911499… |
| 20 | 2026-08-04 13:03 UTC | 1.001.001.001.001.00 | 1.000 | 4327acd94ca3… |
| 19 | 2026-08-04 12:03 UTC | 1.001.001.001.001.00 | 1.000 | 90b1d32ea852… |
| 18 | 2026-08-04 10:57 UTC | 1.001.001.001.001.00 | 1.000 | d37c17b35689… |
| 17 | 2026-08-04 09:54 UTC | 1.001.001.001.001.00 | 1.000 | 1d149298343c… |
Newest first. A failed member scores 0 and stays on the record. Each evidence link opens the panel’s full hash-committed record.
Epoch & design record
- Current epoch
762418be-c436-4cc4-b61e-feeea8c6386d- Opened
- 2026-08-04 09:39 UTC
- Design hash
bbc24079d942fddaf8dd5f81fb3bfc2a3fb81bc4d6433dc8cc7224205bdb08f6- Panel hash
827de544c7641d140ac37e321bdb2578a41e291915f519183abbc5bd68153e81- Pool hash
cbfba66601ff51f43c83017d6de9e49988afcee72235f5dca89d705f4f8bb4cc- Panel size
- 5
- Terminal failure
- zero — a failed member scores 0 and stays on the record
- Pool version
code_reasoning-v4- Checker version
code_reasoning-v1- Reference mean μ₀
- 0.700
- Minimum effect δ
- 0.000
- Evidence log e
- -0.23 · max 0.00 · alarm at 3.00 (= ln 1/α)
- Raw scores kept
- 125
- Provider spend, this epoch
- $1.481187
The persisted monitor state is the authority a certificate replays byte-for-byte; the chart band above is a faithful replay of the same recorded panel means. Spend sums completed probe runs and includes reserved estimates where a run’s true cost was unrecoverable.
Task family
Math
- Frozen null floor
- 0.700
- Anytime level α
- 0.050
- Completed panels
- 24
- CS lower
- 0.686
- CS upper
- 1.000
Panel record — 24 completed panels
| Cycle | Completed | Member scores | Mean | Evidence |
|---|---|---|---|---|
| 41 | 2026-08-05 10:27 UTC | 1.001.001.001.001.00 | 1.000 | 5cbddcfe572e… |
| 40 | 2026-08-05 09:24 UTC | 1.001.001.001.001.00 | 1.000 | 642f9212dbc6… |
| 39 | 2026-08-05 08:18 UTC | 1.001.001.001.001.00 | 1.000 | 32390cae7117… |
| 38 | 2026-08-05 07:17 UTC | 1.001.001.001.001.00 | 1.000 | 1f7756da505e… |
| 37 | 2026-08-05 06:10 UTC | 1.001.001.001.001.00 | 1.000 | 44f8b2e09bd1… |
| 36 | 2026-08-05 05:09 UTC | 1.001.001.001.001.00 | 1.000 | 82fa37aa27aa… |
| 35 | 2026-08-05 04:06 UTC | 1.001.001.001.001.00 | 1.000 | b36be05b014c… |
| 34 | 2026-08-05 03:09 UTC | 1.001.001.001.001.00 | 1.000 | 9a4051bbab24… |
| 33 | 2026-08-05 02:05 UTC | 1.001.001.001.001.00 | 1.000 | 0d71a63bedc2… |
| 32 | 2026-08-05 01:01 UTC | 1.001.001.001.001.00 | 1.000 | e21be1da165d… |
| 31 | 2026-08-04 23:56 UTC | 1.001.001.001.001.00 | 1.000 | abeb4557a84a… |
| 30 | 2026-08-04 22:57 UTC | 1.001.001.001.001.00 | 1.000 | 05b9a9ca54b2… |
| 29 | 2026-08-04 21:56 UTC | 1.001.001.001.001.00 | 1.000 | 21c67d916c1c… |
| 28 | 2026-08-04 20:54 UTC | 1.001.001.001.001.00 | 1.000 | 1c59e2d61aa9… |
| 27 | 2026-08-04 19:54 UTC | 1.001.001.001.001.00 | 1.000 | d53457efaac1… |
| 26 | 2026-08-04 18:51 UTC | 1.001.001.001.001.00 | 1.000 | 276559906987… |
| 25 | 2026-08-04 17:47 UTC | 1.001.001.001.001.00 | 1.000 | 262fae3d24cd… |
| 24 | 2026-08-04 16:48 UTC | 1.001.001.001.001.00 | 1.000 | 7a003c1483fd… |
| 23 | 2026-08-04 15:45 UTC | 1.001.001.001.001.00 | 1.000 | 0a3f63f9ca07… |
| 22 | 2026-08-04 14:40 UTC | 1.001.001.001.001.00 | 1.000 | 2f5b71c47861… |
| 21 | 2026-08-04 13:39 UTC | 1.001.001.001.001.00 | 1.000 | 8c2026256c3c… |
| 20 | 2026-08-04 12:38 UTC | 1.001.001.001.001.00 | 1.000 | 76ebb70b5435… |
| 19 | 2026-08-04 11:37 UTC | 1.001.001.001.001.00 | 1.000 | 8afa7ad4b7be… |
| 18 | 2026-08-04 10:32 UTC | 1.001.001.001.001.00 | 1.000 | f09d90da975f… |
Newest first. A failed member scores 0 and stays on the record. Each evidence link opens the panel’s full hash-committed record.
Epoch & design record
- Current epoch
8786c7c8-5693-483d-926c-6aae60af12a4- Opened
- 2026-08-04 09:39 UTC
- Design hash
fdf94065c55c2ee7d86701efc50be0f5abdc5f02a236f6df52c2ac6f7db801eb- Panel hash
882f3932d07aeb85c4f6406a550d8ad14512e70d3df2432fe7aab03d0508bc75- Pool hash
7ed49fa9a63ba0e0907ff8326de00a843a926618f6d0dec40aa8e491d041e99b- Panel size
- 5
- Terminal failure
- zero — a failed member scores 0 and stays on the record
- Pool version
math-v4- Checker version
math-v1- Reference mean μ₀
- 0.700
- Minimum effect δ
- 0.000
- Evidence log e
- -0.23 · max 0.00 · alarm at 3.00 (= ln 1/α)
- Raw scores kept
- 120
- Provider spend, this epoch
- $0.759051
The persisted monitor state is the authority a certificate replays byte-for-byte; the chart band above is a faithful replay of the same recorded panel means. Spend sums completed probe runs and includes reserved estimates where a run’s true cost was unrecoverable.