Actuary
← Google Gemini 3.5 Flash

Evidence block

Instruction following · cycle 24

google/gemini-3.5-flash · 2026-08-04 16:57:20 UTC

This page is the full public record of one completed panel — the record’s hash-committed unit of evidence. Its identity is its hash; nothing here can change without changing the URL.

Identity

What this block is.

Panel mean
0.800
Members
5
Checker scored
4
Frozen floor
0.700
Anytime level α
0.050
Hashes and versions
Evidence hash
16d71bfee604b6a80c830d34db5f5103a360fc695e5c2d5a02a0bb283a435034
Design hash
4f5cc6b9ff4ce026ccab93f5a3c8241f78eb005bc8b8068e4c701e9236504412
Panel hash
e7dfea1f343f7bf37e066a1117ca21f3438e804ad61437bf72d810640cef7e71
Stream
72a90aa5-d8b7-420a-812c-914bd0506dfc
Epoch
0c9c936b-596a-49fb-bf5d-7874c4916a76
Pool version
instruction_following-v3
Checker version
instruction_following-v1
Panel size
5
Provider spend
$0.0490395

Checker layer

Panel members.

# Item Item id Outcome Score
1 instruction-following-015 26a44f13-e4a8-4273-9cfd-5adce0f3eec9 ok 1.00
2 instruction-following-045 462a27a2-2b9a-417e-b2c3-b20776fad9a0 ok 1.00
3 instruction-following-075 38ede11b-3d52-4905-a6a4-8ee6684146e4 truncated 0.00
4 instruction-following-105 9294d9d8-5c71-4d76-b053-b5cefc08d0e1 ok 1.00
5 instruction-following-135 7d213d46-039d-4f3a-aecf-c785ef61cc80 ok 1.00

Deterministic checkers score every response in [0, 1]; a member that ends in a terminal failure scores 0 and stays on the record. Item text stays unpublished so nobody can tune against the panel — identity travels as the item id and its pool source id.

Capture layer

Provider requests.

# Provider Upstream Response model Response id Finish Latency ms Tokens in Tokens out Cost Output SHA-256 Observed
1 openrouter Google google/gemini-3.5-flash gen-1785862605-BuN576kJOJ5PAXZdGAwP stop 5672 40 1205 $0.010905 c854bdab260418080be4535ba30b3ae463f380b75af90364fd1d89288aadf251 2026-08-04 16:56:51 UTC
2 openrouter Google google/gemini-3.5-flash gen-1785862611-8ntpVJ4uE0lKHyf9axOo stop 3215 51 435 $0.0039915 fcc5ce047f7912486ef1a6fab4c7df803541e1770a5919c95683e21b48bb0d17 2026-08-04 16:56:54 UTC
3 openrouter 44 2044 $0.018462 2026-08-04 16:56:55 UTC
4 openrouter Google google/gemini-3.5-flash gen-1785862601-dMMK8qtfZTOZHpJ5M07i stop 5124 37 1012 $0.0091635 e5706b6994f6025d4b5505ba214178ed1857cb8749b9ecf145c7f7a7d32c3a29 2026-08-04 16:56:46 UTC
5 openrouter Google google/gemini-3.5-flash gen-1785862636-0YGumNbIcIsMeHxAmlSz stop 3312 49 716 $0.0065175 1ae4323e07007b052bb7f38ff4ab1ca0ef9e12498d537111ad88e9441ccde736 2026-08-04 16:57:20 UTC

Everything a probe captures, as captured. Raw model text is scrubbed thirty days after the run; its SHA-256, the outcome and the score are permanent. Costs are provider-reported and include reserved estimates where a run’s true cost was unrecoverable; a dash is a field the provider did not return.

Verify

Recompute the hash yourself.

The JSON twin of this page carries the exact evidence object this URL is named after. Canonicalise it per RFC 8785 and hash it; the digest must equal the address of this page.

GET /api/v1/evidence/16d71bfee604…

curl -s https://actuary.sh/api/v1/evidence/16d71bfee604b6a80c830d34db5f5103a360fc695e5c2d5a02a0bb283a435034 \
  | jq -cjS .evidence | shasum -a 256

For this object’s field types, jq -cjS reproduces RFC 8785 canonical form, and the JSON twin serves the hashed bytes verbatim. Blocks of exactly this shape appear verbatim in signed certificates — verify one offline, or read how the e-process turns panel means into an alarm.