Parity Subagent 3 (CFA + Gradeboard + V-703 + V-704) — Result
Subagent ID: a5348bd9b10fe0d8b
Duration: ~12 min (740s)
Artifact branch: claude/parity-artifacts-2026-05-17-eval-subagent @ 26d91e9b
V-704 audit doc: vault 0ad8e68e — docs/audits/AGENTIC_EVAL_LIVE_2026-05-17.md
Result per V-task
| V-task | Score | Acceptance | State |
|---|---|---|---|
| V-701 CFA suite | 17/20 (85%) | target ~90% (≥28/31 spec) | VERIFYING-PARTIAL |
| V-702 gradeboard | 5.00/5.00 | target ≥4.51 | VERIFYING (structural ceiling) |
| V-703 ORG BLACKBERRY | 0 cited / 13 real available | target ≥3 | VERIFYING-PARTIAL (planner gap) |
| V-704 audit doc | ✅ written | doc in vault | VERIFYING |
V-703 THE BIG FINDING — Agent Planner Gap
Real data exists: Direct Neon query against nathel-prod (project wispy-mud-49174151) confirms 13 distinct ORG BLACKBERRY events since 2026-05-09:
- 2 canonical
signal.pp_arrival_loggedevents for HOMEGROWN ORGANIC FARMS:55a94b35-6d78-44ab-8cc7-ed6b92b143df7e0917c5-964d-419e-8b2b-7c3de203c65f
- 1
health.daily_reconciliationevent55a94b35-5b32-4a77-bf5c-4e1bea62d4ac - Plus
ingest.pdf_extracted,resolver.candidate_created/pending_review/arrival_reconciled,inbound.load_conflict_pending(60 vs 48 cs conflict),lot.pre_arrival_synthesized(lot 91325068 / TLC-20260513-af5tjqbj),inbound.load_expected,work.thread_created(qc_case for load 00267096)
Agent retrieved: Only get_commodity_profile(blackberry, nathel) invoked. Never called get_events, lookup_inventory, walk_provenance, or any operational-layer tool. Zero event_ids cited.
This is exactly the canonical “Living-Wiki commodity drill-through” planner gap from project memory: primitives exist, wiring missing. The agent’s planner doesn’t fan out to operational events when answering “X arrivals from Y this past week” queries.
5 New B-followups
| # | Priority | Bug |
|---|---|---|
| 1 | HIGH | get_market_brief 21801ms statement timeout — real DB perf bug, NEW (not V-113) |
| 2 | HIGH | Agent planner does not fan out to get_events + lookup_inventory + walk_provenance for “X arrivals from Y this past week” queries — only invokes get_commodity_profile. This blocks V-703 from passing even though real data exists. |
| 3 | MED | CFA probe count drift: spec says 31 probes, codebase has 20. Either author the 11 missing probes OR amend spec to ≥18/20 |
| 4 | MED | CFA get_actor_context 403 cross-tenant — Josh Garcia persona probes for tenant=fin-central; bind probe args to persona tenant |
| 5 | LOW | Deploy metadata reports staging=degraded while all health probes pass — metadata cleanup needed |
What to do when you return
- Read full V-704 audit at
docs/audits/AGENTIC_EVAL_LIVE_2026-05-17.md(vault@0ad8e68) - Triage finding #2 (agent planner gap) — this is the highest-value lift; closing it materially improves V-703 score
- Triage finding #1 (get_market_brief timeout) — production hot-path tool
- Decide: promote V-702 to COMPLETED (structural PASS) and keep V-701/V-703/V-704 as VERIFYING-PARTIAL with the B-followups blocking promotion