diff options
| author | Adam Malczewski <[email protected]> | 2026-06-05 13:07:23 +0900 |
|---|---|---|
| committer | Adam Malczewski <[email protected]> | 2026-06-05 13:07:23 +0900 |
| commit | c48d8ac7160c3cdcf32ed4e488807d3daeb8d457 (patch) | |
| tree | 1fccd7f35f051d8bae6bc8c6c5e3ffa22e816d0b /tasks.md | |
| parent | 94dd5334b0277f3cf3b0588150a6615af86a32b3 (diff) | |
| download | dispatch-c48d8ac7160c3cdcf32ed4e488807d3daeb8d457.tar.gz dispatch-c48d8ac7160c3cdcf32ed4e488807d3daeb8d457.zip | |
feat(observability): Phase A logging substrate — Logger/Span ABI + journal sink (250 tests)
Structured, agent-first logging captured durably to an append-only journal file.
Kernel (contracts/logging.ts): leveled/attributed Logger + Span, auto-scoped per extension (host stamps manifest.id, unspoofable), incremental span records (open/close) for crash-reconstructable traces, injected LogSink (pure record-builder). ctx.log on ToolContract; runTurn opens turn/step/tool-call spans and captures the verbatim pre-mutation prompt (the 'before') on the step span.
journal-sink (new package, bootstrap dep — not an extension): LogSink appending NDJSON to a rotating journal; pure serialize + thin fs edge; fail-safe drop, never blocks a turn. host-bin injects it via HostDeps; session-orchestrator threads host.logger (childed per turn) into runTurn.
Redaction is per-extension self-redaction (no shared helper — isolation over DRY). The out-of-process collector + SQLite store + the verbatim 'after' provider.request capture are Phase B / next (notes/observability-design.md §10/§11).
Verified: tsc -b clean, 250 tests (218→+32), biome clean. Live boot: a turn's journal holds host logs + turn/step spans (open+close) + the prompt:before record with the verbatim messages array.
Harness: ORCHESTRATOR §3 rule-scoping map; .dispatch/rules/isolation-over-dry.md; notes/observability-design.md (design D1–D10 + Phase A/B plan).
Diffstat (limited to 'tasks.md')
| -rw-r--r-- | tasks.md | 36 |
1 files changed, 36 insertions, 0 deletions
@@ -154,3 +154,39 @@ extension (read_file), hygiene CRs (getHostAPI + manifest honesty), and the tabId→conversationId vocab rename. typecheck + biome clean; 218 tests green. Remaining work is the parked design decisions (persistent waking agents, etc.) — non-blocking. See HANDOFF.md "Open design decisions still parked". + +--- + +## Observability — Phase A (logging substrate) ✅ DONE + verified live +Goal: structured logs + spans captured durably to a journal file — the substrate +for the agent-first observability subsystem (design: notes/observability-design.md). + +- [x] **Unit 1 — kernel-logging** (mimo-v2.5-pro): Logger/Span ABI + (`contracts/logging.ts`) — leveled/attributed/auto-scoped (host stamps + `extensionId`), incremental span records (open/close, crash-reconstructable, D3), + injected `LogSink` (pure record-builder). `ctx.log` on ToolContract; runTurn + opens turn/step/tool-call spans + the verbatim **"before"** prompt on the step span. +- [x] **Unit 2 — journal-sink** (`packages/journal-sink/`, mimo-v2.5-pro): bootstrap + `LogSink` → NDJSON append-only journal (pure `serialize` + thin fs edge, rotation, + fail-safe drop — never blocks a turn). NOT an extension (HostDeps bootstrap dep). +- [x] **Orchestrator fan-out + wiring** (direct): bus error-attrs `{ err }`, + FakeLogger/`ctx.log` test conformance; host-bin injects `logSink`+`logDeps` + (journal at `.dispatch/journal/`); session-orchestrator threads `host.logger` + (childed per turn) into runTurn. + +**Result:** typecheck clean, **250 tests** (218 → +22 journal-sink, +10 kernel), +biome clean. **Live boot verified:** a turn's journal contains host logs + turn/step +spans (open+close) + the `prompt:before` record carrying the verbatim messages array +— the pre-mutation prompt is fully reconstructable. 2-process model: app + in-process +sink → journal file; the collector (process 2) is Phase B. Redaction is +per-extension self-redaction (no shared helper — isolation over DRY). + +### Next (observability) +- **"AFTER" capture** — `provider.request` verbatim post-transform in + provider-openai-compat → full round-trip rebuild + before↔after diff (§10). +- Minor refinement: move the large `prompt:before` payload from `attributes` into the + record `body` field (store-fat-serve-thin) — currently a stringified attribute. +- Phase B: out-of-process collector → SQLite store + query (§11). + +Summons: prompts/phase-a-{kernel-logging,journal-sink}.md; +reports/phase-a-{kernel-logging,journal-sink}.md. |
