Intelligence

Asynchronous workers, extraction, embeddings, deletion orchestration, and billing rollups.

The intelligence layer runs work that must not block the proxy: session extraction, memory writes, embeddings, organization deletion, billing reconciliation, maintenance, and MCP audit fan-out.

Provisional Ledger class: provisional
Verified 2026-10-21Several tasks are implemented; queue durability and exactly-once projection are not certified

Pages

  • Workers — queues, task families, dead letters, and enqueue admission.
  • Extraction — provider adapters, quality evaluation, and manual vLLM limits.
  • Embedder — CPU stub, TEI, hosted backends, and readiness geometry.
  • Extraction evaluation — gold set, cassette replay, contract gates, and regression limits.

What is implemented

CapabilityStatusBoundary
Session extraction and memory writesIMPLEMENTEDCassette and unit evidence; live vLLM is manual
OpenAI and vLLM extraction providersIMPLEMENTEDvLLM has no CI GPU runner
Embedding profiles (cpu, gpu, hosted)IMPLEMENTEDCPU stub is not a quality model
Organization deletion orchestrationIMPLEMENTEDFull deletion certification remains open
Billing reconciliation and rollupsIMPLEMENTEDHosted reconciliation evidence open
Dead-letter persistence, metrics, OTelIMPLEMENTEDAlert rules exist; runbook practice is separate
Scheduled maintenance sweepDEFERREDRegistered as a no-op, not business logic

Queue layout

QueuePurposePriority
extractionSession turns to memoriesFirst
embeddingAsync vector workSecond
maintenanceBeat sweeps and housekeepingThird
mcp_auditMCP tool-call audit fan-outLast

Redis DB allocation is deliberate: cache 0, Celery broker 1, rate limiting 2, results 3. Do not collapse them into one database.

Non-negotiable boundary

A queued task is not a completed effect. Extraction can be retried, enqueue can be idempotent, and dead letters can be persisted, but the system does not currently claim exactly-once projection into every downstream store. Read Evidence and relay before treating an async side effect as durable.