Concept register · Theme 03 of 14 6 concepts · 38 talks

assay  ·  concepts  ·  memory-and-dreaming

Memory and dreaming

Every session learns, and then dies. The frontier answer has two halves: markdown memory as a plain filesystem, and an out-of-band pass that mines session transcripts into evidence-cited proposals a human accepts or rejects.

assay: substrate shipped · dreaming designed

The dreaming pass — transcript mining as out-of-band learning — 21 sources, establishedFailure corpora and attributed mistake diaries — 7 sources, establishedMemory as a filesystem — 7 sources, establishedMemory curation, governance and forgetting — 7 sources, establishedStructured memory substrates — 5 sources, establishedPromotion-based knowledge curation — 3 sources, corroborated
6 concepts · 50 independent sources · 5 established

§1What it is

The state of the art is boring, deliberately

After a year of trying special-purpose memory tools, the production recipe described at the conference is plain: markdown files in a directory, agents searching them with ordinary tools, autonomy on writes, a fast index. What made it work at fleet scale were the guardrails around it — versioning with provenance (which session motivated this change, and who made it), concurrency control on writes, and permission tiers from read-only shared knowledge down to per-agent scratch space.

Why in-session memory is not enough

Two structural limits: split focus (an agent doing a task and curating memory simultaneously does both worse), and a visibility ceiling — a session only sees itself, so a failure pattern that recurs across the fleet is invisible to every individual agent. The fix is a second-order process that runs out of band, with its own budget.

Dreaming, as demonstrated in production

An orchestrator deploys sub-agents over a batch of session transcripts — tool calls included, not just chat — and looks for prevalent patterns: repeated failures, missing knowledge, misconfigured tools. It then proposes individual memory edits, each citing the transcripts where the pattern occurred and how often it occurred. A human accepts or rejects each proposal. Nothing lands unreviewed. One worked example: every session failing the same way traced to a tool configured in radians instead of degrees — a fix visible only in transcripts.

The surrounding reference implementations

Capture-then-distill pipelines that hash-chain sessions and mine failures and successes into draft skills a human reads before shipping. Reviewed, confidence-scored knowledge units that graduate from personal to team to shared, with agents validating a unit before acting on it and confirming or flagging it after. Promotion-based curation: capture everything privately, promote the rare dense result outward. And attributed mistake diaries, replayed as regression tests — one team turned a failure recurring in two-thirds of runs into a consistent pass by loading the lessons.


§2The concepts in this theme

Each concept has its own page in the concept register — with sightings from every event we review, and where Assay stands on each.


§3How Assay implements this

The substrate is shipped

Per-project memory lives as markdown with a one-line-per-entry index — the filesystem recipe, arrived at independently. The operating rule "refresh, don't remember" re-reads state every cycle rather than trusting recall, which is the visibility-ceiling answer applied at cycle scale.

Registers are the attributed layer

The registers give fleet learning a durable, citable shape: per-entry record files, append-only, tamper-evident, linkable from anywhere. The conference's mistake diaries are the closest analogue — without the deletion detection.

Git is the concurrency and provenance layer

The production implementations hand-roll hash-based compare-and-swap for concurrent memory writes. Assay's memory already lives in git, where a rejected stale write is the compare-and-swap, history is provenance for free, and a proposal arriving as a pull request inherits both the accept/reject decision and the human merge gate.

The dreaming pass is designed, not yet shipped

Assay's design for the consolidation pass — out-of-band transcript mining proposing evidence-cited memory updates through review — predates the conference but has not been built. What the talks changed is its status: three independent reference implementations now exist, which converts it from a research bet into a build item. Two requirements the references added to the design: keep attribution through distillation (the rendered rule must cite the incident that paid for it), and treat transcripts as untrusted input — they were mined from sessions that handled untrusted content, so proposals derived from them inherit that provenance.


§4Talks that cover this theme