Shared Memory and AI Knowledge Infrastructure, Explained
Shared memory means many agents and teams read from one knowledge layer instead of each keeping a private store. It requires four things a per-agent memory does not need: provenance on every chunk, a freshness policy, access boundaries, and a retrieval contract stable enough to outlive the tools that use it.
Why per-agent memory does not scale to an organization
One team gives their agent a memory store. It works, so a second team does the same, then a third. Within a year you have a dozen memory stores holding overlapping, quietly contradictory versions of the same institutional knowledge.
This is the data silo problem, rebuilt with worse properties. A traditional silo at least has an owner, a schema, and someone who notices when it goes stale. An agent memory store accumulates whatever passed through one team's sessions, in a shape nobody chose deliberately, with no review process and no way to tell which of two conflicting entries is current.
The symptom shows up as agents in different teams giving different answers to the same question, each confident, each retrieving from its own store. Support says one thing, sales says another, and the engineering agent has a third version from an internal doc that was superseded in March. Nobody can reconstruct why, because the reasoning is spread across three private stores.
Shared knowledge infrastructure is the alternative: one layer many agents read, with the properties that make shared systems trustworthy.
The four properties shared knowledge needs
A private memory store can be sloppy because only one agent depends on it. A shared one cannot.
Provenance. Every retrieved chunk should carry where it came from and when. Agents will answer from it, humans will act on those answers, and the first question anyone asks about a surprising answer is where it came from. Retrieval that returns text without a source is a rumor mill with good latency.
Freshness. Institutional knowledge changes: pricing, policy, architecture, who owns what. The store needs a rule for what happens when new information contradicts old, and a way to retire what is no longer true. Without it, retrieval quality degrades quietly as the index grows, because the stale chunk still matches the query.
Access boundaries. Shared does not mean everything is visible to everyone. Salary bands, security procedures, and unreleased plans need to be retrievable by the right agents and invisible to the rest, and that boundary has to hold at retrieval time rather than being a policy nobody enforces.
A stable contract. Agents query through an interface. That interface will outlive several generations of agent tooling, so it should be simple, documented, and independent of any framework's schema.
Write the knowledge for retrieval, not for a reader
A forty-page document retrieves badly. The chunk that matches a query brings back a fragment torn from its context, and the surrounding conditions that make it correct get left behind. Knowledge written for a shared layer works better in small self-contained units: one claim, its conditions, its source, and the date it was last confirmed. That is closer to how a good incident write-up reads than how a company handbook reads.
Curation is a real job, and a small one
Shared knowledge needs someone to notice when two chunks conflict and decide which survives. This is much less work than maintaining documentation, because the trigger is a real retrieval producing a wrong answer rather than a quarterly review of everything. Treat contradictions as bugs with an owner, and the store stays trustworthy at a fraction of the cost of a docs program.
What shared memory changes about how agents behave
The obvious gain is consistency. Two agents reading the same chunk give the same answer, which sounds modest until you have watched three departments act on three versions of one policy.
The less obvious gain is that work stops being repeated. When one team's agent works out how a subsystem behaves and that finding lands in the shared layer, no other agent has to derive it again. In a per-agent world that derivation happens once per team, per agent, per session, forever, and every repetition costs tokens and produces a slightly different conclusion.
The third gain is that onboarding an agent becomes trivial. A new agent, or a new tool entirely, points at the same layer and starts with everything the organization knows, rather than spending its first weeks reconstructing context from code and hoping it guesses right.
How RDK implements this
RDK is a distributed knowledge network built on exactly this shape. Files from local vaults, notes, docs, code, are indexed as encrypted private chunks on the RDK network. Encryption is the default for private material, which is what makes a genuinely shared layer possible: teams will only put real operational knowledge somewhere they control the access boundary.
Because the network is not owned by an agent framework, the retrieval contract is the stable interface. Any agent that can call a retrieval tool reads the same chunks. Your coding agent, your support agent, and the internal service you build next quarter all query one layer, and replacing any of those tools costs nothing in accumulated knowledge.
Stacked retrieval is where the economics land. A private index answers 40 to 65 percent of queries, the public network of published chunks adds another 15 to 20 percent, and the LLM handles the remaining 5 to 10 percent as fallback, so token spend drops 80 to 90 percent. At organizational scale that ratio is the difference between agent adoption being a line item you defend and one that pays for itself.
There is also a layer above your own knowledge. Chunks published to the public network are retrievable by other agents, and their authors earn USDC per retrieval. That is the environmental argument in practical form: one well-written work product serves a million agents through retrieval instead of a million identical inference calls regenerating the same answer.
Start with one team and one recurring question
Do not begin with a knowledge management program. Find a question your agents answer wrong or inconsistently, write the correct answer as a small chunk with its source and date, index it, and confirm that every agent now returns it. One resolved contradiction demonstrates the whole model better than a strategy document, and the store grows from real failures rather than from someone's inventory of what should be documented.
Frequently asked questions
- What is shared memory for AI agents?
- One knowledge layer that many agents and teams read from, instead of each agent keeping a private store. It needs properties a private memory does not: provenance on every chunk, a freshness policy, access boundaries enforced at retrieval time, and an interface stable enough to outlive the agent tools that query it.
- What goes wrong with per-team agent memory?
- It rebuilds data silos with worse properties. Each store accumulates whatever passed through one team's sessions, with no owner, no schema anyone chose, and no way to tell which of two conflicting entries is current. The symptom is agents in different teams confidently giving different answers to the same question.
- Why does provenance matter so much in a shared knowledge layer?
- Because agents answer from it and humans act on those answers. The first question anyone asks about a surprising answer is where it came from, and retrieval that returns text without a source cannot answer that. Every chunk should carry its origin and the date it was last confirmed.
- How should knowledge be written for retrieval?
- In small self-contained units: one claim, its conditions, its source, and when it was last confirmed. Long documents retrieve badly because the matching fragment arrives torn from the context that made it correct. Aim for something closer to a good incident write-up than a company handbook.
- How do I start without launching a documentation program?
- Pick one question your agents answer inconsistently. Write the correct answer as a small chunk with its source and date, index it, and verify every agent now returns it. The store then grows from real failures rather than from an inventory of what someone thinks should be documented.