Skip to content

AI, decoded

What are the types of AI agent memory?

Richmond Alake describes four types: working memory holds the current task, semantic memory stores facts, episodic memory records past events, and procedural memory stores how to do a task. This human-memory analogy describes their uses; it does not determine which storage system to buy or which remembered fact should win a conflict.

· Updated · Chain of Thought

Level 4: How AI systems are built · 4.2 Context and memory engineering

Agent MemoryAI Agents

  • 4 episodes
  • 5 guest clips
  • 7 glossary terms
Four memory cards, working, semantic, episodic and procedural, fading from solid to faint, beside the hook: don't delete, forget.

In detail

1. Working memory: what it is holding right now

The active context window. The scratch pad. Small, temporary, whatever is on the desk this moment. It is what a basic chatbot relies on, and without the other kinds, your context is gone when the chat ends. Some consumer assistants now add cross-chat memory on top (Claude, for one, carries saved context into new chats), a step toward the semantic and episodic layers below.

2. Semantic memory: the facts it knows

Reference knowledge it can reuse: your policies, your docs, your institutional knowledge. The textbook on the shelf. This is the institutional knowledge an agent pulls from again and again.

3. Episodic memory: what happened

Time-stamped interactions. Past conversations, tied to when they occurred. The diary. This is what lets an agent say “last week you decided X” instead of starting every session from zero.

4. Procedural memory: how to do the task

Skills and routines. The standard operating procedures it runs without re-reasoning every time. Muscle memory. The how-to layer that turns a one-off into a repeatable workflow.

Forgetting and deletion solve different problems

Richmond Alake recommends reducing the retrieval priority of old memories rather than treating every stored item as equally useful. He describes recency, relevance and importance as signals. This is a retrieval design idea, not a rule to retain everything forever. Decide separately what should be superseded, excluded from retrieval, retained for an approved audit purpose, or deleted under the product’s data policy.

Why it matters

Alake’s own agent demo doesn’t lean on a smarter model. It gives the agent separate lanes for each kind of memory. You cannot train a frontier model on your own, but a single developer can build a memory system that remembers better than ChatGPT. Memory is a layer where individual effort can still compete with the big labs.

Memory that outlasts one model

Episodic memory gets more valuable the longer it accumulates, which makes it worth keeping independent of any one model. In episode 77 at 1:36, Kimberly Logan of the Walrus Foundation argues that a longer context window helps only while you stay with one provider; switching models or harnesses should not mean starting over. At 9:59 she cites Walrus’s figure that almost 85% of the memories written are read back more than 30 days later, which she takes as a sign of long-running workflows. That is the company’s own usage data, not an independent benchmark.

Her example at 13:03 is an episodic record used outside coding: a security team snapshots production, compares it with code changes and uses the accumulated history to verify what changed. The test is the same as for the refund policy below: can the next system tell what changed, when, and which record still applies? Walrus Memory sponsored this episode and the season, as Conor discloses at 3:24. For moving memory between models, see how to make agent memory portable and agent memory portability.

Give each remembered fact an owner and a date

The four-part analogy describes what memory is used for. It does not tell you which storage system to buy, which fact wins a conflict, or who may read it. LangChain’s memory overview makes another useful distinction: thread-scoped state supports one conversation; longer-term stores carry information across conversations. A persisted conversation is not necessarily shared institutional knowledge.

Illustrative design: a support agent remembers a refund policy. Store the policy’s source, owner, effective date, tenant and superseded status with the text. Retrieve within the authorized tenant before ranking for relevance. Decide which source has authority before asking the model to summarize conflicting records.

Test caseWhat should happen
A current 30-day policy conflicts with an older 60-day memoryUse the applicable authoritative policy and identify the conflict
A similar customer record belongs to another tenantDo not retrieve or disclose it
A remembered preference is explicitly withdrawnStop applying it and follow the product’s deletion policy
A new conversation resumes a saved taskRecover the task state without treating old approval as permission for a different action

These are suggested acceptance cases. They test whether the memory is usable, current and authorized, rather than whether a vector search returned something similar.

For choosing an implementation layer, compare Mem0, Zep, Letta and LangMem and run the changing-fact pilot before adopting a memory tool.

Check yourself

Does a highly relevant memory outrank a newer approved policy? Relevance alone cannot answer that. Check authority and applicability. Conor’s essay on agent amnesia explains why persistence matters; the context explainer connects persistent context to systems of record and changing business definitions.

The four types of AI agent memory, as lanes in one context window An agent's context window segmented into four lanes, one per memory type, each with a human analogy. Working memory is what it is holding right now, the scratch pad, like a desk. Semantic memory is the facts it knows, policies, docs and institutional knowledge, like a textbook. Episodic memory is what happened, timestamped past conversations, like a diary. Procedural memory is how to do the task, skills, SOPs and routines, like muscle memory. To the right, don't delete, forget: memory units fade by a weighted score of recency, relevance and importance instead of being hard-deleted, which keeps the audit trail. Below: Richmond Alake, episode 53, says a single developer can't train a frontier model but can build a memory system that remembers better than ChatGPT. Four kinds of memory, four lanes Borrowed from human memory, and kept in separate lanes so the agent knows which is which. THE AGENT’S CONTEXT WINDOW, SEGMENTED WorkingWhat it’s holding right now:the scratch pad≈ the deskSemanticFacts it knows: policies, docs,institutional knowledge≈ the textbookEpisodicWhat happened: timestampedpast conversations≈ the diaryProceduralHow to do the task: skills,SOPs, routines≈ muscle memory DON’T DELETE. FORGET. Old memories fade; nothing is erased. Each unit carries a weighted score: recency · relevance · importance score drops,memory fades Low score fades from recall;the audit trail stays. You can’t train a frontier model alone. You can build the memory layer. Richmond Alake, Oracle, ep 53: a single developer can build a memory system that remembers better than ChatGPT. The fading score follows Stanford’s Generative Agents paper, which he points to as an easy approach to forgetting.
Four memory types in separate lanes, and forgetting instead of deleting. The framing is Richmond Alake’s, from episode 53; the fading score follows the Generative Agents paper he cites. Download the image

Hear it from the guest

“There's a principle I like to communicate to people, which is you don't delete information in memory engineering, you forget.”
Watch on YouTube
“For example, a single developer can't train a GPT 4-5 like model, right? But a single developer can build a memory system that can remember better than a chat GPT.”
Watch on YouTube
“So Blackboard memory is where you have agents kind of come together to post like partial solutions, and essentially it's read write,”
“Memory is fundamentally recording of continuous state changes that is happening in the agentic systems and with agents.”
Watch on YouTube
“Any time that you need something to accumulate knowledge over time. and understand how that knowledge has changed and what's applicable and what's not.”
Kimberly Logan, Walrus Protocol EP 77 · around 13:59 · read the transcript
Watch on YouTube

Quotes lightly edited to remove filler words.

Go deeper

From the conversation

This explainer is drawn from these episodes — each carries its full transcript.

Concepts in this explainer

Agent Memory PortabilityAgent MemoryAI AgentContext WindowAI BenchmarkFrontier ModelSystem of Record