Design and implement agent memory stores in Azure Cosmos DB

Intermediate
Developer
AI Engineer
Azure Cosmos DB
Azure OpenAI Service

Give an agent something to remember. Separate short-term conversation state from long-term memory, distill raw turns into facts a later session can find by meaning, and set the retention, reconciliation, and erasure policies that keep a memory store trustworthy as it grows.

Learning objectives

After completing this module, you're able to:

  • Design short-term and long-term memory architectures for agent use cases.
  • Implement conversation state in Azure Cosmos DB for NoSQL and expire it with time to live.
  • Implement semantic memory by distilling turns into embedded, individually correctable facts.
  • Retrieve the right memory into a limited context window and inject it safely.
  • Design memory retention, pruning, consolidation, and erasure policies.

Prerequisites

  • Experience running vector and full-text queries in Azure Cosmos DB for NoSQL
  • Familiarity with vector embeddings and calling an embedding API such as Azure OpenAI
  • Working knowledge of Azure Cosmos DB for NoSQL partitioning, queries, and request units
  • Programming experience with Python