.md
.pdf
Key Concepts
 Contents 
Memory
Conversational Memory
Entity Memory
Key Concepts#
Memory#
By default, Chains and Agents are stateless, meaning that they treat each incoming query independently.
In some applications (chatbots being a GREAT example) it is highly important to remember previous interactions,
both at a short term but also at a long term level. The concept of “Memory” exists to do exactly that.
Conversational Memory#
One of the simpler forms of memory occurs in chatbots, where they remember previous conversations.
There are a few different ways to accomplish this:
Buffer: This is just passing in the past N interactions in as context. N can be chosen based on a fixed number, the length of the interactions, or other!
Summary: This involves summarizing previous conversations and passing that summary in, instead of the raw dialogue itself. Compared to Buffer, this compresses information: meaning it is more lossy, but also less likely to run into context length limits.
Combination: A combination of the above two approaches, where you compute a summary but also pass in some previous interactions directly!
Entity Memory#
A more complex form of memory is remembering information about specific entities in the conversation.
This is a more direct and organized way of remembering information over time.
Putting it a more structured form also has the benefit of allowing easy inspection of what is known about specific entities.
For a guide on how to use this type of memory, see this notebook.
previous
Getting Started
next
How-To Guides
 Contents
  
Memory
Conversational Memory
Entity Memory
By Harrison Chase
    
      © Copyright 2023, Harrison Chase.
      
  Last updated on Mar 22, 2023.