Chatbot summaries and memory
- Chatbot summaries and memory
- Prerequisites
- Activation Steps
- 1. Enabling Conversation Summaries and Customer Profie
- 2. Enabling Chatbot Memory
- How does it work?
- 1. How does conversation summary work?
- 2. How does client summary work?
- 3. How does chatbot memory work?
To enhance user experience during conversations, the "Summaries and Memory" feature can be utilized. This functionality enables the chatbot to continuously summarize conversations with individual users and leverage these summaries in subsequent interactions. As a result, the chatbot becomes context-aware, recognizing who it is speaking with and recalling topics from previous conversations, allowing for more personalized interactions.
Enabling conversation summary costs 5 message credits per conversation, regardless of how many times the summary is regenerated while the conversation remains active.
Prerequisites
To utilize the chatbot's memory capabilities, it is essential to first increase the chatbot's context size. You can adjust this setting by navigating to Advanced Settings. Check how to increase context size.
Activation Steps
1. Enabling Conversation Summaries and Customer Profie
By enabling these options, each conversation will have an automatically generated summary (available also under the Chatlogs tab). You can customize the type of information captured about both the conversation and the customer. To do this:
- Activate the "Enable conversation summaries" option.
- Optionally: select "Use custom instructions for conversation summary" or even “Use custom instructions for client summary” and modify the prompt according to your specific needs.
Summaries & Memory
- Similarly, you can customize instructions for generating customer profiles.
2. Enabling Chatbot Memory
Activate the "Enable chat memory" option.
Define the proportion between the user's context (conversation summaries and customer profile) and the knowledge base utilized by the chatbot during conversations.
How does it work?
1. How does conversation summary work?
This feauture is really intuitive for users because after every conversation you can look at your “Chatlogs” and see AI generated summaries of your conversations. It takes around 2 minutes after the last message to create summary. It contains a concise overview about your conversation and about what chatbot did to help the user.
Furthermore you can customize your instructions for conversation summary. Here are the basic instructions:
You can change them and create your own prompt which will the best for your conversation summaries! For example, you could customize your instructions to contain only the identified needs or key interests of your clients.
You need to remember that when conversation summaries feauture is enabled it costs additional 5 message credits to each conversation.
2. How does client summary work?
The “Client summary” feature is quite similar to the “Conversation summary” feature. It describes the client's needs and specifies the reasons for the conversation. This tool builds a detailed client profile by summarizing all past conversations.
Moreover you can set up your custom instructions for client summary. Here are the basic instructions:
You can change these instructions in whatever way works best for your company. For example, you can ask your chatbot to provide a summary focusing only on the client’s needs or only on their preferences. Feel free to tailor it to your specific requirements!
You need to remember that when conversation summaries feauture is enabled it costs additional 5 message credits to each conversation.
3. How does chatbot memory work?
Chatbot memory has access to the conversation history and uses it to provide better answers for our clients. Conversation and clients summaries are used by the chatbot and when chat memory is enabled it has access to client summary and summaries of the most recent conversations.
You can also choose your memory size, ranging from 10% to 100%. For example, if you set your memory size to 50% and the total size of the context is 32,000 tokens, then 16,000 tokens will be reserved for your chat memory.
You need to remember that you must have to enable “Conversation summaries” to being able to enable “Chat memory”.