AI / Agentic AI Interview Questions
What is short-term memory in an AI agent?
Short-term memory in an AI agent corresponds to the active conversation and context within the current session, roughly equivalent to what fits inside the model's context window.
- Includes the current task, recent tool calls, and their observed results
- Disappears once the session ends unless it's explicitly saved somewhere persistent
- Limited by the size of the context window, which constrains how much recent history the agent can directly reference
Because short-term memory is bounded, long-running agents need strategies like summarization or offloading to long-term memory to avoid losing important earlier context as a task grows.
What does short-term memory roughly correspond to?
What happens to short-term memory once the session ends, without explicit saving?
More Related questions...
