SentX SI Blog Meet Victoria

What Survives When You Start a New Conversation: Context Windows, Saved State, and Product Memory

· 4 min read · Updated

SentX SI

When you open a new chat with an assistant, "does it remember me?" is really three questions. What the assistant can see in a single request, whether the product saves your past conversations or project state at all, and whether it maintains any memory that gets supplied into new conversations. The short answer is that what actually appears in your new chat is the sum of whatever the application chooses to provide across those three, and the size of the context window by itself never tells you whether anything from before arrives.

What does the context window actually measure?

The context window is a per-request budget. OpenAI's API documentation defines it as the token limit of a single request, covering input and output and, for applicable models, reasoning tokens. Anthropic's context-window guide makes the same separation: the material referenced while generating a response, such as instructions, supplied messages, tool results, and generated output, is distinct from the corpus the model was trained on. Either way, the number tells you how much fits in one exchange, not whether previous-conversation content shows up. A wide window does not create cross-chat recall, and a narrow one does not guarantee amnesia, because the application decides what to attach to each request.

Source: Conversation state

What distinguishes saved state from product memory?

Beyond the window, two more things matter, and they are best treated as useful distinctions rather than fixed layers stacked one above the other. One is persisted conversation or project state. An API can document manual state management, supplying prior messages to a later request, and durable conversation objects that retain messages across sessions or devices; OpenAI's developer guide describes both, but as its own mechanisms, not as a description of any consumer product. The other is product memory: distilled or symbolic representations of people, preferences, and past exchanges that a product maintains and selectively supplies later. In practice these overlap and vary from product to product, and none of them is guaranteed to be present.

Does fitting in the window guarantee recall?

Even inside the window, "fits" is not the same as "recalled perfectly." Anthropic's documentation warns that a larger context is not automatically better for accuracy or recall, and some systems compact or summarize earlier material so a conversation can continue beyond a single window, a documented Claude feature rather than a universal overflow rule. A 2024 paper in Transactions of the Association for Computational Linguistics, "Lost in the Middle," reported that in multi-document question answering and key-value retrieval, performance depended on where the relevant information sat in the input, often worsening when it appeared in the middle. That study is historical and limited in scope, particular tasks and particular models, and is not a benchmark of today's assistants. It is, however, enough reason to treat blanket promises of complete recall within the window as unverified.

How does SentX describe its own memory?

SentX's public pages describe memory as a product feature. The homepage presents Victoria with dynamic symbolic memory of people, preferences, shared conversations, and her own experiences, and says memories develop and change, with important ones strengthening while lower-value details fade. That is a first-party description, not a measured guarantee. The privacy policy states the material limitation: SentX retains representations of interactions, runs a shared memory system, and warns that submitted content is not confidential and can influence interactions with other users.

Source: SentX SI | In pursuit of Superintelligence

How can you test continuity yourself?

If you want to evaluate continuity yourself, design the test so a result means something.

  1. Use invented, non-sensitive project facts, a made-up client name or a fictional deadline, so you can recognize them and risk nothing.
  2. Record the setup: where you told the assistant, when, and what exactly you said.
  3. Start a fresh conversation and ask, and repeat the check a few times rather than trusting a single run.
  4. Read each outcome narrowly.

A single successful or failed recall does not identify the architecture: a hit could be the transcript being re-supplied, a stored memory, or a lucky inference, and a miss could be a retrieval gap rather than an absence. Treat each run as one data point about that product's behavior, not proof of how it works.

The practical conclusions are narrower than the marketing suggests. Do not assume that closing a chat erases all useful state, because products persist differently and some persist little or nothing. Do not assume that everything beyond the window is unreachable, because summaries, saved transcripts, and memory may carry pieces forward. Do not read marketing silence as evidence of weak memory, and do not rank memory above context capacity as the decisive factor for everyone; which matters depends on what you are doing. For work that lives in one thread, keeping related material together in the same conversation tends to help, though even there earlier material may be summarized or omitted, so treat continuity as something to verify rather than assume.

Sources

  1. SentX SI | In pursuit of Superintelligence — Sentx AI Research and Development LLC
    Supported claims and limits
    • The homepage describes dynamic symbolic memory of people, preferences, shared conversations and Victoria's own experiences.
    • The homepage says memories can develop and change, with important memories strengthening and lower-value details fading.
    • These are first-party product descriptions, not measured guarantees of complete or accurate recall.
  2. Victoria Model Card | Capabilities, Evidence and Limits | SentX — Sentx AI Research and Development LLC
    Supported claims and limits
    • SentX describes Victoria as its foundation model, trained and running in Dubai, UAE.
    • The card is a first-party product disclosure; it does not assert an independently verified underlying model version, model size, training-data inventory or benchmark score.
  3. Privacy Policy - SentX — Sentx AI Research and Development LLC
    Supported claims and limits
    • Sections 3 and 7 state that SentX retains representations of interactions and describe a shared memory system; the policy does not disclose the private storage implementation.
    • Sections 7 and 8 warn that submitted content can influence interactions with other users and that submissions are not confidential.
    • Sections 9 and 14 distinguish account-level deletion from information already incorporated into training, model weights or shared memory.
    • These claims describe the published policy only; no deletion flow, retention mechanism or legal interpretation was independently verified.
  4. Conversation state — OpenAI
    Supported claims and limits
    • The guide defines the context window as a per-request token limit encompassing input and output and, for applicable models, reasoning tokens.
    • It documents manual conversation-state management by supplying prior messages to a later request.
    • It separately documents durable conversation objects that can retain messages and other items across sessions, devices or jobs.
    • These are OpenAI API mechanisms and terminology; they do not establish SentX's implementation or ChatGPT consumer behavior.
  5. Context windows — Anthropic
    Supported claims and limits
    • The context-window documentation distinguishes the information referenced while generating a response from the corpus used to train a model.
    • For Claude API requests, instructions, supplied messages and tool results contribute to the context budget, as does generated output; details depend on the model.
    • The documentation warns that a larger context is not automatically better for accuracy or recall.
    • It describes compaction that summarizes earlier conversation material, allowing a conversation to continue beyond a single window; this is a documented Claude feature, not a universal overflow rule.
  6. Lost in the Middle: How Language Models Use Long Contexts — MIT Press, Transactions of the Association for Computational Linguistics; hosted by ACL Anthology
    Supported claims and limits
    • The 2024 paper's inspected abstract reports experiments on multi-document question answering and key-value retrieval.
    • The authors report that performance in their evaluated settings changed with the location of relevant input information, often worsening when it appeared in the middle.
    • This supports avoiding a blanket promise of perfect recall merely because material fits inside a window.
    • This review covered only the abstract and bibliographic metadata. The findings are not a benchmark of current SentX or every present-day model.
Meet Victoria