What is a context window?
PICTURE THIS: A SENTENCE BECOMES TOKENS
The model does not read letters like humans. It reads these pieces, then predicts the next one.
Simple meaning
The context window is the maximum number of tokens the model can consider at once, including prompt and usually the completion.
WHY — Tokens instead of words?
LLMs use tokens (not full words) because it helps them:
people who only read docs from people who shipped.
and tied to GenAI / LLM work.
Each piece maps to a number the network can learn.
Fixed pieces are what transformers expect as input.
STEPS — What happens with tokens?
Before the model can read a sentence, it goes through these steps:
- 1The context window is
the maximum number of tokens the model can consider at once, including prompt and usually the completion.
- 2If you exceed it,
the API rejects the request or you must truncate.
- 3Bigger windows help RAG
but still cost money and can dilute attention.
- 4Context mix
Attention looks at nearby tokens together.
- 5Next token
The model scores what should come next.
- 6Decode
IDs turn back into readable text.
EXAMPLE — See it in action
Here's a short line you can speak, broken into clear beats:
Note: Adapt this scaffold to your own project — keep it under 60–90 seconds.
Key takeaway
The context window is the maximum number of tokens the model can consider at once, including prompt and usually the completion. If you exceed it, the API rejects the request or you must truncate.