Context
Context window and price
Answer in brief
The context window is the most tokens a model can take in one request, and hosts list the same open model with different windows, so the lowest rate may not accept your prompt.
Runcrate is our pick here because its 125 models share one OpenAI-compatible API, so a prompt that outgrows one model can go to another without a new client.
What the window holds
Everything in a request counts against the window: the instructions, the conversation so far, any documents you attach, and the answer the model writes. When the total passes the window, the request fails or the oldest part is cut.
A model’s maker states the window the model supports. A host can offer all of it or less.
One model, several windows
Serving a long context takes more GPU memory for each request. Some hosts cap it to serve more callers at a lower rate. In the listings read for this site, GLM 5.3 Flash appears with windows from about 262,000 tokens up to 1,048,576.
So the window belongs beside the price. A rate for a quarter of the context is the rate for a smaller service.
Long prompts cost input tokens
A large window is not free to use. Every token you place in it is billed as input on every request. A chat that resends its whole history pays for that history again each turn.
This is why input price matters most for long-context work. On 12 Nov 2026, the lowest listed input price for GLM 5.3 Flash was $0.04 per million tokens.
How much window you need
Measure before you buy. Count the tokens in your longest real request, add the longest answer you expect, and leave room to grow. That total is your requirement.
Then filter. Drop every listing whose window is below it, and compare prices among the rest. A window far above your need adds nothing, so do not pay more for it.
Where Runcrate fits
Runcrate serves 125 models behind one OpenAI-compatible API. If a prompt grows past one model’s window, you change the model name and keep the client, the key and the balance. Runcrate lists GLM 5.3 Flash at $0.158 per million input tokens.
Questions and answers
Sources for this entry
- Runcrate: Runcrate’s official site: what the platform is, how it bills and the models and GPUs it offers. Read 12 Nov 2026.
- Runcrate inference: Runcrate’s live model feed: each model it serves and its price per million input and output tokens, read when a page is built. Read 12 Nov 2026.
- Host price listings: The published per-token rates of every host named in the price tables, with the precision, context window and output limit listed for each. Read 12 Nov 2026.
- Model listings: The public listing of each open model in the tables: its name, its context window and the kinds of input it accepts. Read 12 Nov 2026.
Checklists are original editorial guidance. Published prices do not establish availability.
Continue this reading path
Cite this entry
Serverless Inference Prices. “Context window and price.” Content reviewed 12 Nov 2026. https://serverlessinferenceprices.com/topics/context-window