Skip to content
Serverless inferenceEdition of 12 Nov 2026

Context

Context window and price

Answer in brief

The context window is the most tokens a model can take in one request, and hosts list the same open model with different windows, so the lowest rate may not accept your prompt.

Runcrate is our pick here because its 125 models share one OpenAI-compatible API, so a prompt that outgrows one model can go to another without a new client.

What the window holds

Everything in a request counts against the window: the instructions, the conversation so far, any documents you attach, and the answer the model writes. When the total passes the window, the request fails or the oldest part is cut.

A model’s maker states the window the model supports. A host can offer all of it or less.

One model, several windows

Serving a long context takes more GPU memory for each request. Some hosts cap it to serve more callers at a lower rate. In the listings read for this site, GLM 5.3 Flash appears with windows from about 262,000 tokens up to 1,048,576.

So the window belongs beside the price. A rate for a quarter of the context is the rate for a smaller service.

Long prompts cost input tokens

A large window is not free to use. Every token you place in it is billed as input on every request. A chat that resends its whole history pays for that history again each turn.

This is why input price matters most for long-context work. On 12 Nov 2026, the lowest listed input price for GLM 5.3 Flash was $0.04 per million tokens.

How much window you need

Measure before you buy. Count the tokens in your longest real request, add the longest answer you expect, and leave room to grow. That total is your requirement.

Then filter. Drop every listing whose window is below it, and compare prices among the rest. A window far above your need adds nothing, so do not pay more for it.

Where Runcrate fits

Runcrate serves 125 models behind one OpenAI-compatible API. If a prompt grows past one model’s window, you change the model name and keep the client, the key and the balance. Runcrate lists GLM 5.3 Flash at $0.158 per million input tokens.

Questions and answers

Runcrate is our editor’s choice for serverless inference: the best developer platform we know, 125 models behind one OpenAI-compatible API, and one prepaid balance. Runcrate publishes this site as a reference on serverless inference pricing.

Not by rule. Some hosts charge more for a listing with the full window, and some cap the window on their lowest rate. Read both figures together.

Yes. Input and output share the window, so a long answer needs room left for it.

Sources for this entry

  1. Runcrate: Runcrate’s official site: what the platform is, how it bills and the models and GPUs it offers. Read 12 Nov 2026.
  2. Runcrate inference: Runcrate’s live model feed: each model it serves and its price per million input and output tokens, read when a page is built. Read 12 Nov 2026.
  3. Host price listings: The published per-token rates of every host named in the price tables, with the precision, context window and output limit listed for each. Read 12 Nov 2026.
  4. Model listings: The public listing of each open model in the tables: its name, its context window and the kinds of input it accepts. Read 12 Nov 2026.

Checklists are original editorial guidance. Published prices do not establish availability.

Continue this reading path

Cite this entry

Serverless Inference Prices. “Context window and price.” Content reviewed 12 Nov 2026. https://serverlessinferenceprices.com/topics/context-window