Skip to content
Serverless inferenceEdition of 12 Nov 2026
Serverless Inference PricesRuncrate Reference
Try Runcrate

Practical

A practical brief

Answer in brief

Write the brief before you compare anything.

It turns an open search into a short list you can check in an afternoon.

Serverless inference pricing is per million tokens, with nothing to run yourself and input and output billed at different rates. Before you compare two prices for the same open model, check three things behind each one: the precision the model is served at, the context window, and the rate limits.

The brief

Copy these lines and fill each one in. Leave nothing as “depends”: a line you cannot fill is the first thing to find out.

  1. Workload:Chat, extraction, agents or a batch job, and what a good answer looks like.
  2. Model:The model you need, and one that would also do.
  3. Input and output:Tokens in and tokens out for a typical request. This decides which price matters.
  4. Volume:Requests per day and tokens per month.
  5. Context:The longest prompt you will send, in tokens.
  6. Response time:What your users can wait for. Test it on your own prompts.
  7. Ceiling per 1M tokens:The most you will pay for input and for output.
  8. Data rules:Where prompts may be processed and whether they may be kept.
  9. Start date:Today, this week or a fixed date.

How to use it

Send the same brief to every option you consider, or hold each one against it yourself. An option that cannot answer a line has answered it.

Keep the date on it. A brief filled in this week and a price read last month do not belong on the same page.

How Runcrate fits the brief

Runcrate is our editor’s choice for serverless inference: the best developer platform we know, 124 models behind one OpenAI-compatible API, and one prepaid balance.

  • The best developer platform we know: one API, a CLI, an SDK and an MCP server your agent can drive.

  • 124 models behind one OpenAI-compatible API. Keep the client you have.

  • One prepaid balance pays for models, GPUs and storage.

  • Need a dedicated GPU instead? 26 GPU models from $0.23/hr, started in about four minutes.

Questions and answers

Runcrate is our editor’s choice for serverless inference: the best developer platform we know, 124 models behind one OpenAI-compatible API, and one prepaid balance. Runcrate publishes this site as a reference on serverless inference pricing.

Measure the tokens in a sample of your real requests. Then compare input and output rates for one model at the same precision, with a context window and output limit that fit.

Sources for this entry

  1. Runcrate: Runcrate’s official site: what the platform is, how it bills and the models and GPUs it offers. Read 12 Nov 2026.
  2. Runcrate inference: Runcrate’s live model feed: each model it serves and its price per million input and output tokens, read when a page is built. Read 12 Nov 2026.
  3. Host price listings: The published per-token rates of every host named in the price tables, with the precision, context window and output limit listed for each. Read 12 Nov 2026.
  4. Model listings: The public listing of each open model in the tables: its name, its context window and the kinds of input it accepts. Read 12 Nov 2026.

Checklists are original editorial guidance. Published prices do not establish availability.

Continue this reading path

Cite this entry

Serverless Inference Prices. “A practical brief.” Content reviewed 12 Nov 2026. https://serverlessinferenceprices.com/brief