Which LLM is the cheapest for our workload?

The best-for pages rank the live catalogue per task by the index that measures it, and the router picks the cheapest model that meets your quality rule for each request.

How much can we save on our LLM bill?

On the public benchmark the router saved 89% against sending everything to the reference model. Import last month's provider bill on the bill page and the estimate is computed on your own traffic before you change a line of code.

How often do model prices change?

The catalogue is refreshed from the vendors' price lists; each model page shows the date of its data.

90 days of the enterprise, pro and team plans free, no card needed. See the plans

OpenSmartRoute

GPT-3.5 Turbo 16k by OpenAI: pricing, context window and specs - OpenSmartRoute

Model catalogue

OpenAI

GPT-3.5 Turbo 16k

openai/gpt-3.5-turbo-16kCatalogue: Indexed in the reference catalogue; nothing on this deployment answers as this model yet.

JSON

Specification

Published by the vendor; the platform bills at the target's declared price.

GPT-3.5 Turbo 16k

tools

OpenAI openai/gpt-3.5-turbo-16k

This model offers four times the context length of gpt-3.5-turbo, allowing it to support approximately 20 pages of text in a single request at a higher cost. Training data: up...

Input $/1M: $3.00
Output $/1M: $4.00
Context: 16K
Max output: 4K
Released: Aug 28, 2023
Modalities: text

Alternatives, and where the router puts GPT-3.5 Turbo 16k

GPT-3.5 Turbo 16k earns a request when it needs tool calls; a short, general request would go to Nemotron 3.5 Super VL (free) instead - free per million input tokens against $3.00 here; and the hardest requests, where the quality floor rules it out, to Claude Opus 5.5 (batch). Your rules decide the floor; the trace shows the comparison for every request.

Cheaper alternatives

Lower input price and an intelligence index within 5 points (this model has no published index).

On this deployment

Nothing on this deployment answers as this model yet. Connect your own provider under Model providers, or add a target to your catalogue - the router picks it up without retraining.

Not available here yet

Signed in, add the model under Model providers; self-hosting, add a target with metadata.model set to this id.

targets.yamlyaml

# targets.yaml - declare a target that runs GPT-3.5 Turbo 16k
targets:
  - id: gpt-3-5-turbo-16k
    kind: llm
    name: GPT-3.5 Turbo 16k
    metadata:
      model: openai/gpt-3.5-turbo-16k          # links the target to this catalogue entry
    capabilities:
      domains: [general]
      supports_tools: true
      context_window: 16385
    cost:
      usd_per_1k_tokens: 0.003500

Price among OpenAI models

Input list price per million tokens; GPT-3.5 Turbo 16k is the most expensive of 13 listed.

List price is where the decision starts

GPT-3.5 Turbo 16k earns a request when it beats the field on your objective, not on the vendor's page.

The specification above is what OpenAI publishes. What the router uses is the price you actually pay here, the latency measured on this deployment and the outcomes people reported - and it compares those against every other model that could take the request. Price a workload on the estimator, or send one live in the playground.

Photo: RDNE Stock project

For the business

What it means for which models you pay for.

Catalogue of every vendor
The right model, not the famous one
Price, context, abilities and benchmark indexes side by side, with the model that fits each task named.
The rankings
89% less
Lower cost per request
On the 150-prompt benchmark the router spent 89% less than sending every prompt to the reference model, and the judged quality went up, not down.
Read the benchmark
Per million tokens, every model
Prices you can compare

GPT-3.5 Turbo 16k

Specification

GPT-3.5 Turbo 16k

Alternatives, and where the router puts GPT-3.5 Turbo 16k

Cheaper alternatives

On this deployment

Price among OpenAI models

GPT-3.5 Turbo 16k earns a request when it beats the field on your objective, not on the vendor's page.

What it means for which models you pay for.

The right model, not the famous one

Lower cost per request

Prices you can compare

Better alternatives

More from OpenAI