Which LLM is the cheapest for our workload?

The best-for pages rank the live catalogue per task by the index that measures it, and the router picks the cheapest model that meets your quality rule for each request.

How much can we save on our LLM bill?

On the public benchmark the router saved 89% against sending everything to the reference model. Import last month's provider bill on the bill page and the estimate is computed on your own traffic before you change a line of code.

How often do model prices change?

The catalogue is refreshed from the vendors' price lists; each model page shows the date of its data.

90 days of the enterprise, pro and team plans free, no card needed. See the plans

OpenSmartRoute

Llama 3.1 8B Instruct by Meta: pricing, context window and specs - OpenSmartRoute

Model catalogue

Llama 3.1 8B Instruct

meta-llama/llama-3.1-8b-instructCatalogue: Indexed in the reference catalogue; nothing on this deployment answers as this model yet.

JSON

Specification

Published by the vendor; the platform bills at the target's declared price.

Llama 3.1 8B Instruct

open weights tools

Meta meta-llama/llama-3.1-8b-instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...

Input $/1M: $0.05
Output $/1M: $0.08
Context: 131K
Max output: 118K
Released: Jul 23, 2024
Modalities

Alternatives, and where the router puts Llama 3.1 8B Instruct

Llama 3.1 8B Instruct earns a request when it needs tool calls, running on your own hardware; a short, general request would go to Nemotron 3.5 Super VL (free) instead - free per million input tokens against $0.05 here; and the hardest requests, where the quality floor rules it out, to Claude Opus 5.5 (batch). Your rules decide the floor; the trace shows the comparison for every request.

Cheaper alternatives

Lower input price and an intelligence index within 5 points.

Llama 3.1 8B Instruct head to head

Llama 3.1 8B Instruct vs Llama 3.3 70B Instruct

On this deployment

Nothing on this deployment answers as this model yet. Connect your own provider under Model providers, or add a target to your catalogue - the router picks it up without retraining.

Not available here yet

Signed in, add the model under Model providers; self-hosting, add a target with metadata.model set to this id.

targets.yamlyaml

# targets.yaml - declare a target that runs Llama 3.1 8B Instruct
targets:
  - id: llama-3-1-8b-instruct
    kind: llm
    name: Llama 3.1 8B Instruct
    metadata:
      model: meta-llama/llama-3.1-8b-instruct          # links the target to this catalogue entry
    capabilities:
      domains: [general]
      supports_tools: true
      context_window: 131072
    cost:
      usd_per_1k_tokens: 0.000065

Price among Meta models

Input list price per million tokens; Llama 3.1 8B Instruct is the 2nd cheapest of 8 listed.

1
Llama 3.2 1B Instruct
$0.03
2
Llama 3.1 8B Instruct
$0.05
3
Llama 3.2 3B Instruct
$0.05
4
Llama 4 Scout
$0.10
5
Llama 3.3 70B Instruct
$0.10
6
Llama Guard 4 12B
$0.18
7
Llama 4 Maverick
$0.19
8
Llama 3.1 70B Instruct
$0.40

More from Meta

List price is where the decision starts

Llama 3.1 8B Instruct earns a request when it beats the field on your objective, not on the vendor's page.

The specification above is what Meta publishes. What the router uses is the price you actually pay here, the latency measured on this deployment and the outcomes people reported - and it compares those against every other model that could take the request. Price a workload on the estimator, or send one live in the playground.

Photo: RDNE Stock project

For the business

What it means for which models you pay for.

Catalogue of every vendor
The right model, not the famous one
Price, context, abilities and benchmark indexes side by side, with the model that fits each task named.
The rankings
89% less
Lower cost per request
On the 150-prompt benchmark the router spent 89% less than sending every prompt to the reference model, and the judged quality went up, not down.
Read the benchmark
Per million tokens, every model
Prices you can compare

Specification

Llama 3.1 8B Instruct

Alternatives, and where the router puts Llama 3.1 8B Instruct

Cheaper alternatives

Llama 3.1 8B Instruct head to head

On this deployment

Price among Meta models

More from Meta

Llama 3.1 8B Instruct earns a request when it beats the field on your objective, not on the vendor's page.

What it means for which models you pay for.

The right model, not the famous one

Lower cost per request

Prices you can compare

Better alternatives