Can we run it inside our own network?

Yes. The router runs as a container or a Helm release on your infrastructure, and a routing rule keeps regulated data on the models you allow.

Will this lock us into another vendor?

No. The router is Apache-2.0 open source, your provider keys stay yours, and the API is OpenAI-compatible, so leaving is a change of base URL.

How much can we save on our LLM bill?

On the public benchmark the router saved 89% against sending everything to the reference model. Import last month's provider bill on the bill page and the estimate is computed on your own traffic before you change a line of code.

Retail & marketing · use case

Ten thousand product descriptions on a cheap model. The campaign headline on the best one.

Bulk product copy, variants and translations route to small models inside a per-team budget that refuses when it is spent; anything flagged brand-critical goes to the frontier model; the ledger shows what each campaign cost and what it would have cost on the frontier model alone.

Try OpenSmartRoute free Talk to sales about a pilot

Free plan, no card. Self-hosting is free forever; the rules below run the same way on both.

The situation

What the team is dealing with today

Marketing generates more AI text than anyone else in the company and most of it is bulk: variants, descriptions, translations. Paying frontier prices for all of it is the single easiest saving - and the one piece that must be perfect has to be allowed to cost more.

What changes

Bulk copy on the cheapest models that meet the quality rules, inside a budget per team
Brand-critical work pinned to the frontier model by a flag the caller sets
Spend per tenant and per campaign on the savings ledger, next to the always-frontier baseline

One request

What happens, step by step

Bulk copy runs on cheap models within a per-tenant budget; brand-critical work gets the best.

Copy request arrives
Brand-critical flag read from the context
Bulk copy to the cheap models within budget
Brand work to the frontier model
Spend per tenant on the ledger

Route a request like this in the playground and read the trace

A retail & marketing request, quoted live“Write three product descriptions for a merino wool beanie, under 40 words each, for a winter sale landing page.”

Quoting every candidate in the public catalogue...

The policy

Two text files, not a rewrite

This is the rules.yaml that produces the behaviour above; targets.yaml names the models, agents and people it refers to. Budgets are declared per target in the catalogue; context keys let the caller flag what matters.

rules.yaml - retail & marketing (reference configuration)yaml

rules:
  - name: bulk-copy-on-cheap-models
    when:
      domains: [marketing]
      actions: [generation]
      max_complexity: 0.5
    prefer: [llm-small, llm-mid]
    weight: 0.8

  - name: brand-critical-gets-the-best
    when:
      domains: [marketing]
      context: { brand_critical: true }
    prefer: [llm-frontier]
    pin: true

Example: Illustrative configuration or synthetic data, not a customer's.A reference configuration to start from - rules the router enforces as written, not a description of how a named customer runs it.

Other use cases

For the business

What it does for the whole organisation.

Cloud, self-hosted or on-premises
Run it where the data is
The same router ships as a hosted platform, a container image and a Helm chart; the data boundary is a routing rule.
Deployment options
One URL, every vendor
No vendor lock-in
Point your OpenAI-compatible client at one address; add, swap or retire providers in the catalogue without touching application code.
Every vendor side by side
89% less
Lower cost per request
On the 150-prompt benchmark the router spent 89% less than sending every prompt to the reference model, and the judged quality went up, not down.
Read the benchmark

Can we run it inside our own network?: Yes. The router runs as a container or a Helm release on your infrastructure, and a routing rule keeps regulated data on the models you allow.
Will this lock us into another vendor?: No. The router is Apache-2.0 open source, your provider keys stay yours, and the API is OpenAI-compatible, so leaving is a change of base URL.
How much can we save on our LLM bill?: On the public benchmark the router saved 89% against sending everything to the reference model. Import last month's provider bill on the bill page and the estimate is computed on your own traffic before you change a line of code.

Start with the retail & marketing rules and change what you disagree with.

OpenSmartRoute is open source and the free plan keeps the full trace of every decision. Create a workspace, paste the rules, route a request.

Create a free account Read the benchmark

Free plan, no card. Fifteen thousand decisions a month with the full trace.

rules: - name: bulk-copy-on-cheap-models when: domains: [marketing] actions: [generation] max_complexity: 0.5 prefer: [llm-small, llm-mid] weight: 0.8 - name: brand-critical-gets-the-best when: domains: [marketing] context: { brand_critical: true } prefer: [llm-frontier] pin: true

Ten thousand product descriptions on a cheap model. The campaign headline on the best one.

What the team is dealing with today

What happens, step by step

Two text files, not a rewrite

What it does for the whole organisation.

Run it where the data is

No vendor lock-in

Lower cost per request

Start with the retail & marketing rules and change what you disagree with.

Ten thousand product descriptions on a cheap model. The campaign headline on the best one.

What the team is dealing with today

What happens, step by step

Two text files, not a rewrite

What it does for the whole organisation.

Run it where the data is

No vendor lock-in

Lower cost per request

Start with the retail & marketing rules and change what you disagree with.