Answers from the documentation; checking which model is on duty
Hi - I answer from the OpenSmartRoute documentation: routing, the API, plans and quotas, self-hosting. Ask away, or open a support ticket if you need a person.
Grounded in the docs - follow a source before acting on it.
Llama 3.1 8B Instruct - Model - OpenSmartRoute
Modelv1.0.0
Llama 3.1 8B Instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...
Reference model card from the OpenRouter listing - model meta-llama/llama-3.1-8b-instruct. Prices are per million tokens as listed; ratings and installs below are from this marketplace.
Llama 3.1 8B Instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...
Facts
Vendor
Meta
Context window
131,072 tokens
Max output
117,964 tokens
Input price
$0.05 / 1M tokens
Output price
$0.08 / 1M tokens
Input
text
Output
text
Tool calling
yes
Structured outputs
yes
Reasoning
no
Open weights
meta-llama/Meta-Llama-3.1-8B-Instruct
Endpoint: https://openrouter.ai/api/v1 (OpenAI-compatible), model meta-llama/llama-3.1-8b-instruct
Use it
Copy one of these into your project. Installing also returns the manifest and these snippets.
# after Install: the listing is in your workspace's routing pool - nothing else to configurecurl-s-X POST https://osr-api.kindrock-caaab1a2.centralindia.azurecontainerapps.io/api/v1/route -H 'Authorization: Bearer $OSR_API_KEY' -H 'Content-Type: application/json' -d '{"text": "...", "plan": true}'# or pin it on the OpenAI-compatible endpoint: {"model": "model-meta-llama-llama-3-1-8b-instruct", ...}
Installed into a catalogue, chosen by a router
Install Llama 3.1 8B Instruct and it becomes one more candidate the router can pick - when it fits.
A listing is a routing target with a manifest: what it does, which domains it covers, what it costs and who publishes it. Once installed it sits beside your own models and tools, is scored like any other candidate for each request, and shows up in the trace when it wins. Ratings come from workspaces that installed it, one per account.
