NVIDIA has released the full Run:ai GPU orchestration platform as open source under Apache 2.0. The release includes KAI Scheduler, CUDA 13.4 GPU fractioning, quota management, and a local Kind dev environment. The post NVIDIA Open Sources Run:ai Under Apache 2.0 for Kubernetes GPU Orchestration appeared first on MarkTechPost.
Read the original at MarkTechPost: NVIDIA Open Sources Run:ai Under Apache 2.0 for Kubernetes GPU Orchestration
How OpenSmartRoute helps
For a team that routes through the router, a release like this is one catalogue entry. The new model competes on the next request against what the team already runs, on quality, cost and speed. If it answers well it earns more traffic; if it fails it gets less, with no code change in the app.
Any OpenAI-compatible provider works, as do open-weight models served locally. The catalogue at https://opensmartroute.ai lists models with their prices and live rankings, and the savings ledger shows what the routing saved against always using the most expensive option.