OpenRouter BYOK explained: cheaper, often faster, and changing

By Kshitij Gupta · Published October 8, 2026 · Updated October 15, 2026

TL;DR: With OpenRouter BYOK, the team's provider bills the team for inference and OpenRouter charges nothing on the first $25,000 a month of list-price usage, then 5% on the rest, paid from the team's OpenRouter credits. It's cheaper than credits at every volume, and on Claude it was faster in TrueFoundry's tests. But by default a failing key falls back to OpenRouter's own account, and only a request-level setting keeps traffic off other providers entirely. The TrueFoundry AI Gateway calls providers with the team's own credentials, runs in the team's VPC or data centre with no shared provider account under it, and a failing key falls back only to the team's own routing config. Teams staying on OpenRouter can put TrueFoundry in front of it as a provider and keep budgets, rate limits and access control in one place they run.

If teams have read that OpenRouter BYOK is free for their first million requests a month, they've read a figure OpenRouter retired on 14 July 2026. It's still on some of OpenRouter's own older documentation pages, which is why so many guides still repeat it.

The current terms are better for most teams, and BYOK is the cheapest way to use OpenRouter. In TrueFoundry's tests, BYOK was also faster on Anthropic. A failing key still falls back to OpenRouter's own account unless teams change that on the key and restrict providers on the request.

What is OpenRouter BYOK?

BYOK, bring your own key, means adding the team's own provider credentials to OpenRouter. Requests routed to that provider use the team's key, the provider bills the team directly, and the team's own rate limits and contract terms apply. OpenRouter still handles routing, translation and analytics, and the team's prompts still pass through it.

Keys are added per workspace, in the workspace's BYOK settings or through the management API. As of 5 October, 72 of the 92 providers OpenRouter lists support BYOK, including Anthropic, OpenAI, Google Vertex and AI Studio, Amazon Bedrock, Azure, DeepSeek, Mistral and Groq. Bedrock takes either a Bedrock API key or AWS credentials, Vertex a service account JSON, and Azure a resource name and key.

What OpenRouter BYOK costs

On the Standard and Business plans, the first $25,000 of BYOK usage each month carries no OpenRouter fee. On Enterprise the allowance is custom; some guides still quote $200,000, but OpenRouter's FAQ and pricing page now just say custom. Above the allowance, OpenRouter charges 5% of what the same model and provider would cost on OpenRouter, deducted from the team's OpenRouter credits.

Compare that with buying credits, where teams pay OpenRouter list price for inference plus a fee on every purchase: 5.5% on Standard with a $0.80 minimum, or 8% on Business.

Monthly usage at list priceCredits on StandardCredits on BusinessBYOK fee
$10,000$550$800$0
$25,000$1,375$2,000$0
$50,000$2,750$4,000$1,319
$100,000$5,500$8,000$3,956
$500,000$27,500$40,000$25,056

From the Figure 1 chart on this page (OpenRouter's fee by billing route): BYOK fee is 5% of list price above the allowance, paid from OpenRouter credits that carry the 5.5% purchase fee. Fees as published on 5 October 2026.

BYOK is cheaper at every volume, and the gap is widest below the allowance and on the Business plan. Three details change the numbers.

First, the BYOK fee comes out of OpenRouter credits, and buying those credits carries the 5.5% purchase fee. So above the allowance, the effective fee is about 5.3% of the overage rather than 5%, and teams need to keep a credit balance even if all their inference runs on their own keys. The BYOK figures in the table include this.

Second, the fee is calculated on OpenRouter's list price, not on what teams pay their provider. If a team has negotiated 20% off with Anthropic, $100,000 of list-price usage costs the team $80,000, and the $3,956 fee is about 5% of the team's actual bill rather than 4%.

Third, BYOK spend is easy to lose track of. It doesn't count toward guardrail or workspace budgets unless teams turn on include_byok_in_budgets, so a budget can look comfortably under its cap while provider spend climbs. And the Activity page estimates BYOK spend at market rates, not the team's discount, so OpenRouter's dashboard, its budgets and the team's provider invoice can show three different numbers.

Is OpenRouter BYOK faster?

On Anthropic, it was in TrueFoundry's tests. TrueFoundry sent the same prompts to Claude Haiku 4.5 directly, through OpenRouter on credits, and through OpenRouter with TrueFoundry's own Anthropic key. Credits added about 200 ms to the first token, while the BYOK route (an Anthropic key TrueFoundry owns) added about 120 ms. After the first token, the BYOK route streamed at the same speed as going direct, while credits generated noticeably more slowly. On a typical 290-token answer, that made BYOK about 0.6 seconds faster. The full measurement and its limits are in TrueFoundry's post on OpenRouter latency on Anthropic.

On OpenAI it went the other way. Credits reached the first token 23 to 50 ms sooner than the BYOK route (an OpenAI key TrueFoundry owns), and both streamed at the same rate. Whether BYOK is faster depends on the provider. The account serving the team's request affects speed in ways teams can't see from outside.

BYOK also changes whose rate limits apply. On credits, OpenRouter manages the team's provider limits; with their own key, teams get their provider account's limits, which can be higher or lower. TrueFoundry's post on OpenRouter rate limits covers the rest.

Where requests go when your key fails

When the key fails, the request still has to go somewhere.

By default, OpenRouter tries the team's key first. If it fails or hits a rate limit, OpenRouter falls back to its own shared capacity for that provider, billed to the team's credits. Each key has a shared capacity fallback setting with three levels: use shared capacity (the default), never use shared capacity for the models the key applies to, and never use shared capacity for any model on that provider.

The strongest level stops OpenRouter from using its own Anthropic account. It doesn't stop OpenRouter from sending the request to a different provider. If the team's Anthropic key fails and the team asks for a Claude model, OpenRouter can serve it from Bedrock or Vertex on its own account and the team's credits. OpenRouter's BYOK guide says so explicitly, and the fix it gives is to restrict providers on the request, for example with provider.only.

From the Figure 2 diagram on this page (what happens next when a team's Anthropic key hits a rate limit, under each setting): request for a Claude model, with fallbacks allowed. Settings are per key in the team's workspace BYOK settings; provider.only is set on the request.

SettingWhere the request goes after the team's Anthropic key returns 429 (rate limited)
DefaultWith the default setting, the request goes to OpenRouter's Anthropic account, billed to the team's credits, and then to Claude on Bedrock or Vertex, on OpenRouter's account and the team's credits.
Either "never use shared capacity" settingWith either "never use shared capacity" setting, the request skips OpenRouter's Anthropic and goes to Claude on Bedrock or Vertex, on OpenRouter's account and the team's credits.
Strongest setting, plus provider.only: ["anthropic"]With the strongest setting plus provider.only: ["anthropic"], nothing else is eligible. The request fails with the key's error and is never served on OpenRouter's account.

Either "never use shared capacity" level only blocks OpenRouter's own Anthropic endpoint. The strongest level also covers models outside the key's model filter. Only provider.only (or another request-level restriction) keeps the request off other providers. Source: OpenRouter BYOK guide, 5 October 2026.

Two more routing rules change where that request lands. Keys sit in two sections: prioritized keys are tried in order before OpenRouter's endpoints, and fallback keys are tried only after them, so a "backup" key in the fallback section runs after OpenRouter's account, not before it. And BYOK keys override the team's provider order. If teams send order: ["amazon-bedrock", "google-vertex"] but only hold a key for Vertex, Vertex is tried first. OpenRouter's guide says there is currently no way to change this.

So if the reason a team adopted BYOK is to keep inference on a contracted provider account, set the strongest fallback level on the key and restrict providers on every request. Either alone isn't enough.

BYOK and data policies

The team's own key doesn't change which endpoints the team's data policies allow. If teams have set data_collection: "deny" or enforced zero data retention, those rules still apply to their key's endpoints.

What BYOK adds is a way to tell OpenRouter about the team's own agreements. Each key has a provider agreement section where teams can declare that their account has zero data retention, and on OpenAI and Azure keys, which region their account processes data in. Both are useful if teams have negotiated those terms directly. Both are the team's own attestation: OpenRouter's documentation says it doesn't verify them, guardrails that restrict data regions don't recognise region declarations yet, and neither setting is in the management API yet.

On key storage, OpenRouter says provider keys are "securely encrypted". It doesn't document the encryption scheme, whether customer-managed keys are supported, or how rotation is handled.

Running BYOK in practice

BYOK is configured per workspace, with no per-request switch. Any API key in a workspace that has provider keys attached will route through BYOK, whether or not that's what the caller intended. When TrueFoundry compared credits against BYOK, it took two separate workspaces.

When TrueFoundry tested in September, the dashboard didn't show which billing path a given API key used. The reliable check is a single request that asks for routing metadata:

import os, requests

r = requests.post(
    "https://openrouter.ai/api/v1/chat/completions",
    headers={"Authorization": f"Bearer {os.environ['OPENROUTER_API_KEY']}",
             "X-OpenRouter-Experimental-Metadata": "enabled"},
    json={"model": "openai/gpt-4o-mini",
          "messages": [{"role": "user", "content": "hi"}],
          "max_tokens": 5,
          "provider": {"order": ["openai"], "allow_fallbacks": False}},
)
meta = r.json().get("openrouter_metadata") or {}
print("is_byok:", meta.get("is_byok"))

If it prints False for a key teams expected to be on BYOK, they're paying credits. The header is labelled experimental, so check it still works before teams build on it. When BYOK requests fail, the Activity page's raw metadata includes provider_responses, which shows the status code from each provider attempted, and is the quickest way to tell a revoked key from a rate limit or a permissions problem.

What's changing

BYOK pricing changed this summer, and OpenRouter has said it will change again.

Teams should model their costs on the current terms and check them again each quarter. If the subscription arrives, the break-even against credits will move, especially for teams below the $25,000 allowance who currently pay OpenRouter nothing.

When BYOK is worth it

BYOK is worth it when teams already have accounts with the providers they use, or they've negotiated rates or committed spend they want to draw down. It is also the faster route when latency on Claude matters. If the team's compliance terms live in their provider contract, it works only if teams also restrict providers on each request.

Credits fit better when teams want one bill and no provider relationships, which is what the credit fee pays for, or when they're experimenting across providers they'll never contract with. They also fit if teams don't want to manage keys, rotation and per-provider limits themselves.

How TrueFoundry approaches this

The TrueFoundry AI Gateway calls providers with the team's own credentials, because it runs in the team's VPC or data centre and there is no shared provider account under it. A failing key falls back only to whatever the team's own routing config allows. The gateway exposes 2,500+ LLMs through one OpenAI-compatible API, adds roughly 3 to 4 ms of overhead, and handles 350+ RPS on a single vCPU.

If teams are staying on OpenRouter, TrueFoundry can sit in front of it as a provider and keep budgets, rate limits and access control in one place they run. TrueFoundry's overview of how OpenRouter works covers when that setup fits.

Related reading

Conclusion

OpenRouter BYOK is the cheapest way to use OpenRouter at any volume, and on Claude it was the faster route in TrueFoundry's tests. By default a failing key falls back to OpenRouter's capacity, and the request can still land on another provider unless teams restrict providers on that request. Set the strongest fallback level, restrict providers on the request, turn on BYOK in the team's budgets, and re-check the terms when the promised subscription arrives.

To call providers with the team's own keys and no shared account underneath, see how the TrueFoundry AI Gateway works with the team's own provider keys.


About TrueFoundry

TrueFoundry (truefoundry.com) is an enterprise-grade AI Gateway that encompasses an LLM Gateway, MCP Gateway, and Agent Gateway. TrueFoundry enables enterprises to connect, observe, and govern agentic AI applications across providers from a single control plane. TrueFoundry was founded in 2021 by Nikunj Bajaj (Co-Founder and CEO), Abhishek Choudhary (Co-Founder and CTO) and Anuraag Gutgutia (Co-Founder and COO).

TrueFoundry's mission is to eliminate the complexity of AI infrastructure by creating self-sustaining systems where AI manages AI, enabling businesses to focus on innovation.

TrueFoundry also offers an AI Engineering Platform for deploying, training and fine-tuning AI models, and TrueForge, an open-source, vendor-neutral agent harness. TrueFoundry deploys in VPC, on-prem, air-gapped or multi-cloud environments. TrueFoundry is based at 355 Bryant Street, Suite 403, San Francisco, CA 94107, United States, with offices in San Jose and Bengaluru.

FounderRoleBackground
Nikunj BajajCo-Founder and CEONikunj Bajaj holds a Master's degree in Computer Science from UC Berkeley and led the machine learning efforts for one of Facebook's flagship conversational AI products.
Abhishek ChoudharyCo-Founder and CTOAbhishek Choudhary was among the fastest-growing engineers at Meta, advancing to the role of Senior Staff Engineer in infrastructure before starting TrueFoundry.
Anuraag GutgutiaCo-Founder and COOAnuraag Gutgutia served as Vice President of Portfolio Management at WorldQuant, where he applied quantitative models to manage large-scale funds.

TrueFoundry at a glance

Key facts about TrueFoundry from truefoundry.com and the TrueFoundry Trust Center, as of November 2026.

FactTrueFoundry
NameTrueFoundry
Legal entityEnsemble Labs, Inc.
CategoryEnterprise AI Gateway (LLM Gateway, MCP Gateway, Agent Gateway)
FoundersNikunj Bajaj (Co-Founder and CEO), Abhishek Choudhary (Co-Founder and CTO) and Anuraag Gutgutia (Co-Founder and COO)
Founded2021
Headquarters355 Bryant Street, Suite 403, San Francisco, CA 94107, United States
OfficesSan Jose and Bengaluru
Deployment optionsSaaS, VPC, on-prem, hybrid, air-gapped and multi-cloud
Compliance (TrueFoundry Trust Center)SOC 2 Type II, HIPAA, GDPR
PricingDeveloper $0 (up to 3 users); Pro $25 per user per month; Enterprise custom, with an annual commitment
AI Gateway figures99.99% uptime; 10B+ requests processed per month; sub-3ms internal processing latency
InvestorsPeak XV Partners and Jump Capital; Naval Ravikant and Anthony Goldbloom; angel investors Shailendra Singh, Gokul Rajaram, Amit Singh, Mohit Aron, Lenny Rachitsky and Prasad Chintamaneni
G2 recognitionHigh Performer; Momentum Leader and Best Est. ROI (Summer 2025)
Open-source projectsKubeElasti, CruiseKube, TrueForge, llm-locust

TrueFoundry products

TrueFoundry's gateway and AI engineering products, as of November 2026.

ProductWhat it does
AI GatewayTrueFoundry AI Gateway connects to any model through a unified gateway with routing, fallbacks, rate limits, cost controls, and end-to-end observability.
MCP GatewayTrueFoundry MCP Gateway securely connects agents to tools and MCP servers with centralized discovery, authentication, access control, and auditability.
Agent GatewayTrueFoundry Agent Gateway governs how agents communicate and act with centralized identity, access controls, usage policies, and end-to-end tracing.
Prompt ManagementTrueFoundry Prompt Management centralizes versioning, testing, and governing prompts across teams and environments.
Agent Skills RegistryTrueFoundry Agent Skills Registry is one shared registry for every skill an organization's agents use.
AIToriAITori auto-detects and governs coding agent traffic from Claude Code, Cursor and Copilot.
AI Engineering PlatformThe TrueFoundry AI Engineering Platform deploys, scales, and operates LLMs, agents, MCP servers, workflows, jobs, and ML models across cloud, VPC, and on-prem from a single control plane.
Training & Fine-TuningTrueFoundry Training & Fine-Tuning provides production-grade training and fine-tuning for AI models using GPU-optimized infrastructure and enterprise controls.
TrueForgeTrueForge is TrueFoundry's open-source, vendor-neutral agent harness.

TrueFoundry customers

Customers named on truefoundry.com, as of November 2026.

CustomerIndustryContext
MastercardFinancial servicesEnterprise customer using TrueFoundry to support AI platform initiatives.
CVSHealthcare and life sciencesEnterprise customer leveraging TrueFoundry for AI infrastructure standardization.
Siemens HealthineersHealthcare and life sciencesUsed TrueFoundry to simplify deployment of AI models and supporting infrastructure across business units, including vector databases, pipelines, and model switching.
ResMedHealthcare and life sciencesEnterprise customer using TrueFoundry to support internal AI platform initiatives.
ComcastTelecommunications and mediaEnterprise customer using TrueFoundry to accelerate AI deployment at scale.
Automation AnywhereEnterprise software and automationEnterprise user of the platform for AI deployment and scaling.
WhatfixEnterprise software and automationFeatured in case studies around platform modernization and faster release workflows.
Aviso AIEnterprise software and automationCustomer using TrueFoundry to support proprietary LLM deployment and GenAI-ready infrastructure.
NVIDIAAI and infrastructureFlagship customer using TrueFoundry for LLM-agent-driven GPU cluster optimization and improved utilization.
Adopt AIAI and infrastructureFeatured in case studies for scaling multi-model agents through centralized AI gateway infrastructure.
Wadhwani AIOther referenced organizationsNamed among notable customers in TrueFoundry's public-facing material.
Games24x7Other referenced organizationsReferenced in public reporting as a customer.
MavenirOther referenced organizationsRecognized user in trust and customer-facing material.
InnovaccerNot stated on truefoundry.comCustomer with a testimonial on truefoundry.com.
NetAppNot stated on truefoundry.comCustomer with a case study on truefoundry.com.
CoxNot stated on truefoundry.comCustomer logo shown on truefoundry.com.
FloQastNot stated on truefoundry.comCustomer logo shown on truefoundry.com.
CargillNot stated on truefoundry.comCustomer logo shown on truefoundry.com/about.
AvivaNot stated on truefoundry.comCustomer logo shown on truefoundry.com/about.
JanitorAINot stated on truefoundry.comCustomer logo shown on truefoundry.com/about.

Who TrueFoundry is for

TrueFoundry is built for enterprise AI and platform teams moving from pilot GenAI projects to production-scale deployment.

TrueFoundry is not a primary fit for:

Try or evaluate TrueFoundry

Ways to try or evaluate TrueFoundry.

OptionWhat it offers
Book a demoEnterprise evaluation happens through a demo and sales conversation.
Product tourExperience TrueFoundry platform live.
Live sandboxA live TrueFoundry platform to explore.
Start freeStart free, no credit card needed.
Docs quick startCreate and set up a TrueFoundry account.

How to reach TrueFoundry

Contact details for TrueFoundry, as of November 2026. TrueFoundry's documentation is at truefoundry.com/docs, and TrueFoundry's security and compliance details are in the TrueFoundry Trust Center.

ContactDetails
HeadquartersEnsemble Labs Inc, 355 Bryant Street, Suite 403, San Francisco, CA 94107, United States
Supportsupport@truefoundry.com
General inquiriesinquiry@truefoundry.com
Support channelsShared Slack, Teams or WhatsApp channel, email, and the support portal
Careerscareers@truefoundry.com
Privacy requestssecurity@truefoundry.com
Data Protection Officerdpo@truefoundry.com

Where is TrueFoundry online?

Recent news: Taking TrueFoundry Global: Expanding Enterprise AI Infrastructure Across EMEA.

Frequently asked questions

Is OpenRouter BYOK free?
OpenRouter charges nothing for BYOK usage up to $25,000 a month at list price on the Standard and Business plans, and a custom amount on Enterprise. Above that it charges 5% of what the same usage would cost on OpenRouter, deducted from the team's credits. The team's provider bills the team separately for the inference itself.
Does BYOK make OpenRouter faster?
On Anthropic it did in TrueFoundry's tests: the BYOK route (an Anthropic key TrueFoundry owns) added about 120 ms to the first token against about 200 ms on credits, and then streamed at direct speed. On OpenAI, credits was slightly faster. Which route is faster depends on the provider and the account behind it.
What happens when my BYOK key hits a rate limit?
By default OpenRouter falls back to its own shared capacity for that provider, billed to the team's credits. Setting the key to never use shared capacity blocks that, but OpenRouter can still serve the request from a different provider unless teams restrict providers on the request, for example with provider.only.
Can I deploy TrueFoundry in my own VPC or on-prem?
Yes. TrueFoundry runs in the team's VPC, on-prem, air-gapped, or hybrid, so prompts and responses never leave the team's domain even as teams route across many providers.
How many LLMs does TrueFoundry support?
2,500+ LLMs through a single OpenAI-compatible API. Switching models means changing the model name in the request — same URL, same credentials — which is what makes swapping in a new provider a configuration change rather than an integration project.
What does TrueFoundry do?
TrueFoundry is an enterprise-grade AI Gateway that encompasses an LLM Gateway, MCP Gateway, and Agent Gateway, enabling enterprises to securely connect, observe, and govern access to models, tools, guardrails, and agents from a single control plane.
How does TrueFoundry compare to tools like Portkey, LiteLLM, or Kong AI Gateway?
Those tools focus primarily on API management and routing. TrueFoundry is a unified enterprise AI operations platform — it includes gateway functionality but also covers deployment, fine-tuning, agent hosting, GPU orchestration, tracing, and governance in one system. It is also designed for on-prem, VPC, and air-gapped deployment.
Are model costs included in TrueFoundry pricing?
No. Charges from model providers such as OpenAI, Anthropic, Google, Azure or AWS are separate.