Add curated open-weight and frontier models to TrueFoundry’s AI Gateway without a provider account or API key.
TrueFoundry Managed Models are served on TrueFoundry’s own upstream capacity. Unlike other
providers, there is no account to create with the model vendor and no API key to configure or
rotate. Usage is billed to a prepaid credit balance.
From the TrueFoundry dashboard, navigate to AI Gateway > Models and click
Start with free credit.
TrueFoundry Managed Models on the Models page
No card is required to start.
2
Select Models
Select the models you want to enable. Input and output pricing per million tokens and the
context window are shown for each model. Click Submit and Enable to finish.
There are no credentials to enter. You can change the selection at any time.
Models Selection
3
Set Access Control
Configure who can access these models from Access Control. Learn more about access control
here.
To add or remove models later, go to Manage Accounts > TrueFoundry Managed and click
Add model.
After adding the models, you can perform inference using an OpenAI-compatible API via the Playground
or by integrating with your own application.
Python
from openai import OpenAIclient = OpenAI( api_key="your-truefoundry-api-key", base_url="{GATEWAY_BASE_URL}",)response = client.chat.completions.create( model="tfy-managed/grok-4.7", messages=[{"role": "user", "content": "Summarise this incident report."}],)
Each model’s How To Use tab gives you the Base URL, Model ID and API Key, with ready-made
snippets for the OpenAI library, LangChain, Node.js, curl and others, in both streaming and
non-streaming form.
Model identifiers are stable. Retirement of a model is announced in the changelog with a named
replacement and a migration window.
Managed model usage draws down a prepaid credit balance. Credit is bought as a separate payment and
does not appear on your plan invoice. Manage it at Settings > TrueFoundry Model Credits.
TrueFoundry Model Credits
1
Add credits
Select a preset amount or enter your own, then click Add Credits. Credit does not expire.
2
Enable automatic top-up
Set a balance threshold and a top-up amount, then click Save Changes. Credit is added
automatically from your saved card whenever the balance falls below the threshold.
Automatic top-up requires a saved card. A declined charge is retried and you are notified by
email. After repeated failures, automatic top-up is disabled so your card is not retried
indefinitely.
Every purchase appears under TrueFoundry Managed Credit History with its date, invoice number,
amount, status, and whether it was triggered by a user or by automatic top-up. Receipts are
available per transaction.
At a zero balance, managed models stop serving requests and return an error. Other provider
accounts in your gateway are unaffected. Adding credit restores service immediately, and your
model selection is unchanged. You are notified by email before and when this happens.
Managed model usage can be billed against your existing TrueFoundry invoice instead of a card.
Contact your account team to enable invoiced billing.
No provider used by TrueFoundry Managed Models trains on your prompts or completions. This applies
to every model in the catalog.Zero data retention (ZDR) means prompts and completions are never written to storage after a
request is served.
Each model is served by multiple upstream providers with automatic failover. If a provider becomes
unavailable or degrades, requests are routed to the next provider with no change on your side.Quantization is fixed per model, so a model identifier always returns the same precision regardless
of which provider serves the request.
Was this page helpful?
Assistant
Responses are generated using AI and may contain mistakes.
