Skip to main content
Baseten hosts open-source and custom models behind an OpenAI-compatible Model API. TrueFoundry connects to Baseten through the AI Gateway at https://inference.baseten.co/v1. Baseten models support chat completions, streaming, and embeddings (where the model supports it).

Adding Models

This section explains the steps to add Baseten models and configure the required access controls.
1

Select Baseten as the provider

From the TrueFoundry dashboard, go to AI Gateway > Models, click Add Model and choose To New Provider Account. Select Baseten from the provider list.
Add Provider Account page listing the supported model providers

Choose a provider in Add Provider Account

2

Add Baseten Account Details

Give a unique name to your Baseten account and complete the form with your Baseten authentication details (API Key).Under advanced settings, you can optionally set a Discount % that is applied to the upstream list price for this account.
Baseten Configure Account form in the provider account setup drawer

Configure Account for Baseten

3

Add Models

Click Add Model Manually and fill the form:
  • Display Name: the name shown in the TrueFoundry UI.
  • Model ID: the model identifier from Baseten’s model catalog.
  • Model Types: select the type of the model (defaults to Chat).
  • Cost (optional): cost metrics used for cost tracking.
4

Save and grant access

Click Test Credentials to check the account against the selected models, or click Save without Testing. To keep the account in Git instead, click Apply using YAML and apply the generated spec with tfy apply.To let other users, teams or virtual accounts use or manage these models, open Manage Accounts, click ⋮ on the account and choose Access Control > Grant Access. See Access control.

Inference

After adding the models, you can perform inference using an OpenAI-compatible API via the Playground or by integrating with your own application. Use the TrueFoundry model ID in the format your-baseten-account/your-model-display-name. See Chat Completions - Getting Started for a full code example: