Skip to main content

​
Adding Models

Add Smallest AI models to the AI Gateway and set up access in three steps.
1

Select Smallest AI as the provider

From the TrueFoundry dashboard, go to AI Gateway > Models, click Add Model and choose To New Provider Account. Select Smallest AI from the provider list.
Add Provider Account page listing the supported model providers

Choose a provider in Add Provider Account

2

Add Smallest AI Account Details

Enter a unique account name and your Smallest AI API Key.
Smallest AI Configure Account form in the provider account setup drawer

Configure Account for Smallest AI

3

Add Models

Click Add Model Manually and fill in the Display name, Model ID, and Model type (Text to Speech or Audio Transcription).
Smallest AI Add Model form with Display name, Model ID, and Model Types fields

Add a Smallest AI model

For Smallest AI, the Model ID and Display name must be identical (e.g. smallest-tts, smallest-stt).
4

Save and grant access

Click Test Credentials to check the account against the selected models, or click Save without Testing. To keep the account in Git instead, click Apply using YAML and apply the generated spec with tfy apply.To let other users, teams or virtual accounts use or manage these models, open Manage Accounts, click ⋮ on the account and choose Access Control > Grant Access. See Access control.

​
Inference

Once models are added, use the Smallest AI native HTTP API to call TTS and STT endpoints through the AI Gateway. Requests are proxied to Smallest AI’s Waves API under your model account path.

​
Supported APIs

Once your Smallest AI model account is configured, the following API surfaces are available through the AI Gateway. The table below summarizes each endpoint alongside platform feature support (tracing, cost tracking).
Legend:
  • ✅ Supported by provider and TrueFoundry
  • Supported by Provider, but not by TrueFoundry
  • Provider does not support this feature
Convert text into audio using Smallest AI’s Waves TTS API. The AI Gateway forwards your request to waves/v1/smallest-tts/get_speech under your model account and streams back the raw audio bytes. Full docs: Text-to-Speech.Before you start: Replace {GATEWAY_BASE_URL} with your gateway base URL (how to find it) and {smallestAiProviderAccountName} with the display name of your Smallest AI model account.
Python
For the full list of voices, supported sample rates, languages, and output formats, refer to the Smallest AI Waves TTS reference.
Transcribe audio with Smallest AI’s Waves STT API. The AI Gateway forwards your request to waves/v1/smallest-stt/get_text under your model account. You can pass a remote audio URL via the JSON body. Full docs: Speech-to-Text.
Python
Smallest AI returns a JSON object containing the transcription field. Refer to the Smallest AI Waves STT reference for additional parameters and supported languages.
Cost tracking: Smallest AI usage is not metered by the AI Gateway. Tracing and request logging continue to work as with any other provider — see Metrics Dashboard.