TypeSafe

TypeSafe provides System One models such as Jev that evaluate a piece of content against typed questions and return calibrated answers. TrueFoundry connects to TypeSafe natively through the AI Gateway. TypeSafe models use the decision model type and are called through POST /v1/systemone, not chat completions.

You can also reach TypeSafe through Custom Endpoints. The native integration below provides model access control and cost tracking, with models addressed as account-name/model-name.

Adding Models

This section explains the steps to add TypeSafe models and configure the required access controls.

Navigate to TypeSafe in AI Gateway

From the TrueFoundry dashboard, navigate to AI Gateway > Models and select TypeSafe.

Add TypeSafe Account Details

Click Add TypeSafe Model Account. Give a unique name to your TypeSafe account and complete the form:

API Key: your TypeSafe API key. It is sent to TypeSafe as an Authorization: Bearer token.
Base URL (optional): defaults to https://api.typesafe.ai. Change this only if TypeSafe directs you to a different endpoint.

Add collaborators to your account, this will give access to the account to other users/teams. Learn more about access control here.Under advanced settings, you can optionally set a Discount % that is applied to the upstream list price for this account.

Add Models

Click + Add Model and fill the form:

Display Name: the name shown in the TrueFoundry UI, for example jev.
Model ID: the TypeSafe model identifier, for example jev-1.13.0 or jev-latest. Pin a versioned ID so confidence thresholds stay stable across releases.
Model Types: Decision (default).
Cost (optional): TypeSafe bills input tokens only, so set the output cost to 0.

Inference

Call the model with the TrueFoundry model ID in the format your-typesafe-account/your-model-display-name. Send the content in state and named questions in questions. This example asks a yes/no (noul) question about a support message. Set GATEWAY_BASE_URL to your gateway base URL without a trailing slash and TFY_API_KEY to your TrueFoundry API key.

import os

import requests

gateway_base_url = os.environ["GATEWAY_BASE_URL"].rstrip("/")
response = requests.post(
    f"{gateway_base_url}/v1/systemone",
    headers={"Authorization": f"Bearer {os.environ['TFY_API_KEY']}"},
    json={
        "model": "my-typesafe-account/jev",  # provider account / model display name
        "state": {"message": "My subscription was charged twice this month."},
        "questions": {
            "billing": {
                "type": "noul",
                "instructions": "Does this message describe a billing issue?",
            }
        },
    },
    timeout=60,
)
response.raise_for_status()
print(response.json()["answers"]["billing"])

curl --fail-with-body -X POST "${GATEWAY_BASE_URL}/v1/systemone" \
  -H "Authorization: Bearer ${TFY_API_KEY}" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "my-typesafe-account/jev",
    "state": {"message": "My subscription was charged twice this month."},
    "questions": {
      "billing": {
        "type": "noul",
        "instructions": "Does this message describe a billing issue?"
      }
    }
  }'

The response contains the versioned model that served the request, an answers object keyed by your question IDs, and usage with input_tokens and output_tokens. See the TypeSafe API reference for all question types.

Get Started

LLM Gateway

MCP Registry and Gateway

Skills Registry

Prompt Registry

Guardrails and Security

Observability

Deployment

Admin Guide

Chat

Messages

Embeddings

Rerank

Responses

Image

Audio

Batch

Files

Fine-tuning

Moderations

Video

Models

Adding Models

Inference

​Adding Models

​Inference

Adding Models

Inference