Skip to main content

TrueFoundry Docs home page

Book Demo
Blog
Sign Up
Sign Up

Get Started

AI Gateway Overview
Quick Start

LLM Gateway

AI Gateway Playground
Access Control
Caching (Exact and Semantic)
Cost Tracking

MCP Registry and Gateway

Overview
Getting Started
Authentication and Security
Using MCP Gateway in Agent
Virtual MCP Server
OpenAPI to MCP Server
Common Tools MCP Server

Agent Hub

Agent Hub
Agent API

Guardrails and Security

Overview
Getting Started
Configuration
Bring your own Guardrail / Plugin

Prompt Management

Overview
Playground
Prompt Versioning
Using Prompts

Observability

View Metrics
View Traces
Configure Data Access
Configure Data Routing
API Access to Metrics
API Access to Logs

Deployment

Architecture
Deployment Options
Globally Distributed SAAS
Install AI Gateway

Admin Guide

Setup AI Gateway in Org
Use Secret Manager

Chat

POST
Chat Completions

Agent

POST
Agent Responses
POST
Agent App

Embeddings

POST
Generate Embeddings

Rerank

POST
Rerank Documents

Responses

GET
List Model Response Input Items
GET
Get Model Response
DEL
Delete Model Response
POST
Model Responses

Image

POST
Generate images from a prompt
POST
Edit images based on a prompt
POST
Creates a variation of an image.

Audio

POST
Transcribe Audio

Batch

GET
List batches
POST
Create Batch
GET
Get Batch
GET
Get Batch Output
POST
Cancel Batch

Files

GET
List Files
POST
Upload File
GET
Get File
DEL
Delete file
GET
Get File Content

Moderations

POST
Post moderations

Models

GET
List available models

Routing Config

Global YAML-based routing configuration for TrueFoundry AI Gateway

This page has moved. See Virtual Models.

Was this page helpful?

⌘I

Powered byThis documentation is built and hosted on Mintlify, a developer documentation platform

Assistant

Responses are generated using AI and may contain mistakes.

Contact support