MCP Gateway

Overview

TrueFoundry AI Gateway enables you to expose integrated MCP Servers to developers in a secure manner.

Diagram showing TrueFoundry AI Gateway architecture with MCP Servers integration

This allows you to:

Manage who can use the registered MCP Servers.

Avoid exposing MCP Server credentials directly to the developers.

Monitor usage metrics (latency, execution per second) of the tools across all registered MCP Servers. (Coming soon.)

Rate-limit tool calls. (Coming soon.)

This is useful for expensive tools like search, code-execution, etc.

Quickstart

Copy the code snippet

TrueFoundry Dashboard showing where to find the MCP server code snippet in AI Gateway UI — Get your code snippet from the AI Gateway UI

TrueFoundry Dashboard showing code snippet interface for MCP server integration — Copy the code snippet from the UI for quick integration

Copy PAT or VAT

See API Keys for more details on creating PATs and VATs.

Call the MCP Server from your code

At this point, we can use the code snippet we copied at Step 1.Below is an example showing how to connect, list tools, and call tools on an MCP Server. Update the placeholders with your actual credentials and tool names.

TypeScript
Python

Install the library:

npm install @modelcontextprotocol/sdk

Code:

import { Client } from "@modelcontextprotocol/sdk/client/index.js";
import { StreamableHTTPClientTransport } from "@modelcontextprotocol/sdk/client/streamableHttp.js";

// Example usage (runs if this file is executed directly)
// Run with: npx ts-node typescript-mcp-client.ts
(async () => {
    const url = '{GATEWAY_BASE_URL}/mcp/<integrationId>/server';
    const authToken = '<tfy-api-token>'; // Replace with your actual TFY API token (PAT or Service account token)
    const toolName = '<tool-name>';      // Replace with your actual tool name
    const args = {};                     // Replace with your actual tool arguments

    const requestInit: RequestInit = {
        headers: { Authorization: `Bearer ${authToken}` }
    };
    const baseUrl = new URL(url);
    const client = new Client({ name: "streamable-http-client", version: "1.0.0" });
    await client.connect(new StreamableHTTPClientTransport(baseUrl, { requestInit }));

    const tools = await client.listTools();
    console.log("Available tools:", tools);

    const result = await client.callTool({ name: toolName, arguments: args });
    console.log("Tool result:", result);
})();

Install the library:

pip install fastmcp

Code:

from fastmcp import Client

token = "<tfy-api-token>" # Replace with your actual TFY API token (PAT or VA Token)
async def main():
    url = "{GATEWAY_BASE_URL}/mcp/<integrationId>/server"
    async with Client(url, auth=token) as client:
        tools = await client.list_tools()
        for tool in tools:
            print(f"Tool: {tool.name}")
            print(f"Description: {tool.description}")
            print(f"Parameters: {tool.inputSchema}")
        print("--------------------------------")
        tool_name = "echo"  # Replace with your actual tool name
        tool_args = {"message": "hello"}  # Replace with your actual tool arguments
        results = await client.call_tool(tool_name, tool_args)
        print(f"Result: {results}")
        print("--------------------------------")

if __name__ == "__main__":
    import asyncio
    asyncio.run(main())

Configuration

Required Parameters

Parameter	Description
`url`	The MCP server URL (e.g., `{GATEWAY_BASE_URL}/mcp/<integrationId>/server`)
`authToken`	Your TrueFoundry API token (PAT or user token)
`toolName`	The name of the tool you want to invoke
`args`	The arguments to pass to the tool

Replace the placeholders in the example:

{GATEWAY_BASE_URL} with your TrueFoundry AI Gateway base URL
<integrationId> with your MCP server ID
<tfy-api-token> with your TrueFoundry API token
<tool-name> with the name of the tool you want to use

Get Started

LLM Gateway

MCP Registry and Gateway

Skills Registry

Prompt Registry

Guardrails and Security

Observability

Deployment

Admin Guide

Chat

Messages

Embeddings

Rerank

Responses

Image

Audio

Batch

Files

Fine-tuning

Moderations

Models

Overview

Quickstart

Configuration

Required Parameters

Supported Transports

​Overview

​Quickstart

​Configuration

Required Parameters

​Supported Transports

Overview

Quickstart

Configuration

Supported Transports