Ask TFY by TrueFoundry | Debug, Analyse, and Act on Your AI Gateway

TrueFoundry announces the acquisition of Seldon AI, expanding its Control Plane for Enterprise AI. Full press release →

Debug

Instantly identify root cause of failures without hunting through traces

Ask TFY cross-references your live traces, routing rules, and guardrail configurations to classify errors by type and pinpoint whether failures were client-side or caused by a model provider outage, cutting hours of manual investigation down to a single prompt.

Analyze

Generate custom reports grounded in your actual gateway data

Ask TFY queries across your traces, provider prompt cache utilization, MCP tool calls, and budget consumption simultaneously, rendering custom live graphs that surface issues before they become incidents.

Configure

Go from root cause to live fix without leaving the conversation

Ask TFY applies budget rules, virtual model fallback configurations, and routing policy updates directly on instruction, so the gap between identifying a production issue and resolving it collapses to seconds.

Made for Real-World AI at Scale

99.99%

uptime

Centralized failovers, routing, and guardrails ensure your AI apps stay online, even when model providers don’t.

10B+

Requests processed/month

Scalable, high-throughput inference for production AI.

30%

Average cost optimization

Smart routing, batching, and budget controls reduce token waste.

Enterprise-Ready

Deploy a secure AI gateway that keeps your data and models within your cloud / on-prem infrastructure.

HIPAA, GDPR, and AICPA SOC compliance badges for data security and privacy regulations standards.

Compliance & Security
SOC 2, HIPAA, and GDPR standards to ensure robust data protection
Governance & Access Control
SSO + Role-Based Access Control (RBAC) & Audit Logging
Enterprise Support & Reliability
24/7 support with SLA-backed response SLAs

Deploy TrueFoundry in any environment

VPC, on-prem, air-gapped, or across multiple clouds.

No data leaves your domain. Enjoy complete sovereignty, isolation, and enterprise-grade compliance wherever TrueFoundry runs

Get Started

Cloud deployment options including On-Prem, Multi-Cloud, Air-gapped, and AWS, Google Cloud Platform.

TrueFoundry’s AI Gateway standardized how every team interacts with LLMs, embeddings, and RAG components. Instead of scattered integrations, we now control access, routing policies, and safety guardrails centrally. The ability to optimize for cost or latency without changing applications has been a game-changer. It’s made our AI architecture cleaner, more secure, and far easier to scale.

Smiling man with beard and short dark hair in a collared shirt and blazer.

Indroneel G.

Head of IT, Siemens Healthineers

Frequently asked questions

What is Ask TFY?

Ask TFY is an AI agent built into TrueFoundry's AI gateway that has live access to your traces, models, MCP servers, guardrail configurations, and budget rules. You ask it questions in plain language and it investigates, generates reports, and applies configuration changes on your behalf.

How does Ask TFY help with debugging AI gateway failures?

Ask TFY scans your live traces for a given application and time range, classifies errors by type, and identifies whether failures were client-side or caused by an upstream model provider. It then recommends the exact configuration change needed to fix the issue and applies it when instructed.

Can Ask TFY generate reports that aren't available in my observability dashboard?

Yes. Ask TFY can surface provider prompt cache utilization by request, MCP tool call coverage against guardrail configuration, cost breakdowns by model, developer, or application, and error pattern analysis across any time range, all rendered as live graphs in the chat.

What configuration changes can Ask TFY apply directly?

Ask TFY can enforce budget rules, configure virtual model fallbacks, and update routing policies when instructed. Every change is initiated explicitly from the conversation, so you stay in full control of what gets applied and when.

How is Ask TFY different from TrueFoundry's built-in monitoring dashboard?

TrueFoundry's monitoring dashboard shows you what happened. Ask TFY investigates why it happened, recommends a fix, and applies it, without you manually cross-referencing traces, guardrail configs, and routing rules across separate screens.

Which MCP security gaps can Ask TFY identify?

Ask TFY cross-references your live MCP traffic against your guardrail configuration to identify every tool call running without guardrail coverage. This lets you find and close security gaps that would otherwise require manually filtering traces per server and checking configs separately.