Skip to main content
This guide provides instructions for integrating Confident AI with the TrueFoundry AI Gateway to export OpenTelemetry traces.

​
What is Confident AI?

Confident AI is an AI observability and evaluation platform for LLM applications. Its Observatory ingests OTLP traces so you can monitor completions, debug agent workflows, run online evaluations, and analyze latency and cost alongside production traffic.

​
Key capabilities

​
Prerequisites

Before integrating Confident AI with TrueFoundry, ensure you have:
  1. TrueFoundry account: Create a TrueFoundry account and follow our Gateway Quick Start Guide
  2. Confident AI account: Sign up at Confident AI and access your project dashboard
  3. Confident AI API key: Create an API key from your Confident AI project settings — it is used to authenticate OTLP trace export
The TrueFoundry OTEL Config export sends traces only for the AI Gateway. It does not export OTEL metrics from this screen.

​
OTLP traces endpoint

Confident AI exposes a dedicated OTLP/HTTP traces endpoint. Use the URL for your region: 
https://otel.confident-ai.com/v1/traces
For EU deployments: 
https://eu.otel.confident-ai.com/v1/traces
Confident AI accepts OTLP over HTTP only — gRPC is not supported.

​
Integration steps

TrueFoundry AI Gateway supports exporting OpenTelemetry traces to Confident AI over OTLP/HTTP so you can monitor LLM gateway traffic in the Confident AI Observatory.
1

Create a Confident AI API key

  1. Log in to your Confident AI dashboard.
  2. Open your project and go to Settings → API Keys (or the API key section in your project settings).
  3. Create a new API key, copy it, and store it securely — you will use it in the x-confident-api-key header.
The API key is tied to your Confident AI project. Traces exported from TrueFoundry land in that project when you use this key.
2

Configure OTEL export in TrueFoundry

  1. Go to AI Gateway → Controls → Settings in the TrueFoundry dashboard.
  2. Scroll to OTEL Config and click the edit (pencil) control.
  3. Enable Otel Traces Exporter Configuration.
  4. Select HTTP Configuration.
  5. Set Endpoint to https://otel.confident-ai.com/v1/traces (or the EU endpoint if your project is in the EU region).
  6. Set Encoding to Json.
TrueFoundry OTEL Traces Exporter Configuration for Confident AI with HTTP endpoint, Json encoding, Content-Type header, and x-confident-api-key
3

Configure headers and save

Enable Headers and add:
HeaderValue
Content-Typeapplication/json
x-confident-api-key<Confident_AI_API_Key>
Replace <Confident_AI_API_Key> with the key from Step 1. Click Save to apply the configuration.
Leave Exclude Request Data unchecked if you want Confident AI to receive LLM request and response payloads via the tfy.input and tfy.output span attributes.
4

Verify the integration

  1. Send a few requests through the TrueFoundry AI Gateway.
  2. In TrueFoundry, open Monitor to confirm gateway traffic is flowing.
  3. In Confident AI, go to Observability → Traces.
  4. Confirm new traces appear with latency, environment, and status details for your gateway requests.
Confident AI Observability Traces dashboard showing gateway traces with latency and production environment

​
Configuration reference

ConfigurationValue
Traces endpointhttps://otel.confident-ai.com/v1/traces (US/default) or https://eu.otel.confident-ai.com/v1/traces (EU)
ProtocolHTTP (OTLP)
EncodingJson
Auth headerx-confident-api-key: <Confident_AI_API_Key>
Content-Typeapplication/json