Skip to main content
This guide provides instructions for integrating Future AGI with the TrueFoundry AI Gateway to export OpenTelemetry traces.

What is Future AGI?

Future AGI is an end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Its Observe workspace ingests OTLP traces so you can monitor gateway traffic, debug agent workflows, analyze latency and token usage, and run evaluations on production spans.

Key capabilities

Prerequisites

Before integrating Future AGI with TrueFoundry, ensure you have:
  1. TrueFoundry account: Create a TrueFoundry account and follow our Gateway Quick Start Guide
  2. Future AGI account: Sign up at Future AGI and access your project dashboard
  3. API credentials: Obtain your API key and secret key from the Future AGI dashboard under BuildKeys
The TrueFoundry OTEL Config export sends traces only for the AI Gateway. It does not export OTEL metrics from this screen.

OTLP traces endpoint

Future AGI exposes a dedicated OTLP/HTTP traces endpoint:
https://api.futureagi.com/tracer/v1/traces

Integration steps

TrueFoundry AI Gateway supports exporting OpenTelemetry traces to Future AGI over OTLP/HTTP so you can monitor LLM gateway traffic in the Future AGI Observe dashboard.
1

Get your Future AGI API credentials

  1. Log in to your Future AGI dashboard.
  2. Go to BuildKeys.
  3. Copy your API key and secret key, and store them securely — you will use them as X-Api-Key and X-Secret-Key in TrueFoundry.
Both keys are required for OTLP trace ingestion. If export fails with auth errors, verify the keys are active and copied without extra whitespace.
2

Configure OTEL export in TrueFoundry

  1. Go to AI GatewayControlsSettings in the TrueFoundry dashboard.
  2. Scroll to OTEL Config and click the edit (pencil) control.
  3. Enable Otel Traces Exporter Configuration.
  4. Select HTTP Configuration.
  5. Set Endpoint to https://api.futureagi.com/tracer/v1/traces.
  6. Set Encoding to Json.
TrueFoundry OTEL Traces Exporter Configuration for Future AGI with HTTP endpoint, Json encoding, API headers, and resource attributes
3

Configure headers, resource attributes, and save

Enable Headers and add:
HeaderValue
X-Api-KeyYour Future AGI API key
X-Secret-KeyYour Future AGI secret key
Enable Additional Resource Attributes and add:
AttributeValue
project_nameYour Future AGI project name (for example devtest)
project_typeobserve
project_type must be set to observe so traces are routed to the Future AGI Observe workspace. project_name can be any name you choose — it determines which project the gateway traces appear under in Future AGI.
Click Save to apply the configuration.
4

Verify the integration

  1. Send a few requests through the TrueFoundry AI Gateway.
  2. In TrueFoundry, open Monitor to confirm gateway traffic is flowing.
  3. In Future AGI, open your project and go to ObserveTracing.
  4. Confirm new traces appear with trace names, latency, status, and timestamps for your gateway requests.
Future AGI Observe Tracing dashboard showing gateway traces with latency, status, and traffic graph

Configuration reference

ConfigurationValue
Traces endpointhttps://api.futureagi.com/tracer/v1/traces
ProtocolHTTP (OTLP)
EncodingJson
HeadersX-Api-Key set to your API key; X-Secret-Key set to your secret key
Resource attributesproject_name set to your project name; project_type set to observe