Skip to main content

Documentation Index

Fetch the complete documentation index at: https://www.truefoundry.com/llms.txt

Use this file to discover all available pages before exploring further.

This guide provides instructions for integrating SigNoz with the TrueFoundry AI Gateway to export OpenTelemetry traces and metrics.

​
What is SigNoz?

SigNoz is an open-source, OpenTelemetry-native observability platform that provides distributed tracing, metrics monitoring, and log management for cloud-native applications. SigNoz Cloud is the fully managed version that requires no infrastructure setup.

​
Key Features of SigNoz

  • Distributed Tracing: Capture end-to-end traces of all LLM requests with detailed span-level visibility into latency and errors
  • Metrics Monitoring: Track aggregated usage, token counts, and latency trends across your LLM gateway with PromQL-compatible queries
  • Alerts & Dashboards: Build custom dashboards and set up alerts on gateway performance metrics

​
Prerequisites

Before integrating SigNoz with TrueFoundry, ensure you have:
  1. TrueFoundry Account: Create a TrueFoundry account and follow the instructions in our Gateway Quick Start Guide
  2. SigNoz Cloud Account: Sign up for a SigNoz Cloud account to get your ingestion endpoint and API key

​
Understanding the SigNoz Ingestion Endpoint

SigNoz Cloud organizes ingestion by region. Your ingestion URL follows this pattern: 
https://ingest.<region>.signoz.cloud:443
The region is visible in your SigNoz Cloud URL after login. Common regions are in for India and us for the United States. For example if your ingestion URL is https://ingest.in2.signoz.cloud then your region is in2.

​
Integration Steps

1

Get Your Ingestion Key from SigNoz

  1. Log into your SigNoz Cloud dashboard.
  2. Navigate to Settings → Ingestion Settings.
  3. Copy your Ingestion Key and note your ingestion URL.
Your ingestion URL contains your region. For example https://ingest.in2.signoz.cloud means your region is in2 and your traces endpoint will be https://ingest.in2.signoz.cloud:443/v1/traces.
2

Configure OTEL Export in TrueFoundry

  1. Go to AI Gateway → Controls → Settings in the TrueFoundry dashboard.
  2. Scroll down to the OTEL Config section and click the edit (✏️) button.
TrueFoundry AI Gateway Settings page showing the OTEL Config section with edit button
  1. Enable the Otel Traces Exporter Configuration toggle and fill in:
FieldValue
ToggleEnabled
ProtocolHTTP Configuration
Endpointhttps://ingest.<region>.signoz.cloud:443/v1/traces
EncodingProto
Header Keysignoz-ingestion-key
Header Value<your-ingestion-key>
TrueFoundry OTEL Traces Exporter Configuration showing HTTP endpoint pointing to SigNoz Cloud with signoz-ingestion-key header
  1. Scroll down to enable the Otel Metrics Exporter Configuration toggle and fill in:
FieldValue
ToggleEnabled
ProtocolHTTP Configuration
Endpointhttps://ingest.<region>.signoz.cloud:443/v1/metrics
EncodingProto
Header Keysignoz-ingestion-key
Header Value<your-ingestion-key>
  1. Click Save to apply the configuration.
Replace <region> with your actual SigNoz region (e.g. in2) and <your-ingestion-key> with the key copied from SigNoz Ingestion Settings.
3

Verify the Integration

  1. Make a request through the TrueFoundry AI Gateway.
  2. Log into your SigNoz Cloud dashboard and navigate to the Traces section.
  3. Confirm traces from tfy-llm-gateway are appearing.
SigNoz Traces page showing LLM call traces exported from TrueFoundry AI Gateway
  1. Navigate to the Metrics section and run a query to confirm gateway metrics are flowing in.
SigNoz Metrics page showing gateway metrics query results from TrueFoundry AI Gateway

​
Configuration Reference

ConfigurationValue
Traces Endpointhttps://ingest.<region>.signoz.cloud:443/v1/traces
Metrics Endpointhttps://ingest.<region>.signoz.cloud:443/v1/metrics
ProtocolHTTP
EncodingProto
Auth Header Keysignoz-ingestion-key
Auth Header ValueYour SigNoz ingestion key