Working with Multi Modal
The API supports various media types including images, audio, video and pdf.Images
Images
Media Resolution
Media Resolution
Supported Providers:
OpenAI, Azure OpenAI, Google Gemini, Google Vertex AI, xAIThe detail parameter in the image_url object allows you to control the resolution at which images are processed. This helps balance between response quality, latency, and cost.Supported Values: low, high, autoExample Usage
For Google Gemini and Vertex AI providers, the
detail parameter is automatically translated to the mediaResolution parameter:"low"→MEDIA_RESOLUTION_LOW(64 tokens)"high"→MEDIA_RESOLUTION_HIGH(256+ tokens with scaling)"auto"or omitted → No explicit media resolution (model decides)
Audio
Audio
Video
Video