Skip to main content

A2AFramework

type
typing.Literal[Any]
default:"a2a"
required
Type
agent_card_path
str
default:"/.well-known/agent-card.json"
required
Path to the agent card JSON, relative to the base URL

Account

id
typing.Optional[str]
tenant_name
typing_extensions.Annotated[(str, Any, Any)]
required
fqn
str
required
manifest
typing.Dict[(str, typing.Any)]
required
Account manifest
created_by_subject
typing_extensions.Annotated[(Subject, Any, Any)]
required
created_at
typing_extensions.Annotated[(typing.Optional[dt.datetime], Any, Any)]
updated_at
typing_extensions.Annotated[(typing.Optional[dt.datetime], Any, Any)]
is_editable
typing_extensions.Annotated[(bool, Any, Any)]
required

AccountInfo

account_id
typing_extensions.Annotated[(str, Any, Any)]
required
name
str
required

ActivateUserResponse

Union, One Of:

AddonComponent

name
AddonComponentName
required
app_name
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
namespace
typing.Optional[str]
application_id
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
description
typing.Optional[str]
path
typing.Optional[str]
addon_folder
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
installed
typing.Optional[bool]
status
typing.Optional[AddonComponentStatus]
version
typing.Optional[str]
manifest
typing.Optional[typing.Dict[(str, typing.Any)]]
installation_source
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
unsupported_cluster_types
typing_extensions.Annotated[(typing.Optional[typing.List[ClusterType]], Any, Any)]
required
typing.Optional[bool]
known_cr_ds
typing_extensions.Annotated[(typing.Optional[typing.List[str]], Any, Any)]
source
typing.Optional[AddOnComponentSource]
upgrades
typing.Optional[UpgradeData]
labels
typing.Optional[typing.List[str]]
recommendations
typing.Optional[typing.List[Recommendation]]
workspace_id
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
metadata
typing.Optional[typing.Dict[(str, typing.Any)]]
Addon metadata. autopilotEnabled is true when the backing addon application has autopilot enabled; otherwise false.

AddOnComponentSource

repo_url
str
required
Repository URL of the source
chart
str
required
Chart of the source

AddonComponentStatus

health_status
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
sync_status
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
installed
bool
required
Indicates whether the addon is installed

AgentFramework

Union, One Of:

AgentManifest

Union, One Of:

AgentSkill

id
str
required
name
str
required
description
str
required
tags
typing.Optional[typing.List[str]]
examples
typing.Optional[typing.List[str]]
input_modes
typing_extensions.Annotated[(typing.Optional[typing.List[str]], Any, Any)]
output_modes
typing_extensions.Annotated[(typing.Optional[typing.List[str]], Any, Any)]

AgentSkillManifest

name
str
required
Name of the skill.
metadata
typing.Dict[(str, typing.Any)]
required
Key value metadata. Should be valid JSON. For e.g. \{"business-unit": "sales", "quality": "good", "rating": 4.5\}
ml_repo
str
required
Name of the ML Repo that this agent skill belongs to
version
typing.Optional[int]
Version of the entity
type
typing.Literal[Any]
default:"agent_skill"
required
source
AgentSkillManifestSource
required

AgentSkillManifestSource

Union, One Of:

AgentSkillSourceBlobStorage

type
typing.Literal[Any]
default:"blob-storage"
required
description
str
required
1–1024 chars.

AgentSkillSourceInline

type
typing.Literal[Any]
default:"inline"
required
skill_md
str
required
Main body of SKILL.md file.

AgentSkillVersion

id
str
required
Unique identifier for the artifact version
fqn
str
required
Fully qualified name of the artifact version in the format β€˜{artifact_type}:{tenant_name}/{ml_repo_name}/{artifact_name}:{version}’
created_by_subject
Subject
required
πŸ”— SubjectSubject (user, team, or service account) that created this artifact version
created_at
typing.Optional[dt.datetime]
Timestamp when the artifact version was created
updated_at
typing.Optional[dt.datetime]
Timestamp when the artifact version was last updated
manifest
AgentSkillManifest
required
πŸ”— AgentSkillManifestManifest containing metadata specific to this agent skill version
ml_repo_id
str
required
ID of the ML Repo that this artifact version belongs to
agent_skill_id
str
required
ID of the parent agent skill artifact that this version belongs to

AgentSource

Union, One Of:

Ai21KeyAuth

type
typing.Literal[Any]
default:"api-key"
required
api_key
str
required
The API key for AI21 authentication

Ai21Model

type
typing.Literal[Any]
default:"integration/model/ai21"
required
name
str
required
A descriptive name to identify this model integration in the UI
model_id
str
required
The AI21 model identifier (e.g., jamba-large, jamba-mini). This is the model name from AI21’s model catalog.
model_types
typing.List[ModelType]
required
πŸ”— ModelTypeSpecify the type of the AI21 model
cost
typing.Optional[ModelCostMetric]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

Ai21ProviderAccount

type
typing.Literal[Any]
default:"provider-account/ai21"
required
name
str
required
The name of the AI21 provider account
auth_data
Ai21KeyAuth
required
integrations
typing.Optional[typing.List[Ai21Integrations]]
List of integrations that are associated with the AI21 provider account
collaborators
typing.Optional[typing.List[Collaborator]]
πŸ”— CollaboratorList of users who have access to this provider account
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

AiFeaturesSettings

type
typing.Literal[Any]
default:"settings/ai-features"
required
enabled
bool
required
Enable/Disable AI features. Other fields only apply when this is true
ai_provider
typing.Literal[Any]
default:"truefoundry"
required
AI provider to use for AI features When TrueFoundry is selected, TrueFoundry will manage and provide the AI models for the features.

AktoGuardrailConfig

name
str
required
The name of the Guardrail Config.
description
typing.Optional[str]
Optional description for this Guardrail Config.
type
typing.Literal[Any]
default:"integration/guardrail-config/akto"
required
auth_data
AktoTokenAuth
required
operation
typing.Literal[Any]
default:"validate"
required
The operation type for this guardrail. Akto guardrails can only be used for validation.
enforcing_strategy
EnforcingStrategy
required
config
AktoGuardrailConfigConfig
required

AktoGuardrailConfigConfig

base_url
str
required
The base URL of the Akto guardrails service (e.g. https://your-akto-host:port)

AktoTokenAuth

type
typing.Literal[Any]
default:"token"
required
token
str
required
JWT token for authenticating with the Akto guardrails service

Alert

id
typing.Optional[str]
name
str
required
timestamps
typing.List[dt.datetime]
required
start_time
typing_extensions.Annotated[(dt.datetime, Any, Any)]
required
resolved_time
typing_extensions.Annotated[(typing.Optional[dt.datetime], Any, Any)]
application_id
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
cluster_id
typing_extensions.Annotated[(str, Any, Any)]
required
tenant_name
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
fingerprint
str
required
updated_at
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
created_at
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
application_debug_info_id
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]

AlertConfig

type
typing.Literal[Any]
default:"alert-config"
required
Type
name
str
required
Name - 3 to 35 lower case characters long alphanumeric word, may contain - in between, cannot start with a number
resource
AlertConfigResource
required
notification_targets
typing.List[NotificationTargetForAlertRule]
required
πŸ”— NotificationTargetForAlertRuleConfigure one or more notification targets where alerts will be sent. Each target specifies a notification channel (email or slack).
rules
typing.List[PrometheusAlertRule]
required
πŸ”— PrometheusAlertRuleDefine one or more alert rules that specify the conditions to monitor, when to trigger alerts, and how they should be handled.

AlertConfigResource

type
AlertConfigResourceType
required
πŸ”— AlertConfigResourceTypeThe type of resource this alert config belongs to. Can be either an application or a cluster.
fqn
str
required
FQN of the resource this alert config belongs to.

AllDataAccessRule

scope
typing.Literal[Any]
default:"all_data"
required
Data access scope - access to all data with optional filters
filters
typing.Optional[typing.List[AllDataAccessRuleFiltersItem]]
πŸ”— AllDataAccessRuleFiltersItemOptional filters to restrict data access (only applicable for all_data scope)

AllDataAccessRuleFiltersItem

Union, One Of:

AmqpInputConfig

type
typing.Literal[Any]
default:"amqp"
required
url
str
required
AMQP Queue URL of Subscriber
queue_name
str
required
AMQP Queue Name
wait_time_seconds
int
default:"5"
required
Wait timeout for long polling.

AmqpMetricConfig

type
typing.Literal[Any]
default:"amqp"
required
queue_length
int
required
Upper limit of the number of backlog messages the auto-scaler will try to maintain per replica. If you set this number to 10 and have 30 messages in the stream and one replica, the auto-scaler will scale the number of replicas to 3.

AmqpOutputConfig

type
typing.Literal[Any]
default:"amqp"
required
url
str
required
AMQP Queue URL of Publisher
routing_key
str
required
AMQP Routing Key to publish to.
exchange_name
typing.Optional[str]
AMQP Exchange Name

AnthropicKeyAuth

type
typing.Literal[Any]
default:"api-key"
required
api_key
str
required
The API key for Anthropic authentication

AnthropicModel

name
str
required
A descriptive name to identify this model integration in the UI
model_id
str
required
The Anthropic model identifier (e.g., claude-3-5-sonnet-20241022, claude-3-opus-20240229, claude-3-haiku-20240307). This is the standard model name from Anthropic’s API documentation.
type
typing.Literal[Any]
default:"integration/model/anthropic"
required
model_types
typing.List[ModelType]
required
πŸ”— ModelTypeSpecify the type of the Anthropic model
cost
typing.Optional[ModelCostMetric]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

AnthropicProviderAccount

type
typing.Literal[Any]
default:"provider-account/anthropic"
required
name
str
required
The name of the Anthropic provider account
auth_data
AnthropicKeyAuth
required
integrations
typing.Optional[typing.List[AnthropicIntegrations]]
List of integrations that are associated with the Anthropic provider account
collaborators
typing.Optional[typing.List[Collaborator]]
πŸ”— CollaboratorList of users who have access to this provider account
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

Application

id
typing.Optional[str]
fqn
typing.Optional[str]
name
typing.Optional[str]
type
typing.Optional[ApplicationType]
created_by_subject
typing_extensions.Annotated[(Subject, Any, Any)]
required
tenant_name
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
metadata
typing.Optional[ApplicationMetadata]
lifecycle_stage
typing_extensions.Annotated[(ApplicationLifecycleStage, Any, Any)]
required
workspace_id
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
last_version
typing_extensions.Annotated[(typing.Optional[int], Any, Any)]
active_version
typing_extensions.Annotated[(typing.Optional[int], Any, Any)]
created_at
typing_extensions.Annotated[(typing.Optional[dt.datetime], Any, Any)]
updated_at
typing_extensions.Annotated[(typing.Optional[dt.datetime], Any, Any)]
recommendations
typing.Optional[typing.List[Recommendation]]
πŸ”— RecommendationRecommendations for this application
alerts
typing.Optional[typing.List[Alert]]
πŸ”— AlertAlerts for this application
alerts_summary
typing_extensions.Annotated[(typing.Optional[typing.Dict[(str, typing.Any)]], Any, Any)]
application_debug_infos
typing_extensions.Annotated[(typing.Optional[typing.List[Any]], Any, Any)]
potential_problems
typing_extensions.Annotated[(typing.Optional[typing.List[ApplicationProblem]], Any, Any)]
autopilot
typing.Dict[(str, typing.Any)]
required
workspace_fqn
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
created_by
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
deployment
typing.Optional[Any]
active_deployment_id
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
last_deployment_id
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]

ApplicationDebugInfo

id
typing.Optional[str]
application_id
typing_extensions.Annotated[(str, Any, Any)]
required
application
typing.Optional[Any]
debug_info
typing_extensions.Annotated[(typing.Dict[(str, typing.Any)], Any, Any)]
required
created_at
typing_extensions.Annotated[(typing.Optional[dt.datetime], Any, Any)]
updated_at
typing_extensions.Annotated[(typing.Optional[dt.datetime], Any, Any)]

ApplicationMetadata

paused
typing.Optional[bool]

ApplicationProblem

name
str
required
description
str
required

ApplicationsCancelDeploymentResponse

message
typing.Optional[str]
Deployment cancelled

ApplicationSet

type
typing.Literal[Any]
default:"application-set"
required
name
str
required
Name of the application set.
components
typing.Optional[typing.List[ApplicationSetComponentsItem]]
πŸ”— ApplicationSetComponentsItemArray of components with their specifications.
template
typing.Optional[str]
Template to be used for the application set.
values
typing.Optional[typing.Dict[(str, typing.Any)]]
Values to be used to render components for the application set.
workspace_fqn
typing.Optional[str]
Fully qualified name of the workspace
convert_template_manifest
typing.Optional[bool]
Flag to indicate if the template manifest should be converted to TrueFoundry manifest

ApplicationSetComponentsItem

Union, One Of:

ApplyMlEntityResponse

data
ApplyMlEntityResponseData
required
πŸ”— ApplyMlEntityResponseDataThe created or updated ML entity (model version, prompt version, agent skill version, artifact version, or data directory)

ApplyMlEntityResponseData

Union, One Of:

Artifact

id
str
required
Unique identifier for the artifact
ml_repo_id
str
required
ID of the ML Repo that this artifact belongs to
type
ArtifactType
required
πŸ”— ArtifactTypeType of the artifact (e.g., β€˜artifact’, β€˜model’, β€˜chat_prompt’, β€˜agent_skill’, β€˜plot’, β€˜image’)
name
str
required
Name of the artifact (alphanumeric characters, hyphens, and underscores only, max 256 characters)
fqn
str
required
Fully qualified name of the artifact in the format β€˜{artifact_type}:{tenant_name}/{ml_repo_name}/{artifact_name}’
created_by_subject
Subject
required
πŸ”— SubjectSubject (user, team, or service account) that created this artifact
created_at
typing.Optional[dt.datetime]
Timestamp when the artifact was created
updated_at
typing.Optional[dt.datetime]
Timestamp when the artifact was last updated
latest_version
typing.Optional[BaseArtifactVersion]
πŸ”— BaseArtifactVersionThe most recent version of this artifact
run_steps
typing.Optional[typing.List[int]]
List of run step numbers where this artifact was created or updated

ArtifactManifest

name
str
required
Name of the artifact (alphanumeric characters, hyphens, and underscores only, max 256 characters)
metadata
typing.Dict[(str, typing.Any)]
required
Key value metadata. Should be valid JSON. For e.g. \{"business-unit": "sales", "quality": "good", "rating": 4.5\}
ml_repo
str
required
Name of the ML Repo that this artifact belongs to (must start and end with alphanumeric, 2-100 characters)
version
typing.Optional[int]
Version of the entity
type
typing.Literal[Any]
default:"artifact-version"
required
description
typing.Optional[str]
version_alias
typing.Optional[str]
Version alias is alternate, ideally human readable, version string to reference an artifact version. It should start with v followed by alphanumeric and it can include . and - in between (e.g. v1.0.0, v1-prod, v3-dev, etc)
source
ArtifactManifestSource
required
step
typing.Optional[int]
Step/Epoch number in an iterative training loop the artifact version was created. Generally useful when logging a model version from a MLRepo Run
run_id
typing.Optional[str]
ID of the MLRepo Run that generated the artifact version

ArtifactManifestSource

Union, One Of:

ArtifactPath

src
str
required
Local file or folder path
dest
typing.Optional[str]
Relative path where the file or folder will be uploaded to in the artifact

ArtifactsCacheVolume

storage_class
str
required
Storage class of the Volume where artifacts will be cached
cache_size
int
default:"200"
required
Size of the Volume (in GB) where artifacts will be cached. Should be greater than twice the size of artifacts getting cached

ArtifactsDownload

cache_volume
typing.Optional[ArtifactsCacheVolume]
artifacts
typing.List[ArtifactsDownloadArtifactsItem]
required
πŸ”— ArtifactsDownloadArtifactsItemList of artifacts to be cached

ArtifactsDownloadArtifactsItem

Union, One Of:

ArtifactVersion

id
str
required
Unique identifier for the artifact version
fqn
str
required
Fully qualified name of the artifact version in the format β€˜{artifact_type}:{tenant_name}/{ml_repo_name}/{artifact_name}:{version}’
created_by_subject
Subject
required
πŸ”— SubjectSubject (user, team, or service account) that created this artifact version
created_at
typing.Optional[dt.datetime]
Timestamp when the artifact version was created
updated_at
typing.Optional[dt.datetime]
Timestamp when the artifact version was last updated
manifest
ArtifactManifest
required
πŸ”— ArtifactManifestManifest containing metadata for a generic artifact version
ml_repo_id
str
required
ID of the ML Repo that this artifact version belongs to
tags
typing.Optional[typing.List[str]]
List of tags associated with this artifact version for filtering and organization
version_alias
typing.Optional[str]
Optional human-readable version alias (e.g. v1.0.0)
usage_code_snippet
typing.Optional[str]
Code snippet demonstrating how to use this artifact version
artifact_id
str
required
ID of the parent artifact that this version belongs to

AssistantMessage

role
typing.Literal[Any]
default:"assistant"
required
Role of the message
content
typing.Optional[AssistantMessageContent]
πŸ”— AssistantMessageContentText content for the assistant message
tool_calls
typing.Optional[typing.List[ToolCall]]
πŸ”— ToolCallList of tool calls made by the assistant
name
typing.Optional[str]
Name of the assistant this message is from

AssistantMessageContent

Union, One Of:

AssistantMessageContentOneItem

Union, One Of:

AsyncProcessorSidecar

destination_url
str
required
URL for the processor to invoke
request_timeout
typing.Optional[int]
default:"10"
Timeout for the invoke request in seconds
sidecar_image
typing.Optional[str]
Image for the processor sidecar (This field will be deprecated in the future)

AsyncService

type
typing.Literal[Any]
default:"async-service"
required
replicas
AsyncServiceReplicas
required
πŸ”— AsyncServiceReplicasDeploy multiple instances of your pods to distribute incoming traffic across them, ensuring effective load balancing.
rollout_strategy
typing.Optional[Rolling]
worker_config
WorkerConfig
required
sidecar
typing.Optional[AsyncProcessorSidecar]

AsyncServiceAutoscaling

metrics
AsyncServiceAutoscalingMetrics
required
πŸ”— AsyncServiceAutoscalingMetricsMetrics to use for the autoscaler

AsyncServiceAutoscalingMetrics

Union, One Of:

AsyncServiceReplicas

Union, One Of:

AutoRotate

auto_rotate_interval
int
default:"360"
required
Rotation Interval in days after which the token will be rotated. Minimum value is 30.
grace_period
int
default:"30"
required
Grace Period in days for which the token will be valid after rotation interval. Minimum value is 1.

Autoshutdown

wait_time
int
default:"900"
required
The period to wait after the last received request before scaling the replicas to 0. This value should be high enough to allow for the replicas of the service to come up to avoid premature scaling down.

AwsAccessKeyAuth

aws_access_key_id
str
required
AWS Access Key ID
aws_secret_access_key
str
required
AWS Secret Access Key for the user to authenticate with
aws_session_token
typing.Optional[str]
AWS Session Token, only required when using temporary credentials

AwsAccessKeyBasedAuth

type
typing.Literal[Any]
default:"access-key-based"
required
access_key_id
str
required
AWS access key ID that you want to use for authentication.
secret_access_key
str
required
AWS access key secret that you want to use for authentication.

AwsAssumedRoleBasedAuth

type
typing.Literal[Any]
default:"assumed-role-based"
required
assumed_role_arn
str
required
ARN of the role you want to assume.

AwsBedrockApiKeyAuth

type
typing.Literal[Any]
default:"api-key"
required
api_key
str
required
Your AWS Bedrock API key for authentication

AwsBedrockAssumedRoleBasedAuth

external_id
typing.Optional[str]
Optional external ID to use when assuming the role. This provides an added layer of security by ensuring only parties with the correct external ID can assume the role.

AwsBedrockGuardrailConfig

name
str
required
The name of the Guardrail Config.
description
typing.Optional[str]
Optional description for this Guardrail Config.
type
typing.Literal[Any]
default:"integration/guardrail-config/aws-bedrock"
required
auth_data
typing.Optional[AwsBedrockGuardrailConfigAuthData]
πŸ”— AwsBedrockGuardrailConfigAuthDataAuthentication data for the AWS account
operation
AwsBedrockGuardrailConfigOperation
required
πŸ”— AwsBedrockGuardrailConfigOperationThe operation type to use for the Guardrail. Validate guardrails are used to validate requests and mutate can validate as well as mutate requests. Validate guardrails are run in parallel while mutate guardrails are run sequentially.
priority
typing.Optional[int]
default:"1"
Execution order for mutate guardrails. Lower values run first. Only applicable when operation is mutate.
enforcing_strategy
EnforcingStrategy
required
config
AwsBedrockGuardrailConfigConfig
required

AwsBedrockGuardrailConfigAuthData

Union, One Of:

AwsBedrockGuardrailConfigConfig

guardrail_id
str
required
The unique identifier of the Bedrock Guardrail created in AWS console
guardrail_version
str
required
Version number of the guardrail to use (e.g., 2 for version 2)
region
AwsRegion
required

AwsBedrockProviderAccount

type
typing.Literal[Any]
default:"provider-account/aws-bedrock"
required
name
str
required
The name of the AWS Bedrock provider account
region
AwsRegion
required
auth_data
typing.Optional[AwsBedrockProviderAccountAuthData]
πŸ”— AwsBedrockProviderAccountAuthDataAuthentication data for the AWS account
integrations
typing.List[BedrockModel]
required
πŸ”— BedrockModelList of integrations that are associated with the AWS Bedrock provider account
collaborators
typing.Optional[typing.List[Collaborator]]
πŸ”— CollaboratorList of users who have access to this provider account
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

AwsBedrockProviderAccountAuthData

Union, One Of:

AwsEcr

type
typing.Literal[Any]
default:"integration/docker-registry/aws/ecr"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
registry_url
str
required
The URL of the registry.
auth_data
typing.Optional[AwsEcrAuthData]
πŸ”— AwsEcrAuthDataCustom authentication data for the integration.
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

AwsEcrAuthData

Union, One Of:

AwsEksIntegration

type
typing.Literal[Any]
default:"integration/cluster/aws/eks"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
region
AwsRegion
required
cluster_name
str
required
Name of the cluster given in the cloud account.
auth_data
typing.Optional[AwsEksIntegrationAuthData]
πŸ”— AwsEksIntegrationAuthDataCustom authentication data for the integration.
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

AwsEksIntegrationAuthData

Union, One Of:

AwsInferentia

type
typing.Literal[Any]
default:"aws_inferentia"
required
name
typing.Optional[str]
Name of the AWS Inferentia Accccelerator. One of [INF1, INF2]. This field is required for Node Selector and can be ignored in Nodepool Selector.
count
int
required
Count of Inferentia accelerator chips to provide to the application

AwsIntegrations

Union, One Of:

AwsParameterStore

type
typing.Literal[Any]
default:"integration/secret-store/aws/parameter-store"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
region
AwsRegion
required
auth_data
typing.Optional[AwsParameterStoreAuthData]
πŸ”— AwsParameterStoreAuthDataCustom authentication data for the integration.
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.
kms_arn
typing.Optional[str]
The ARN of the KMS key to use for encryption.

AwsParameterStoreAuthData

Union, One Of:

AwsProviderAccount

type
typing.Literal[Any]
default:"provider-account/aws"
required
name
str
required
The name of the AWS provider account.
aws_account_id
str
required
The AWS account ID.
auth_data
typing.Optional[AwsProviderAccountAuthData]
πŸ”— AwsProviderAccountAuthDataAuthentication data for the AWS account.
integrations
typing.List[AwsIntegrations]
required
πŸ”— AwsIntegrationsList of integrations that are associated with the AWS provider account.
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

AwsProviderAccountAuthData

Union, One Of:

AwsS3

type
typing.Literal[Any]
default:"integration/blob-storage/aws/s3"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
storage_root
str
required
The S3 storage path in the format β€˜s3://<bucket-name>/<optional-path-prefix>’. Works with S3-compatible storage providers like MinIO, Ceph, and DigitalOcean Spaces. Example: β€˜s3://mybucket’ or β€˜s3://mybucket/artifacts/production’.
region
AwsRegion
required
auth_data
typing.Optional[AwsS3AuthData]
πŸ”— AwsS3AuthDataCustom authentication data for the integration.
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

AwsS3AuthData

Union, One Of:

AwsSagemakerProviderAccount

type
typing.Literal[Any]
default:"provider-account/aws-sagemaker"
required
name
str
required
The name of the Sagemaker provider account
region
AwsRegion
required
auth_data
typing.Optional[AwsSagemakerProviderAccountAuthData]
πŸ”— AwsSagemakerProviderAccountAuthDataAuthentication data for the AWS account
integrations
typing.List[SagemakerModel]
required
πŸ”— SagemakerModelList of integrations that are associated with the Sagemaker provider account
collaborators
typing.Optional[typing.List[Collaborator]]
πŸ”— CollaboratorList of users who have access to this provider account
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

AwsSagemakerProviderAccountAuthData

Union, One Of:

AwsSecretsManager

type
typing.Literal[Any]
default:"integration/secret-store/aws/secrets-manager"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
region
AwsRegion
required
auth_data
typing.Optional[AwsSecretsManagerAuthData]
πŸ”— AwsSecretsManagerAuthDataCustom authentication data for the integration.
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.
kms_arn
typing.Optional[str]
The ARN of the KMS key to use for encryption.

AwsSecretsManagerAuthData

Union, One Of:

AwsSqsAccessKeyBasedAuth

type
typing.Literal[Any]
default:"access-key-based"
required
access_key_id
str
required
AWS access key ID that you want to use for authentication.
secret_access_key
str
required
AWS access key secret that you want to use for authentication.

AwsSqsAssumedRoleBasedAuth

type
typing.Literal[Any]
default:"assumed-role-based"
required
assumed_role_arn
str
required
ARN of the role you want to assume.

AzureAksIntegration

type
typing.Literal[Any]
default:"integration/cluster/azure/aks"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
resource_group
str
required
The resource group of the cluster in the cloud account.
cluster_name
str
required
Name of the cluster given in the cloud account.
auth_data
typing.Optional[AzureOAuth]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

AzureBasicAuth

type
typing.Literal[Any]
default:"basic-auth"
required
username
str
required
The username for the Azure managed identity.
password
str
required
The password for the Azure managed identity.

AzureBlobStorage

type
typing.Literal[Any]
default:"integration/blob-storage/azure/blob"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
storage_root
str
required
The full Azure Blob Storage URL in the format β€˜https://<storage-account-name>.blob.core.windows.net/<container-name>/<optional-path-prefix>’. Example: β€˜https://mystorageaccount.blob.core.windows.net/mycontainer’ or β€˜https://mystorageaccount.blob.core.windows.net/mycontainer/artifacts/production’.
auth_data
typing.Optional[AzureConnectionStringAuth]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

AzureCertificateAuth

type
typing.Literal[Any]
default:"certificate"
required
tenant_id
str
required
The Azure AD tenant ID where the application is registered
client_id
str
required
The Azure AD application (client) ID for service principal authentication
certificate
str
required
Certificate in PEM format (e.g., -----BEGIN CERTIFICATE----- … -----END CERTIFICATE-----)
certificate_thumbprint
str
required
The base64url-encoded SHA-1 thumbprint of the certificate (x5t claim)

AzureConnectionStringAuth

type
typing.Literal[Any]
default:"connection-string"
required
connection_string
str
required
The connection string for the Azure managed identity.

AzureContainerRegistry

type
typing.Literal[Any]
default:"integration/docker-registry/azure/acr"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
registry_url
str
required
The URL of the registry.
auth_data
typing.Optional[AzureBasicAuth]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

AzureContentSafetyGuardrailConfig

name
str
required
The name of the Guardrail Config.
description
typing.Optional[str]
Optional description for this Guardrail Config.
type
typing.Literal[Any]
required
auth_data
AzureContentSafetyGuardrailConfigAuthData
required
πŸ”— AzureContentSafetyGuardrailConfigAuthDataAuthentication data for the Azure account
operation
typing.Literal[Any]
default:"validate"
required
The operation type for this guardrail. Azure Content Safety guardrails can only be used for validation.
enforcing_strategy
EnforcingStrategy
required
config
AzureContentSafetyGuardrailConfigConfig
required

AzureContentSafetyGuardrailConfigAuthData

Union, One Of:

AzureContentSafetyGuardrailConfigConfig

resource_name
str
required
Name of your Azure Content Safety resource where the service is deployed (e.g., my-content-safety)
api_version
str
default:"2024-09-01"
required
API version for the Content Safety API
custom_host
typing.Optional[str]
Custom endpoint URL for the Content Safety API (optional, uses default Azure endpoint if not specified)
blocklist_names
typing.Optional[typing.List[str]]
Names of custom blocklists created in Azure Content Safety to check text against. Leave empty if not using custom blocklists
severity_threshold
float
default:"2.0"
required
Minimum severity level (0-6) to flag content. Higher values are more restrictive. 0=Safe, 2=Low risk, 4=Medium risk, 6=High risk
categories
typing.List[AzureContentSafetyCategory]
required
πŸ”— AzureContentSafetyCategoryTypes of harmful content to detect: Hate (hate speech), SelfHarm (self-injury), Sexual (sexual content), Violence (violent content)

AzureFoundryModel

type
typing.Literal[Any]
default:"integration/model/azure-foundry"
required
name
str
required
A descriptive name to identify this model integration in the UI
auth_data
AzureFoundryModelAuthData
required
πŸ”— AzureFoundryModelAuthDataAzure AI Foundry authentication credentials
model_types
typing.List[ModelType]
required
πŸ”— ModelTypeTypes of models supported by this Azure AI Foundry deployment
model_id
str
required
The model deployment name created in your Azure AI Foundry project. This is the deployment name you configured in Azure AI Foundry, not the base model name.
azure_endpoint
str
required
The Azure AI Foundry endpoint URL. Should look like https://{deployment}.{region}.models.ai.azure.com
api_version
typing.Optional[str]
The API version for the Azure Foundry model
cost
typing.Optional[ModelCostMetric]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

AzureFoundryModelAuthData

Union, One Of:

AzureFoundryProviderAccount

type
typing.Literal[Any]
default:"provider-account/azure-foundry"
required
name
str
required
The name of the Azure AI Foundry provider account
integrations
typing.List[AzureFoundryModel]
required
πŸ”— AzureFoundryModelList of integrations that are associated with the Azure Foundry provider account
collaborators
typing.Optional[typing.List[Collaborator]]
πŸ”— CollaboratorList of users who have access to this provider account
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

AzureIntegrations

Union, One Of:

AzureKeyAuth

type
typing.Literal[Any]
default:"api-key"
required
api_key
str
required
The API key for Azure AI Foundry authentication

AzureOAuth

type
typing.Literal[Any]
default:"oauth"
required
tenant_id
str
required
The Azure Active Directory tenant (directory) ID.
client_id
str
required
The client (application) ID of an App Registration in the tenant.
client_secret
str
required
A client secret that was generated for the App Registration.
subscription_id
str
required
The ID of the target subscription. The value must be an UUID.

AzureOpenAiModel

type
typing.Literal[Any]
default:"integration/model/azure-openai"
required
name
str
required
A descriptive name to identify this model integration in the UI
model_id
str
required
The model deployment name created in your Azure OpenAI resource (e.g., gpt-4-deployment, gpt-35-turbo-deployment). This is NOT the base model name but the deployment name you configured in Azure.
api_version
str
required
The Azure OpenAI API version to use
foundation_model
typing.Optional[str]
The foundation model identifier (e.g., gpt-4o-2024-11-20)
deployment_type
AzureOpenAiModelDeploymentType
required
πŸ”— AzureOpenAiModelDeploymentTypeGlobal: worldwide processing; Data zone (US): US data zone processing; Data zone (EU): EU data zone processing; Standard: single-region processing
model_types
typing.List[ModelType]
required
πŸ”— ModelTypeSpecify the type of the Azure OpenAI model
cost
typing.Optional[ModelCostMetric]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

AzureOpenAiProviderAccount

type
typing.Literal[Any]
default:"provider-account/azure-openai"
required
name
str
required
The name of the Azure OpenAI provider account
azure_endpoint
str
required
The Azure OpenAI Service endpoint URL. Should look like https://{resource-name}.openai.azure.com
auth_data
AzureOpenAiProviderAccountAuthData
required
πŸ”— AzureOpenAiProviderAccountAuthDataAzure OpenAI authentication credentials
integrations
typing.List[AzureOpenAiModel]
required
πŸ”— AzureOpenAiModelList of integrations that are associated with the Azure OpenAI provider account
collaborators
typing.Optional[typing.List[Collaborator]]
πŸ”— CollaboratorList of users who have access to this provider account
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

AzureOpenAiProviderAccountAuthData

Union, One Of:

AzurePiiGuardrailConfig

name
str
required
The name of the Guardrail Config.
description
typing.Optional[str]
Optional description for this Guardrail Config.
type
typing.Literal[Any]
default:"integration/guardrail-config/azure-pii"
required
auth_data
AzurePiiGuardrailConfigAuthData
required
πŸ”— AzurePiiGuardrailConfigAuthDataAuthentication data for the Azure account
operation
AzurePiiGuardrailConfigOperation
required
πŸ”— AzurePiiGuardrailConfigOperationThe operation type to use for the Guardrail. Validate guardrails are used to validate requests and mutate can validate as well as mutate requests. Validate guardrails are run in parallel while mutate guardrails are run sequentially.
priority
typing.Optional[int]
default:"1"
Execution order for mutate guardrails. Lower values run first. Only applicable when operation is mutate.
enforcing_strategy
EnforcingStrategy
required
config
AzurePiiGuardrailConfigConfig
required

AzurePiiGuardrailConfigAuthData

Union, One Of:

AzurePiiGuardrailConfigConfig

resource_name
str
required
Name of your Azure AI Language resource where the PII detection service is deployed (e.g., my-language-resource)
api_version
str
default:"2024-11-01"
required
API version for the PII detection API
custom_host
typing.Optional[str]
Custom endpoint URL for the PII detection API (optional, uses default Azure endpoint if not specified)
domain
AzurePiiGuardrailConfigConfigDomain
required
πŸ”— AzurePiiGuardrailConfigConfigDomainSpecialized domain for PII detection. Use phi for PHI (Protected Health Information) or none for general text
pii_categories
typing.List[AzurePiiCategory]
required
πŸ”— AzurePiiCategoryCategories of PII to detect.
model_version
str
default:"latest"
required
Version of the PII detection model to use, use latest for the newest model or specify a specific version for consistency
language
str
default:"en"
required
Language code for PII detection (e.g., en for English)

AzurePromptShieldGuardrailConfig

name
str
required
The name of the Guardrail Config.
description
typing.Optional[str]
Optional description for this Guardrail Config.
type
typing.Literal[Any]
required
auth_data
AzurePromptShieldGuardrailConfigAuthData
required
πŸ”— AzurePromptShieldGuardrailConfigAuthDataAuthentication data for the Azure account
operation
typing.Literal[Any]
default:"validate"
required
The operation type for this guardrail. Azure Prompt Shield guardrails can only be used for validation.
enforcing_strategy
EnforcingStrategy
required
config
AzurePromptShieldGuardrailConfigConfig
required

AzurePromptShieldGuardrailConfigAuthData

Union, One Of:

AzurePromptShieldGuardrailConfigConfig

resource_name
str
required
Name of your Azure Content Safety resource where the Prompt Shield service is deployed (e.g., my-content-safety)
api_version
str
default:"2024-09-01"
required
API version for the Prompt Shield API
custom_host
typing.Optional[str]
Custom endpoint URL for the Prompt Shield API (optional, uses default Azure endpoint if not specified)

AzureProviderAccount

type
typing.Literal[Any]
default:"provider-account/azure"
required
name
str
required
The name of the Azure provider account.
subscription_id
typing.Optional[str]
The ID of the target subscription. The value must be an UUID.
integrations
typing.List[AzureIntegrations]
required
πŸ”— AzureIntegrationsList of integrations that are associated with the Azure provider account.
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

AzureReposIntegration

type
typing.Literal[Any]
default:"integration/vcs/azure"
required
name
str
required
account_name
str
required
Account Name
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

AzureVault

type
typing.Literal[Any]
default:"integration/secret-store/azure/vault"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
auth_data
typing.Optional[AzureOAuth]
key_vault_name
str
required
Name of key vault name.
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

BaseArtifactVersion

id
str
required
Unique identifier for the artifact version
fqn
str
required
Fully qualified name of the artifact version in the format β€˜{artifact_type}:{tenant_name}/{ml_repo_name}/{artifact_name}:{version}’
created_by_subject
Subject
required
πŸ”— SubjectSubject (user, team, or service account) that created this artifact version
created_at
typing.Optional[dt.datetime]
Timestamp when the artifact version was created
updated_at
typing.Optional[dt.datetime]
Timestamp when the artifact version was last updated
manifest
typing.Optional[BaseArtifactVersionManifest]
ml_repo_id
str
required
ID of the ML Repo that this artifact version belongs to

BaseArtifactVersionManifest

Union, One Of:

BaseAutoscaling

min_replicas
int
default:"1"
required
Minimum number of replicas to keep available
max_replicas
int
required
Maximum number of replicas allowed for the component.
polling_interval
typing.Optional[int]
default:"30"
This is the interval to check each trigger on.

BaseOAuth2Login

client_id
str
required
client ID for OAuth2.
client_secret
typing.Optional[str]
Client secret or the TrueFoundry secret containing the client secret for OAuth2.
authorization_url
str
required
URL for the authorization request
token_url
str
required
The endpoint to exchange auth code for tokens.
scopes
typing.List[str]
required
List of scopes to request from the OAuth2 provider.
jwt_source
BaseOAuth2LoginJwtSource
required
πŸ”— BaseOAuth2LoginJwtSourceSource of the JWT token to be used for verification.

BaseRemoteAgent

name
str
required
The name of the Agent
description
str
required
The description of the Agent
tags
typing.Optional[typing.Dict[(str, typing.Any)]]
Tags for the Agent
collaborators
typing.List[Collaborator]
required
πŸ”— CollaboratorList of users who have access to this Agent
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

BaseService

name
str
required
Name of the service. This uniquely identifies this service in the workspace. > Name can only contain alphanumeric characters and ’-’ and can be atmost 25 characters long
image
BaseServiceImage
required
πŸ”— BaseServiceImageSpecify whether you want to deploy a Docker image or build and deploy from source code
artifacts_download
typing.Optional[ArtifactsDownload]
resources
typing.Optional[Resources]
env
typing.Optional[typing.Dict[(str, typing.Optional[str])]]
Configure environment variables to be injected in the service either as plain text or secrets. Docs
ports
typing.List[Port]
required
πŸ”— PortExpose the deployment to make it accessible over the internet or keep it private. Implement authentication to restrict access. Docs
service_account
typing.Optional[str]
mounts
typing.Optional[typing.List[BaseServiceMountsItem]]
πŸ”— BaseServiceMountsItemConfigure data to be mounted to service pod(s) as a string, secret or volume. Docs
labels
typing.Optional[typing.Dict[(str, str)]]
Labels
kustomize
typing.Optional[Kustomize]
liveness_probe
typing.Optional[HealthProbe]
readiness_probe
typing.Optional[HealthProbe]
startup_probe
typing.Optional[HealthProbe]
workspace_fqn
typing.Optional[str]
Fully qualified name of the workspace

BaseServiceImage

Union, One Of:

BaseServiceMountsItem

Union, One Of:

BasetenKeyAuth

type
typing.Literal[Any]
default:"api-key"
required
api_key
str
required
The API key for Baseten authentication

BasetenModel

type
typing.Literal[Any]
default:"integration/model/baseten"
required
name
str
required
A descriptive name to identify this model integration in the UI
model_id
str
required
The Baseten model identifier. This is the model name from Baseten’s model catalog.
model_types
typing.List[ModelType]
required
πŸ”— ModelTypeSpecify the type of the Baseten model
cost
typing.Optional[ModelCostMetric]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

BasetenProviderAccount

type
typing.Literal[Any]
default:"provider-account/baseten"
required
name
str
required
The name of the Baseten provider account
auth_data
BasetenKeyAuth
required
integrations
typing.Optional[typing.List[BasetenIntegrations]]
List of integrations that are associated with the Baseten provider account
collaborators
typing.Optional[typing.List[Collaborator]]
πŸ”— CollaboratorList of users who have access to this provider account
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

BaseWorkbenchInput

name
str
required
Name of the workbench. This uniquely identifies this workbench in the workspace. > Name can only contain alphanumeric characters and ’-’ and can be atmost 25 characters long
home_directory_size
int
default:"20"
required
Size of the home directory for the workbench (Persistent Storage)
resources
typing.Optional[Resources]
env
typing.Optional[typing.Dict[(str, typing.Optional[str])]]
Configure environment variables to be injected in the service either as plain text or secrets. Docs
mounts
typing.Optional[typing.List[BaseWorkbenchInputMountsItem]]
πŸ”— BaseWorkbenchInputMountsItemConfigure data to be mounted to workbench pod(s) as a string, secret or volume. Docs
service_account
typing.Optional[str]
kustomize
typing.Optional[Kustomize]
workspace_fqn
typing.Optional[str]
Fully qualified name of the workspace

BaseWorkbenchInputMountsItem

Union, One Of:

BasicAuthCreds

type
typing.Literal[Any]
default:"basic_auth"
required
username
str
required
Username for service auth - Username for the user to authenticate with
password
str
required
Password for service auth - Password for the user to authenticate with

BedrockModel

name
str
required
A descriptive name to identify this model integration in the UI
model_id
str
required
The AWS Bedrock model identifier or inference profile. Can be a foundation model ID (e.g., anthropic.claude-3-5-sonnet-20240620-v1:0, amazon.titan-text-express-v1), an inference profile ID (e.g., us.anthropic.claude-3-5-sonnet-20240620-v1:0), or an inference profile ARN (e.g., arn:aws:bedrock:us-east-1:123456789012:inference-profile/my-profile).
type
typing.Literal[Any]
default:"integration/model/bedrock"
required
model_types
typing.List[ModelType]
required
πŸ”— ModelTypeSpecify the type of the Bedrock model
region
typing.Optional[AwsRegion]
cost
typing.Optional[ModelCostMetric]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

BitbucketIntegration

type
typing.Literal[Any]
default:"integration/vcs/bitbucket"
required
name
str
required
account_name
str
required
Account Name
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

BitbucketProviderAccount

type
typing.Literal[Any]
default:"provider-account/bitbucket"
required
name
str
required
integrations
typing.List[BitbucketIntegration]
required
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

BlobStorageReference

type
typing.Literal[Any]
default:"blob-storage"
required
path
str
required
Path to the content in blob storage
mime_type
MimeType
required
πŸ”— MimeTypeMIME type of the content

BlueGreen

type
typing.Literal[Any]
default:"blue_green"
required
enable_auto_promotion
typing.Optional[bool]
Promote the new release to handle the complete traffic. A manual promotion would be needed if this is disabled
auto_promotion_seconds
typing.Optional[int]
default:"30"
Promote the new release to handle the complete traffic after waiting for these many seconds

BudgetAlert

thresholds
typing.List[float]
required
List of usage percentages (0-100) at which alerts should be triggered. Default thresholds are [75, 90, 95, 100].
notification_target
typing.List[NotificationTarget]
required
πŸ”— NotificationTargetSelect where to send budget alert notifications

BudgetConfig

type
typing.Literal[Any]
default:"gateway-budget-config"
required
rules
typing.List[BudgetRule]
required
πŸ”— BudgetRuleList of budget rules

BudgetRule

id
str
required
Unique identifier for the rule
when
BudgetWhen
required
limit_to
float
required
Numeric limit value for the budget
unit
BudgetLimitUnit
required
budget_applies_per
typing.Optional[typing.List[str]]
Create separate budget rules for each unique value of the selected entity. For example, if β€œuser” is selected, a separate budget rule will be created for each unique user making requests. Options: user, virtualaccount, model, or a metadata key (e.g., metadata.appId).
alerts
typing.Optional[BudgetAlert]
audit_mode
typing.Optional[bool]
When enabled, requests exceeding the budget are tracked but not blocked

BudgetWhen

subjects
typing.Optional[typing.List[str]]
List of subjects that this rule applies to
models
typing.Optional[typing.List[str]]
List of models that this rule applies to
metadata
typing.Optional[typing.Dict[(str, str)]]
Metadata key-value pairs that this rule applies to

Build

type
typing.Literal[Any]
default:"build"
required
docker_registry
typing.Optional[str]
FQN of the container registry. If you can’t find your registry here, add it through the Integrations page
build_source
BuildBuildSource
required
πŸ”— BuildBuildSourceSource code location.
build_spec
BuildBuildSpec
required
πŸ”— BuildBuildSpecInstructions to build a container image out of the build source

BuildBuildSource

Union, One Of:

BuildBuildSpec

Union, One Of:

BuildInfo

name
str
required
status
float
required
Status of the build: STARTED = 20, SUCCEEDED = 30, FAILED = 40

BuildSecret

id
str
required
The ID of the build secret.
value
str
required
The value of the build secret.
env
typing.Optional[str]
The name of the environment variable to inject the secret into.

Canary

type
typing.Literal[Any]
default:"canary"
required
steps
typing.List[CanaryStep]
required
πŸ”— CanaryStepThese steps would be executed in order to enable shifting of traffic slowly from stable to canary version

CanaryStep

weight_percentage
int
required
Percentage of total traffic to be shifted to the canary release. The rest will continue to go to the existing deployment
pause_duration
typing.Optional[int]
Duration for which to pause the release. The release process will wait for these seconds before proceeding to the next step. If this is not set, the step will pause indefinitely on this step

CartesiaApiKeyAuth

type
typing.Literal[Any]
default:"api-key"
required
api_key
str
required
The API key for Cartesia authentication

CartesiaModel

type
typing.Literal[Any]
default:"integration/model/cartesia"
required
name
str
required
A descriptive name to identify this model integration in the UI
model_id
str
required
The Cartesia model identifier (for example, sonic-2, sonic-multilingual)
model_types
typing.List[ModelType]
required
πŸ”— ModelTypeSpecify the type of the Cartesia model (text_to_speech or audio_transcription)
cost
typing.Optional[ModelCostMetric]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

CartesiaProviderAccount

type
typing.Literal[Any]
default:"provider-account/cartesia"
required
name
str
required
The name of the Cartesia provider account
base_url
typing.Optional[str]
Optional custom base URL for Cartesia API
cartesia_version
CartesiaProviderAccountCartesiaVersion
required
πŸ”— CartesiaProviderAccountCartesiaVersionThe Cartesia API version header. Must be set to a supported API version.
auth_data
CartesiaApiKeyAuth
required
integrations
typing.List[CartesiaModel]
required
πŸ”— CartesiaModelList of integrations that are associated with the Cartesia provider account
collaborators
typing.Optional[typing.List[Collaborator]]
πŸ”— CollaboratorList of users who have access to this provider account
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

CedarGuardrailConfig

name
str
required
The name of the Guardrail Config.
description
typing.Optional[str]
Optional description for this Guardrail Config.
type
typing.Literal[Any]
default:"integration/guardrail-config/cedar"
required
operation
typing.Literal[Any]
default:"validate"
required
The operation type for this guardrail. Cedar guardrails can only be used for validation.
enforcing_strategy
EnforcingStrategy
required
config
CedarGuardrailConfigConfig
required

CedarGuardrailConfigConfig

policy
str
required
Enter a Cedar policy string to define access control rules. Supports principal types (user, team, virtualaccount), MCPTool actions, MCPServer resources, and when/unless clauses, refer to Docs

CerebrasKeyAuth

type
typing.Literal[Any]
default:"api-key"
required
api_key
str
required
The API key for Cerebras authentication

CerebrasModel

type
typing.Literal[Any]
default:"integration/model/cerebras"
required
name
str
required
A descriptive name to identify this model integration in the UI
model_id
str
required
The Cerebras model identifier (e.g., llama-4-scout-17b-16e-instruct, llama3.1-70b). This is the standard model name from Cerebras’s API documentation.
model_types
typing.List[ModelType]
required
πŸ”— ModelTypeSpecify the type of the Cerebras model
cost
typing.Optional[ModelCostMetric]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

CerebrasProviderAccount

type
typing.Literal[Any]
default:"provider-account/cerebras"
required
name
str
required
The name of the Cerebras provider account
auth_data
CerebrasKeyAuth
required
integrations
typing.Optional[typing.List[CerebrasIntegrations]]
List of integrations that are associated with the Cerebras provider account
collaborators
typing.Optional[typing.List[Collaborator]]
πŸ”— CollaboratorList of users who have access to this provider account
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

ChangePasswordResponse

Union, One Of:

ChatPromptManifest

name
str
required
Name of the prompt (alphanumeric characters, hyphens, and underscores only, max 256 characters)
metadata
typing.Dict[(str, typing.Any)]
required
Key value metadata. Should be valid JSON. For e.g. \{"business-unit": "sales", "quality": "good", "rating": 4.5\}
ml_repo
str
required
Name of the ML Repo that this prompt belongs to (must start and end with alphanumeric, 2-100 characters)
version
typing.Optional[int]
Version of the entity
type
typing.Literal[Any]
default:"chat_prompt"
required
description
typing.Optional[str]
version_alias
typing.Optional[str]
Version alias is alternate, ideally human readable, version string to reference an artifact version. It should start with v followed by alphanumeric and it can include . and - in between (e.g. v1.0.0, v1-prod, v3-dev, etc)
messages
typing.List[ChatPromptManifestMessagesItem]
required
πŸ”— ChatPromptManifestMessagesItemList of messages in the chat conversation, must be non-empty
variables
typing.Optional[typing.Dict[(str, str)]]
Variables referenced in messages and that can be replaced when running generation
model_configuration
typing.Optional[ModelConfiguration]
tools
typing.Optional[typing.List[ToolSchema]]
πŸ”— ToolSchemaList of tools to be used in the chat prompt
mcp_servers
typing.Optional[typing.List[ChatPromptManifestMcpServersItem]]
πŸ”— ChatPromptManifestMcpServersItemA list of MCP servers FQNs or URLs and their tools
guardrails
typing.Optional[Guardrails]
response_format
typing.Optional[ChatPromptManifestResponseFormat]
πŸ”— ChatPromptManifestResponseFormatResponse format configuration for structured outputs
routing_config
typing.Optional[ChatPromptManifestRoutingConfig]
πŸ”— ChatPromptManifestRoutingConfigConfiguration for routing requests to different model targets
cache_config
typing.Optional[ChatPromptManifestCacheConfig]
πŸ”— ChatPromptManifestCacheConfigCache configuration for the chat prompt
tool_call_to_mcp_mapping
typing.Optional[typing.Dict[(str, McpServerToolDetails)]]
πŸ”— McpServerToolDetailsMapping of tool calls to MCP server integration IDs and tool names
logging_config
typing.Optional[LoggingConfig]
sub_agents
typing.Optional[typing.List[SubAgent]]
πŸ”— SubAgentSub agents to be used in the chat prompt

ChatPromptManifestCacheConfig

Union, One Of:

ChatPromptManifestMcpServersItem

Union, One Of:

ChatPromptManifestMessagesItem

Union, One Of:

ChatPromptManifestResponseFormat

Union, One Of:

ChatPromptManifestRoutingConfig

Union, One Of:

ClouderaModel

type
typing.Literal[Any]
default:"integration/model/cloudera"
required
name
str
required
A descriptive name to identify this model integration in the UI
model_id
str
required
The unique identifier of the Model in Cloudera Model Registry. This is the model ID assigned when you registered or deployed your model in the CDP Model Registry
base_url
str
required
The model endpoint URL up to the API version v1. To get the base_url, copy the model endpoint URL and delete the last two path components
model_types
typing.List[ModelType]
required
πŸ”— ModelTypeSpecify the type of the Cloudera model
cost
typing.Optional[ModelCostMetric]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

ClouderaProviderAccount

type
typing.Literal[Any]
default:"provider-account/cloudera"
required
name
str
required
The name of the Cloudera provider account
auth_data
ClouderaProviderAccountAuthData
required
πŸ”— ClouderaProviderAccountAuthDataCloudera authentication credentials
integrations
typing.List[ClouderaIntegrations]
required
List of integrations that are associated with the Cloudera provider account
collaborators
typing.Optional[typing.List[Collaborator]]
πŸ”— CollaboratorList of users who have access to this provider account
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

ClouderaProviderAccountAuthData

Union, One Of:

ClouderaTokenAuth

type
typing.Literal[Any]
default:"token"
required
api_token
str
required
Pre-generated API token for Cloudera CDP authentication. You can generate this token using the CDP CLI or from your user profile settings. This token provides direct access to CDP services without requiring workload-specific authentication.

ClouderaWorkloadAuthToken

type
typing.Literal[Any]
default:"workload-auth-token"
required
cdp_base_url
str
required
The base URL for CDP API services
access_key_id
str
required
The access key ID for your Cloudera CDP workload authentication.
private_key
str
required
The private key for your Cloudera CDP workload authentication.
workload_name
str
required
The name of the CDP workload you want to authenticate with.

Cluster

id
str
required
fqn
str
required
manifest
ClusterManifest
required
tenant_name
typing_extensions.Annotated[(str, Any, Any)]
required
account_id
typing_extensions.Annotated[(str, Any, Any)]
required
created_by_subject
typing_extensions.Annotated[(typing.Optional[Subject], Any, Any)]
created_at
typing_extensions.Annotated[(dt.datetime, Any, Any)]
required
updated_at
typing_extensions.Annotated[(dt.datetime, Any, Any)]
required
created_by
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]

ClusterGateway

uid
typing.Optional[str]
name
str
required
hosts
typing.List[str]
required
is_tie_breaker
typing_extensions.Annotated[(typing.Optional[bool], Any, Any)]
selector
typing.Dict[(str, str)]
required

ClusterManifest

type
typing.Literal[Any]
default:"cluster"
required
name
str
required
Name - 3 to 35 lower case characters long alphanumeric word, may contain - in between, cannot start with a number
cluster_type
ClusterManifestClusterType
required
πŸ”— ClusterManifestClusterTypeThe cluster type of this cluster
environment_names
typing.List[str]
required
Tag the environment like dev, staging or production. You will need to create environments if you don’t have already.
base_domains
typing.Optional[typing.List[str]]
One or more base URLs, which can be either a wildcard domain (resulting in app URLs like \<app-name\>-\<workspace-name\>.\<base-domain-URL\>) or a non-wildcard domain (resulting in app URLs like \<base-domain-URL\>/\<app-name\>-\<workspace-name\>) > Read more about routing here and about β€˜A’ record and domain mapping here
monitoring
typing.Optional[ClusterManifestMonitoring]
default_registry_fqn
typing.Optional[str]
Cluster Default Registry
workbench_config
typing.Optional[ClusterManifestWorkbenchConfig]
spark_config
typing.Optional[SparkConfig]
ingress_controller_config
typing.Optional[IngressControllerConfig]
cluster_integration_fqn
typing.Optional[str]
Cluster Integration FQN
workflow_storage_integration_fqn
typing.Optional[str]
Workflow Storage Integration
supported_nodepools
typing.Optional[typing.List[Nodepool]]
πŸ”— NodepoolAdd nodepools that are already created in your cluster. When deploying, applications can choose to schedule from these nodepools.
node_label_keys
typing.Optional[ClusterManifestNodeLabelKeys]
πŸ”— ClusterManifestNodeLabelKeysThe node label keys that this cluster supports. Note: You will additionally need to add truefoundry.com/gpu_type label for GPU-supported node pools. For more information, check out this documentation.
collaborators
typing.List[Collaborator]
required
πŸ”— CollaboratorCollaborators who can access this cluster
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

ClusterManifestMonitoring

loki_url
typing.Optional[str]
Cluster Loki URL
victoria_logs_url
typing.Optional[str]
Cluster VictoriaLogs URL
prometheus_url
typing.Optional[str]
Cluster Prometheus URL
kubecost_url
typing.Optional[str]
Cluster Kubecost URL

ClusterManifestNodeLabelKeys

nodepool_selector_label
str
required
The nodepool selector label that this cluster supports

ClusterManifestWorkbenchConfig

notebook_config
typing.Optional[NotebookConfig]
ssh_server_config
typing.Optional[SshServerConfig]
default_storage_class
typing.Optional[str]
The default storage class for the home directory of workbench

ClustersDeleteResponse

message
typing.Optional[str]
Success message

CodeSafetyLinterGuardrailConfig

name
str
required
The name of the Guardrail Config.
description
typing.Optional[str]
Optional description for this Guardrail Config.
type
typing.Literal[Any]
default:"integration/guardrail-config/code-safety-linter"
required
operation
typing.Literal[Any]
default:"validate"
required
The operation type for this guardrail. Code Safety Linter guardrails can only be used for validation.
enforcing_strategy
EnforcingStrategy
required

Codeserver

type
typing.Literal[Any]
default:"codeserver"
required
image
WorkbenchImage
required

CohereKeyAuth

type
typing.Literal[Any]
default:"api-key"
required
api_key
str
required
The API key for Cohere authentication

CohereModel

type
typing.Literal[Any]
default:"integration/model/cohere"
required
name
str
required
A descriptive name to identify this model integration in the UI
model_id
str
required
The Cohere model identifier (e.g., command-a-03-2025, command-r-03-2024, command-r-03-2024). This is the standard model id from Cohere’s model catalog.
model_types
typing.List[ModelType]
required
πŸ”— ModelTypeSpecify the type of the Cohere model
cost
typing.Optional[ModelCostMetric]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

CohereProviderAccount

type
typing.Literal[Any]
default:"provider-account/cohere"
required
name
str
required
The name of the Cohere provider account
auth_data
CohereKeyAuth
required
integrations
typing.Optional[typing.List[CohereIntegrations]]
List of integrations that are associated with the Cohere provider account
collaborators
typing.Optional[typing.List[Collaborator]]
πŸ”— CollaboratorList of users who have access to this provider account
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

Collaborator

subject
str
required
Fully Qualified Name of the subject. eg: user:email or team:teamname
role_id
str
required
Role ID for the resource

CommonToolsSettings

type
typing.Literal[Any]
default:"settings/common-tools"
required
Enable web search tool Allows model to search the web for information.
code_executor
bool
required
Enable code executor tool Allows model to execute code and return the results.
sandbox_exec
bool
required
Enable sandbox executor tool Allows model to execute shell command in an isolated stateful sandbox environment.
sequential_thinking
bool
required
Enable sequential thinking tool Allows model to reason step-by-step to solve complex problems.
web_scrape
bool
required
Enable web scraping tool. Allows model to scrape content from web pages with intelligent format selection for structured or unstructured data.

ContainerTaskConfig

type
typing.Literal[Any]
default:"container-task-config"
required
image
ContainerTaskConfigImage
required
πŸ”— ContainerTaskConfigImageSpecify whether you want to deploy a Docker image or build and deploy from source code
env
typing.Optional[typing.Dict[(str, typing.Optional[str])]]
Configure environment variables to be injected in the task either as plain text or secrets. Docs
resources
typing.Optional[Resources]
mounts
typing.Optional[typing.List[ContainerTaskConfigMountsItem]]
πŸ”— ContainerTaskConfigMountsItemConfigure data to be mounted to Workflow pod(s) as a volume.
service_account
typing.Optional[str]
Service Account

ContainerTaskConfigImage

Union, One Of:

ContainerTaskConfigMountsItem

Union, One Of:

CoreNatsOutputConfig

type
typing.Literal[Any]
default:"core-nats"
required
nats_url
str
required
Output NATS URL
root_subject
str
required
Root subject of output NATS
auth
typing.Optional[NatsUserPasswordAuth]

CpuUtilizationMetric

type
typing.Literal[Any]
default:"cpu_utilization"
required
value
int
required
Percentage of cpu request averaged over all replicas which the autoscaler should try to maintain

CreateDockerRepositoryResponse

repo_name
typing_extensions.Annotated[(str, Any, Any)]
required

CreateMultiPartUploadRequest

id
str
required
ID of the artifact version to upload files to
path
str
required
Relative path within the artifact version where the file should be uploaded
num_parts
int
required
Number of parts to split the upload into for multipart upload

CreatePersonalAccessTokenResponse

token
str
required
Personal Access Token

CronMetric

type
typing.Literal[Any]
default:"cron"
required
desired_replicas
typing.Optional[int]
Desired number of replicas during the given interval. Default value is max_replicas.
start
str
required
Cron expression indicating the start of the cron schedule. * * * * * | | | | | | | | | |___ day of week (0-6) (Sunday is 0) | | | |_____ month (1-12) | | |_______ day of month (1-31) | |_________ hour (0-23) |___________ minute (0-59)
end
str
required
Cron expression indicating the end of the cron schedule. * * * * * | | | | | | | | | |___ day of week (0-6) (Sunday is 0) | | | |_____ month (1-12) | | |_______ day of month (1-31) | |_________ hour (0-23) |___________ minute (0-59)
timezone
str
default:"UTC"
required
Timezone against which the cron schedule will be calculated, e.g. β€œAsia/Tokyo”. Default is machine’s local time. https://docs.truefoundry.com/docs/list-of-supported-timezones

CustomAgentServerAuth

Union, One Of:

CustomBasicAuth

type
typing.Literal[Any]
default:"basic-auth"
required
username
str
required
The username for the basic authentication.
password
str
required
The password for the basic authentication.

CustomBearerAuth

type
typing.Literal[Any]
default:"bearer-auth"
required
bearer_token
str
required
The bearer token for the custom bearer authentication.

CustomBlobStorage

type
typing.Literal[Any]
default:"integration/blob-storage/custom"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
endpoint
str
required
The endpoint of the storage provider.
storage_root
str
required
The S3-compatible storage path in the format β€˜s3://<bucket-name>/<optional-path-prefix>’. Works with S3-compatible storage providers like MinIO, Ceph, and DigitalOcean Spaces. Example: β€˜s3://mybucket’ or β€˜s3://mybucket/artifacts/production’.
region
typing.Optional[str]
The region where the storage is located.
auth_data
CustomBasicAuth
required
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

CustomEndpoint

type
typing.Literal[Any]
default:"integration/model/custom-endpoint"
required
name
str
required
A descriptive name to identify this endpoint in the UI
base_url
str
required
The target base URL to proxy requests to (e.g., https://my-service.example.com/v1)
auth_data
typing.Optional[CustomEndpointAuthData]
πŸ”— CustomEndpointAuthDataAuthentication credentials for the upstream endpoint. Overrides account-level auth if set.
headers
typing.Optional[typing.Dict[(str, str)]]
Custom headers forwarded to the upstream endpoint with every request. For example: \{"X-Custom-Header": "value"\}
tls_settings
typing.Optional[CustomTlsSettings]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this endpoint. List of user fqn in format <user_type>:<username>.

CustomEndpointAuthData

Union, One Of:

CustomEndpointProviderAccount

type
typing.Literal[Any]
default:"provider-account/custom-endpoint"
required
name
str
required
The name of the custom endpoint provider account.
auth_data
typing.Optional[CustomEndpointProviderAccountAuthData]
πŸ”— CustomEndpointProviderAccountAuthDataDefault authentication data for all endpoints under this account. Can be overridden at the endpoint level.
integrations
typing.List[CustomEndpointIntegrations]
required
πŸ”— CustomEndpointList of endpoint integrations associated with this provider account.
collaborators
typing.Optional[typing.List[Collaborator]]
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

CustomEndpointProviderAccountAuthData

Union, One Of:

CustomFramework

type
typing.Literal[Any]
default:"custom"
required
Type

CustomGuardrailConfig

name
str
required
The name of the Guardrail Config.
description
typing.Optional[str]
Optional description for this Guardrail Config.
type
typing.Literal[Any]
default:"integration/guardrail-config/custom"
required
auth_data
typing.Optional[CustomGuardrailConfigAuthData]
πŸ”— CustomGuardrailConfigAuthDataAuthentication data for the Guardrail Server.
operation
CustomGuardrailConfigOperation
required
πŸ”— CustomGuardrailConfigOperationThe operation type to use for the Guardrail. Validate guardrails are used to validate requests and mutate can validate as well as mutate requests. Validate guardrails are run in parallel while mutate guardrails are run sequentially.
priority
typing.Optional[int]
default:"1"
Execution order for mutate guardrails. Lower values run first. Only applicable when operation is mutate.
enforcing_strategy
EnforcingStrategy
required
target
CustomGuardrailConfigTarget
required
πŸ”— CustomGuardrailConfigTargetSpecify whether the guardrail should be applied to the request or response. Guardrails with target β€œRequest” can be only used in input guardrails and guardrails with target β€œResponse” can only be used in output guardrails.
config
CustomGuardrailConfigConfig
required

CustomGuardrailConfigAuthData

Union, One Of:

CustomGuardrailConfigConfig

url
str
required
The URL of the Guardrail to send a post request to.
headers
typing.Optional[typing.Dict[(str, str)]]
Headers for the Guardrail Server. Forwarded to the Guardrail Server as is. For example: \{"Authorization": "APIKey \<token\>"\}
config
typing.Optional[typing.Dict[(str, typing.Any)]]
The config for the Guardrail Server. This is a JSON object that will be sent as a config to Guardrail Server along with the request.

CustomHeaderAuth

type
typing.Literal[Any]
default:"header"
required
headers
typing.Dict[(str, str)]
required
Headers passed to the generic secret server with every request.

CustomHelmRepo

type
typing.Literal[Any]
default:"integration/helm-repo/custom"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
repo_url
str
required
The URL of the Helm Repo.
auth_data
CustomBasicAuth
required
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

CustomIntegrations

Union, One Of:

CustomJwtAuthIntegration

type
typing.Literal[Any]
default:"integration/jwt-auth/custom"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
issuer
str
required
The base URL of the authentication provider.
jwks_uri
str
required
The JSON Web Key Set URI for JWT verification.
login_provider
typing.Optional[OAuth2LoginProvider]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

CustomProviderAccount

type
typing.Literal[Any]
default:"provider-account/custom"
required
name
str
required
The name of the provider account.
auth_data
typing.Optional[CustomBasicAuth]
integrations
typing.List[CustomIntegrations]
required
πŸ”— CustomIntegrationsList of integrations that are associated with the provider account.
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

CustomRegexPattern

pattern
str
required
A custom regex pattern to match against content (e.g., β€œ\b\d{3}-\d{2}-\d{4}\b” for SSN)
redaction_text
typing.Optional[str]
default:"[REDACTED]"
Text to use when redacting matched content (only applicable in mutate mode). Defaults to β€˜[REDACTED]’.

CustomServerHeaderAuth

type
typing.Literal[Any]
default:"header"
required
headers
typing.Dict[(str, str)]
required

CustomServerPassthrough

type
typing.Literal[Any]
default:"passthrough"
required

CustomTlsSettings

reject_unauthorized
bool
required
When set to true, it will reject any connection which is not authorized with the list of supplied CAs.
ca_cert
typing.Optional[str]
Add custom CA certificates to use for TLS verification.

CustomUsernamePasswordArtifactsRegistry

type
typing.Literal[Any]
default:"integration/docker-registry/custom"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
registry_url
str
required
The URL of the registry.
auth_data
typing.Optional[CustomBasicAuth]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

DataAccessRule

Union, One Of:

DataAccessRuleBase

id
str
required
Unique identifier for the rule
description
typing.Optional[str]
Description of the rule
enabled
typing.Optional[bool]
Whether this rule is enabled
subjects
typing.List[str]
required
List of subjects that this rule applies to (users, teams, roles)
data_types
typing.List[GatewayDataType]
required
πŸ”— GatewayDataTypeList of data types that this rule applies to

DatabricksApiKeyAuth

type
typing.Literal[Any]
default:"api-key"
required
api_key
str
required
API key for Databricks authentication.

DatabricksJobTaskConfig

type
typing.Literal[Any]
default:"databricks-job-task-config"
required
image
DatabricksJobTaskConfigImage
required
πŸ”— DatabricksJobTaskConfigImageSpecify the image spec for the task
workspace_host
str
required
Databricks workspace URL, e.g. https://<workspace>.cloud.databricks.com
job_id
str
required
The Databricks job ID to run (from Databricks workspace Jobs).
service_account
typing.Optional[str]
Service Account
job_parameters
typing.Optional[typing.Dict[(str, typing.Optional[str])]]
Optional parameters to pass to the job run (e.g. notebook params, jar params).
timeout_seconds
typing.Optional[float]
Maximum seconds to wait for the job run to complete. Used by CLI when polling.
skip_wait_for_completion
typing.Optional[bool]
If false, the task waits for the Databricks job run to complete (trigger and poll). If true, only triggers the job and returns. Default false.
env
typing.Optional[typing.Dict[(str, typing.Optional[str])]]
Configure environment variables to be injected in the task either as plain text or secrets. Docs
resources
typing.Optional[Resources]

DatabricksJobTaskConfigImage

Union, One Of:

DatabricksModel

type
typing.Literal[Any]
default:"integration/model/databricks"
required
name
str
required
A descriptive name to identify this model integration in the UI
model_id
str
required
The serving endpoint name configured in your Databricks workspace. This is the endpoint you created in Databricks Model Serving, not the underlying model name.
model_types
typing.List[ModelType]
required
πŸ”— ModelTypeSpecify the type of the Databricks model
cost
typing.Optional[ModelCostMetric]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

DatabricksProviderAccount

type
typing.Literal[Any]
default:"provider-account/databricks"
required
name
str
required
The name of the Databricks provider account
auth_data
DatabricksProviderAccountAuthData
required
πŸ”— DatabricksProviderAccountAuthDataDatabricks authentication credentials
base_url
str
required
The base URL of your Databricks workspace
integrations
typing.List[DatabricksIntegrations]
required
List of integrations that are associated with the Databricks provider account
collaborators
typing.Optional[typing.List[Collaborator]]
πŸ”— CollaboratorList of users who have access to this provider account
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

DatabricksProviderAccountAuthData

Union, One Of:

DatabricksServicePrincipalAuth

type
typing.Literal[Any]
default:"service-principal"
required
oauth_secret
str
required
OAuth secret of the Databricks service principal.
client_id
str
required
Client ID or Application ID of the Databricks service principal.

DataDirectory

id
str
required
Unique identifier for the data directory
ml_repo_id
str
required
ID of the ML Repo that this data directory belongs to
name
str
required
Name of the data directory
fqn
str
required
Fully qualified name of the data directory
created_by_subject
Subject
required
πŸ”— SubjectSubject (user, team, or service account) that created this data directory
created_at
dt.datetime
required
Timestamp when the data directory was created
updated_at
dt.datetime
required
Timestamp when the data directory was last updated
manifest
DataDirectoryManifest
required
πŸ”— DataDirectoryManifestManifest containing metadata for the data directory
usage_code_snippet
typing.Optional[str]
Code snippet demonstrating how to use this data directory

DataDirectoryManifest

type
typing.Literal[Any]
default:"data-dir"
required
name
str
required
Name of the data directory
ml_repo
str
required
Name of the ML Repo to create the data directory under
description
typing.Optional[str]
Description for the data directory
metadata
typing.Dict[(str, typing.Any)]
required
Key Value metadata. Should be valid JSON. For e.g. \{"business-unit": "sales", "quality": "good", "rating": 4.5\}
source
DataDirectoryManifestSource
required

DataDirectoryManifestSource

Union, One Of:

DeactivateUserResponse

Union, One Of:

DeepgramApiKeyAuth

type
typing.Literal[Any]
default:"api-key"
required
api_key
str
required
The API key for Deepgram authentication

DeepgramModel

type
typing.Literal[Any]
default:"integration/model/deepgram"
required
name
str
required
A descriptive name to identify this model integration in the UI
model_id
str
required
The Deepgram model identifier (for example, nova-2, nova-2-general, aura-asteria-en)
model_types
typing.List[ModelType]
required
πŸ”— ModelTypeSpecify the type of the Deepgram model (text_to_speech or audio_transcription)
cost
typing.Optional[ModelCostMetric]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

DeepgramProviderAccount

type
typing.Literal[Any]
default:"provider-account/deepgram"
required
name
str
required
The name of the Deepgram provider account
auth_data
DeepgramApiKeyAuth
required
base_url
typing.Optional[str]
Optional custom base URL for Deepgram API
integrations
typing.List[DeepgramModel]
required
πŸ”— DeepgramModelList of integrations that are associated with the Deepgram provider account
collaborators
typing.Optional[typing.List[Collaborator]]
πŸ”— CollaboratorList of users who have access to this provider account
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

DeepinfraKeyAuth

type
typing.Literal[Any]
default:"api-key"
required
api_key
str
required
The API key for DeepInfra authentication

DeepinfraModel

type
typing.Literal[Any]
default:"integration/model/deepinfra"
required
name
str
required
A descriptive name to identify this model integration in the UI
model_id
str
required
The DeepInfra model identifier (e.g., meta-llama/Llama-3.3-70B-Instruct-Turbo, mistralai/Mistral-Small-24B-Instruct-2501). This is the full model path from DeepInfra’s model catalog.
model_types
typing.List[ModelType]
required
πŸ”— ModelTypeSpecify the type of the DeepInfra model
cost
typing.Optional[ModelCostMetric]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

DeepinfraProviderAccount

type
typing.Literal[Any]
default:"provider-account/deepinfra"
required
name
str
required
The name of the DeepInfra provider account
auth_data
DeepinfraKeyAuth
required
integrations
typing.Optional[typing.List[DeepinfraIntegrations]]
List of integrations that are associated with the DeepInfra provider account
collaborators
typing.Optional[typing.List[Collaborator]]
πŸ”— CollaboratorList of users who have access to this provider account
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

DeleteApplicationResponse

message
str
required
Application deletion message

DeleteJobRunResponse

message
str
required
Job run deleted

DeletePersonalAccessTokenResponse

Union, One Of:

DeleteSecretGroupResponse

Union, One Of:

DeleteTeamResponse

Union, One Of:

DeleteUserResponse

Union, One Of:

DeleteVirtualAccountResponse

Union, One Of:

Deployment

id
typing.Optional[str]
version
typing.Optional[float]
fqn
typing.Optional[str]
application_id
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
manifest
DeploymentManifest
required
application
typing.Optional[Any]
created_by_subject
typing_extensions.Annotated[(Subject, Any, Any)]
required
created_at
typing_extensions.Annotated[(typing.Optional[dt.datetime], Any, Any)]
updated_at
typing_extensions.Annotated[(typing.Optional[dt.datetime], Any, Any)]
deployment_builds
typing_extensions.Annotated[(typing.Optional[typing.List[BuildInfo]], Any, Any)]
deployment_statuses
typing_extensions.Annotated[(typing.Optional[typing.List[DeploymentStatus]], Any, Any)]
current_status_id
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
current_status
typing_extensions.Annotated[(typing.Optional[DeploymentStatus], Any, Any)]
applied_recommendations
typing_extensions.Annotated[(typing.Optional[typing.List[Recommendation]], Any, Any)]
created_by
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]

DeploymentBuild

id
typing.Optional[str]
deployment_id
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
component_name
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
build
typing.Optional[BuildInfo]
build_id
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
image_uri
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
name
typing.Optional[str]
status
typing.Optional[BuildStatus]
get_logs_url
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
tail_logs_url
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
logs_start_ts
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
metadata
typing.Optional[typing.Dict[(str, typing.Any)]]
created_at
typing_extensions.Annotated[(typing.Optional[dt.datetime], Any, Any)]
updated_at
typing_extensions.Annotated[(typing.Optional[dt.datetime], Any, Any)]

DeploymentManifest

Union, One Of:

DeploymentStatus

id
typing.Optional[str]
deployment_id
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
status
typing.Optional[DeploymentStatusValue]
state
typing.Optional[typing.Dict[(str, typing.Any)]]
transition
typing.Optional[DeploymentTransition]
message
typing.Optional[str]
retry_count
typing_extensions.Annotated[(typing.Optional[float], Any, Any)]
created_at
typing_extensions.Annotated[(typing.Optional[dt.datetime], Any, Any)]
updated_at
typing_extensions.Annotated[(typing.Optional[dt.datetime], Any, Any)]

DeveloperMessage

role
typing.Literal[Any]
default:"developer"
required
The role of the messages author, in this case developer.
content
DeveloperMessageContent
required
πŸ”— DeveloperMessageContentThe contents of the developer message.
name
typing.Optional[str]
An optional name for the participant.

DeveloperMessageContent

Union, One Of:

DockerFileBuild

type
typing.Literal[Any]
default:"dockerfile"
required
dockerfile_path
str
default:"./Dockerfile"
required
The file path of the Dockerfile relative to project root path.
build_context_path
str
default:"./"
required
Build context path for the Dockerfile relative to project root path.
command
typing.Optional[DockerFileBuildCommand]
πŸ”— DockerFileBuildCommandOverride the command to run when the container starts When deploying a Job, the command can be templatized by defining params and referencing them in command E.g. python main.py --learning_rate \{\{learning_rate\}\}
build_args
typing.Optional[typing.Dict[(str, str)]]
Build arguments to pass to docker build
build_secrets
typing.Optional[typing.List[BuildSecret]]
πŸ”— BuildSecretBuild secrets you can use in run statements inside dockerfile like RUN β€”mount=type=secret,id=pip_index_url … you can learn more about build secrets here https://www.truefoundry.com/docs/docker-build-secrets

DockerFileBuildCommand

Union, One Of:

DockerhubBasicAuth

type
typing.Literal[Any]
default:"basic-auth"
required
username
str
required
password
str
required

DockerhubProviderAccount

type
typing.Literal[Any]
default:"provider-account/dockerhub"
required
name
str
required
3 to 36 lower case characters long alphanumeric word, may contain - in between, cannot start with a number
account_name
typing.Optional[str]
Account Name
auth_data
typing.Optional[DockerhubBasicAuth]
integrations
typing.List[DockerhubIntegrations]
required
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

DockerhubRegistry

type
typing.Literal[Any]
default:"integration/docker-registry/dockerhub"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
registry_url
str
required
Registry URL
auth_data
typing.Optional[DockerhubBasicAuth]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

DynamicVolumeConfig

type
typing.Literal[Any]
default:"dynamic"
required
Volume Type for the volume.
storage_class
str
required
Name of the storage class to be used for the volume.
size
int
required
Size of volume in Gi

ElevenLabsApiKeyAuth

type
typing.Literal[Any]
default:"api-key"
required
api_key
str
required
The XI API key for ElevenLabs authentication

ElevenLabsModel

type
typing.Literal[Any]
default:"integration/model/elevenlabs"
required
name
str
required
A descriptive name to identify this model integration in the UI
model_id
str
required
The ElevenLabs model identifier (for example, eleven_multilingual_v2, eleven_turbo_v2_5)
model_types
typing.List[ModelType]
required
πŸ”— ModelTypeSpecify the type of the ElevenLabs model (text_to_speech or audio_transcription)
cost
typing.Optional[ModelCostMetric]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

ElevenLabsProviderAccount

type
typing.Literal[Any]
default:"provider-account/elevenlabs"
required
name
str
required
The name of the ElevenLabs provider account
auth_data
ElevenLabsApiKeyAuth
required
base_url
typing.Optional[str]
Optional custom base URL for ElevenLabs API
integrations
typing.List[ElevenLabsModel]
required
πŸ”— ElevenLabsModelList of integrations that are associated with the ElevenLabs provider account
collaborators
typing.Optional[typing.List[Collaborator]]
πŸ”— CollaboratorList of users who have access to this provider account
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

Email

type
typing.Literal[Any]
default:"email"
required
notification_channel
str
required
Specify the notification channel to send alerts to
to_emails
typing.List[str]
required
List of recipients’ email addresses if the notification channel is Email.

EmailNotificationChannel

type
typing.Literal[Any]
default:"integration/notification-channel/email"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
auth_data
SmtpCredentials
required
from_email
str
required
The email address from which the email will be sent.
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

EmptyResponse

Union, One Of:

Endpoint

host
str
required
Host e.g. ai.example.com, app.truefoundry.com
path
typing.Optional[str]
Path e.g. /v1/api/ml/, /v2/docs/

EnkryptAiGuardrailConfig

name
str
required
The name of the Guardrail Config.
description
typing.Optional[str]
Optional description for this Guardrail Config.
type
typing.Literal[Any]
default:"integration/guardrail-config/enkrypt-ai"
required
auth_data
EnkryptAiKeyAuth
required
operation
EnkryptAiGuardrailConfigOperation
required
πŸ”— EnkryptAiGuardrailConfigOperationThe operation type to use for the Guardrail. Validate guardrails are used to validate requests and mutate can validate as well as mutate requests. Validate guardrails are run in parallel while mutate guardrails are run sequentially.
priority
typing.Optional[int]
default:"1"
Execution order for mutate guardrails. Lower values run first. Only applicable when operation is mutate.
enforcing_strategy
EnforcingStrategy
required
config
EnkryptAiGuardrailConfigConfig
required

EnkryptAiGuardrailConfigConfig

guardrail_name
str
required
The name of the guardrail to use for the Enkrypt AI Guardrail.

EnkryptAiKeyAuth

type
typing.Literal[Any]
default:"api-key"
required
api_key
str
required
The API key for Enkrypt AI authentication

Environment

id
typing.Optional[str]
priority
float
required
color
EnvironmentColor
required
tenant_name
typing_extensions.Annotated[(str, Any, Any)]
required
created_by_subject
typing_extensions.Annotated[(Subject, Any, Any)]
required
is_production
typing_extensions.Annotated[(bool, Any, Any)]
required
optimize_for
typing_extensions.Annotated[(typing.Optional[EnvironmentOptimizeFor], Any, Any)]
manifest
EnvironmentManifest
required
created_by
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]

EnvironmentColor

color_hex
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
background_color_hex
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
color
typing.Optional[str]
background_color
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]

EnvironmentManifest

type
typing.Literal[Any]
default:"environment"
required
name
str
required
Environment Name
color
EnvironmentColor
required
is_production
typing_extensions.Annotated[(bool, Any, Any)]
required
optimize_for
typing_extensions.Annotated[(EnvironmentOptimizeFor, Any, Any)]
required

Event

name
typing.Optional[str]
Name of the event
first_timestamp
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
last_timestamp
typing_extensions.Annotated[(str, Any, Any)]
required
involved_object
typing_extensions.Annotated[(EventInvolvedObject, Any, Any)]
required
type
str
required
Type of the event
count
int
required
Number of occurrences of the event
reason
str
required
Reason for the event
message
str
required
Message describing the event
namespace
typing.Optional[str]
Namespace of the event
chart
EventChart
required
πŸ”— EventChartChart of the event

EventChart

category
EventChartCategory
required

EventInvolvedObject

kind
str
required
name
str
required
api_version
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
namespace
typing.Optional[str]
container_name
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]

ExactMatchCacheConfig

type
typing.Literal[Any]
default:"exact-match"
required
namespace
typing.Optional[str]
Cache namespace (defaults to β€˜default’ if not provided)
ttl
float
default:"3600.0"
required
Time-to-live for cached entries in seconds (max 3 days)

ExternalBlobStorageSource

type
typing.Literal[Any]
default:"external"
required
uri
str
required
URI referencing a path in the blob storage bucket linked to the MLRepo

FastAiFramework

type
typing.Literal[Any]
default:"fastai"
required

FiddlerGuardrailConfig

name
str
required
The name of the Guardrail Config.
description
typing.Optional[str]
Optional description for this Guardrail Config.
type
typing.Literal[Any]
default:"integration/guardrail-config/fiddler"
required
auth_data
FiddlerKeyAuth
required
operation
typing.Literal[Any]
default:"validate"
required
The operation type for this guardrail. Fiddler guardrails can only be used for validation.
enforcing_strategy
EnforcingStrategy
required
config
FiddlerGuardrailConfigConfig
required

FiddlerGuardrailConfigConfig

guard_type
FiddlerGuardType
required
threshold
typing.Optional[float]
Confidence threshold (0.0-1.0) for flagging content. Content scoring above the threshold will be flagged

FiddlerKeyAuth

type
typing.Literal[Any]
default:"api-key"
required
api_key
str
required
API key for the Fiddler account

FileInfo

path
str
required
Relative path of the file or directory within the artifact version
is_dir
bool
required
Whether this path represents a directory (true) or a file (false)
file_size
typing.Optional[int]
Size of the file in bytes (only present for files, not directories)
signed_url
typing.Optional[str]
Pre-signed URL to download the file directly (only present for files)
last_modified
typing.Optional[dt.datetime]
Timestamp when the file was last modified

FlyteLaunchPlan

id
FlyteLaunchPlanId
required
spec
FlyteLaunchPlanSpec
required
closure
typing.Any
required

FlyteLaunchPlanId

resource_type
typing_extensions.Annotated[(typing.Literal[Any], Any, Any)]
default:"LAUNCH_PLAN"
required
name
str
required

FlyteLaunchPlanSpec

workflow_id
typing_extensions.Annotated[(FlyteWorkflowId, Any, Any)]
required

FlyteTask

template
FlyteTaskTemplate
required
description
typing.Optional[typing.Any]

FlyteTaskCustom

truefoundry
FlyteTaskCustomTruefoundry
required

FlyteTaskCustomTruefoundry

Union, One Of:

FlyteTaskId

resource_type
typing_extensions.Annotated[(typing.Literal[Any], Any, Any)]
default:"TASK"
required
name
str
required

FlyteTaskTemplate

id
FlyteTaskId
required
custom
FlyteTaskCustom
required

FlyteWorkflow

template
FlyteWorkflowTemplate
required
description
typing.Optional[typing.Any]

FlyteWorkflowId

resource_type
typing_extensions.Annotated[(typing.Literal[Any], Any, Any)]
default:"WORKFLOW"
required
name
str
required

FlyteWorkflowTemplate

id
FlyteWorkflowId
required

ForwardAction

type
typing.Literal[Any]
default:"forward"
required
service_uri
str
required
Service uri to redirect to. This is the kubernetes fully qualified domain name that the target service can be reached on Eg - For a service called sample-service in workspace ws this would be `sample-service.ws.svc.cluster.local
port
int
required
Port to redirect the service traffic to

Function

name
str
required
Name of the tool/function being called
arguments
str
required
Arguments passed to the tool/function

FunctionSchema

name
str
required
Name of the function
description
typing.Optional[str]
Description of the function
parameters
typing.Optional[typing.Dict[(str, typing.Any)]]
Parameters schema for the function
strict
typing.Optional[bool]
Indicates if the function should be called strictly

GatewayConfig

Union, One Of:

GatewayConfiguration

id
typing.Optional[str]
tenant_name
typing_extensions.Annotated[(str, Any, Any)]
required
type
str
required
manifest
types_config_Config
required
created_by_subject
typing_extensions.Annotated[(Subject, Any, Any)]
required
created_at
typing_extensions.Annotated[(typing.Optional[dt.datetime], Any, Any)]
updated_at
typing_extensions.Annotated[(typing.Optional[dt.datetime], Any, Any)]

GatewayDataAccessConfig

type
typing.Literal[Any]
default:"gateway-data-access-config"
required
rules
typing.List[DataAccessRule]
required
πŸ”— DataAccessRuleList of data access rules

GatewayDataCreatedByFilter

field
typing.Literal[Any]
default:"created_by"
required
Filter type
operator
typing.Literal[Any]
default:"IN"
required
Comparison operator
value
typing.List[str]
required
List of subjects (users, virtual accounts, teams) to filter by

GatewayDataMetadataFilter

field
typing.Literal[Any]
default:"metadata"
required
Filter type
key
str
required
Metadata key to filter on
operator
typing.Literal[Any]
default:"IN"
required
Comparison operator
value
typing.List[str]
required
Values to match against

GatewayDataRoutingConfig

type
typing.Literal[Any]
default:"gateway-data-routing-config"
required
Type of configuration
destinations
typing.Optional[typing.List[GatewayDataRoutingConfigDestination]]
πŸ”— GatewayDataRoutingConfigDestinationList of conditional routing destinations
default
GatewayDataRoutingConfigDestinationStorage
required

GatewayDataRoutingConfigDestination

name
str
required
Name for the destination
enabled
bool
required
Whether this destination is enabled
description
typing.Optional[str]
Description of the destination
when
typing.List[GatewayDataRoutingConfigDestinationCondition]
required
πŸ”— GatewayDataRoutingConfigDestinationConditionConditions that must be met to use this destination

GatewayDataRoutingConfigDestinationCondition

Union, One Of:

GatewayDataRoutingConfigDestinationControlPlaneManagedStorage

type
typing.Literal[Any]
default:"controlplane-managed"
required
Type of storage configuration
region
typing.Optional[GatewayDataRoutingConfigDestinationControlPlaneManagedStorageRegion]
πŸ”— GatewayDataRoutingConfigDestinationControlPlaneManagedStorageRegionSpecifies the region where control plane–managed storage is located.

GatewayDataRoutingConfigDestinationCreatedByCondition

field
typing.Literal[Any]
default:"created_by"
required
Field to evaluate the condition on
operator
typing.Literal[Any]
default:"IN"
required
Operator to use for comparison
value
typing.List[str]
required
Value to compare against

GatewayDataRoutingConfigDestinationCustomerManagedStorage

type
typing.Literal[Any]
default:"customer-managed"
required
Type of storage configuration
storage_integration_fqn
str
required
Storage Integration FQN to store traces and spans. A storage integration represents a connected blob storage like AWS S3 / Azure Blob Storage / Google Cloud Storage.

GatewayDataRoutingConfigDestinationMetadataCondition

field
typing.Literal[Any]
default:"metadata"
required
Field to evaluate the condition on
key
str
required
Metadata key to match
operator
typing.Literal[Any]
default:"IN"
required
Operator to use for comparison
value
typing.List[str]
required
Value to compare against

GatewayDataRoutingConfigDestinationStorage

storage
GatewayDataRoutingConfigDestinationStorageStorage
required
πŸ”— GatewayDataRoutingConfigDestinationStorageStorageStorage configuration for traces and spans
traces_retention_period_days
typing.Optional[int]
Number of days to retain traces (this does not affect metrics storage)

GatewayDataRoutingConfigDestinationStorageStorage

Union, One Of:

GatewayLoggingConfig

name
str
required
Name of the logging configuration
type
typing.Literal[Any]
default:"gateway-logging-config"
required
rules
typing.List[GatewayLoggingRule]
required
πŸ”— GatewayLoggingRuleList of logging rules

GatewayLoggingRule

id
str
required
Unique identifier for the rule
when
GatewayLoggingWhen
required
tracing_project_fqn
str
required
FQN of the tracing project to send logs to

GatewayLoggingWhen

subjects
typing.Optional[typing.List[str]]
List of subjects that this rule applies to

GatewayMetadataConfig

name
str
required
Name of the metadata configuration
type
typing.Literal[Any]
default:"gateway-metadata-config"
required
rules
typing.List[GatewayMetadataRule]
required
πŸ”— GatewayMetadataRuleList of metadata rules

GatewayMetadataRule

id
str
required
Unique identifier for the rule
when
GatewayMetadataWhen
required
metadata_override
typing.Dict[(str, str)]
required
Metadata key-value pairs to override in the request metadata

GatewayMetadataWhen

subjects
typing.Optional[typing.List[str]]
List of subjects that this rule applies to

GatewayOtelConfig

type
typing.Literal[Any]
default:"gateway-otel-config"
required
otel_traces_exporter_config
typing.Optional[GatewayOtelConfigOtelTracesExporterConfig]
πŸ”— GatewayOtelConfigOtelTracesExporterConfigSet this configuration to export LLM gateway OTEL traces to an external platform. Note that we only export OTEL traces via this configuration.
otel_metrics_exporter_config
typing.Optional[GatewayOtelConfigOtelMetricsExporterConfig]
πŸ”— GatewayOtelConfigOtelMetricsExporterConfigSet this configuration to export LLM gateway OTEL metrics to an external platform. Note that we only export OTEL metrics via this configuration.

GatewayOtelConfigOtelMetricsExporterConfig

Union, One Of:

GatewayOtelConfigOtelTracesExporterConfig

Union, One Of:

GatewayRequestMetadataFilter

gateway_request_metadata_key
typing_extensions.Annotated[(str, Any, Any)]
required
operator
GatewayRequestMetadataFilterOperator
required
value
GatewayRequestMetadataFilterValue
required

GatewayRequestMetadataFilterValue

Union, One Of:

GcpApiKeyAuth

type
typing.Literal[Any]
default:"api-key"
required
api_key
typing_extensions.Annotated[(str, Any, Any)]
required

GcpGcr

type
typing.Literal[Any]
default:"integration/docker-registry/gcp/gcr"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
registry_url
str
required
The URL of the registry.
auth_data
typing.Optional[GcpKeyFileAuth]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

GcpGcs

type
typing.Literal[Any]
default:"integration/blob-storage/gcp/gcs"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
storage_root
str
required
The Google Cloud Storage path in the format β€˜gs://<bucket-name>/<optional-path-prefix>’. Example: β€˜gs://mybucket’ or β€˜gs://mybucket/artifacts/production’.
auth_data
typing.Optional[GcpKeyFileAuth]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

GcpGkeIntegration

type
typing.Literal[Any]
default:"integration/cluster/gcp/gke-standard"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
location
GcpRegion
required
cluster_name
str
required
Name of the cluster given in the cloud account.
auth_data
typing.Optional[GcpKeyFileAuth]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

GcpGsm

type
typing.Literal[Any]
default:"integration/secret-store/gcp/gsm"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
auth_data
typing.Optional[GcpKeyFileAuth]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

GcpIntegrations

Union, One Of:

GcpKeyFileAuth

type
typing.Literal[Any]
default:"key-file"
required
key_file_content
GcpKeyFileAuthKeyFileContent
required
πŸ”— GcpKeyFileAuthKeyFileContentKey File Content - Key file content must be valid JSON

GcpKeyFileAuthKeyFileContent

Union, One Of:

GcpProviderAccount

type
typing.Literal[Any]
default:"provider-account/gcp"
required
name
str
required
The name of the GCP provider account.
project_id
typing.Optional[str]
The project id of the GCP account.
auth_data
typing.Optional[GcpKeyFileAuth]
integrations
typing.List[GcpIntegrations]
required
πŸ”— GcpIntegrationsList of integrations that are associated with the GCP provider account.
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

GcpTpu

type
typing.Literal[Any]
default:"gcp_tpu"
required
name
str
required
Name of the TPU Type. One of - tpu-v4-podslice (TPU v4, ct4p) - tpu-v5-lite-device (TPU v5e, ct5l) - tpu-v5-lite-podslice (TPU v5e, ct5lp) - tpu-v5p-slice (TPU v5p, ct5p)
topology
str
required
Topology of the TPU slices. Currently only single-host topology is supported. Please refer to TPUs on GKE docs Allowed Values: - 2x2x1 for tpu-v4-podslice - One of 1x1, 2x2, 2x4 for tpu-v5-lite-device and tpu-v5-lite-podslice - 2x2x1 for tpu-v5p-slice

GeminiModel

type
typing.Literal[Any]
default:"integration/model/gemini"
required
name
str
required
A descriptive name to identify this model integration in the UI
model_id
str
required
The Google Gemini model identifier (e.g., gemini-2.0-flash, gemini-2.0-flash-lite-preview-02-05, gemini-2.0-flash-lite-preview-02-05). This is the standard model name from Google’s Gemini API documentation.
model_types
typing.List[ModelType]
required
πŸ”— ModelTypeSpecify the type of the Gemini model (e.g., chat, text, etc.)
cost
typing.Optional[ModelCostMetric]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

GenericSecretStoreIntegration

type
typing.Literal[Any]
default:"integration/secret-store/custom/generic"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
base_url
str
required
Base URL of the generic secret server.
auth_data
CustomHeaderAuth
required
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

GetAgentSkillResponse

data
AgentSkill
required
πŸ”— AgentSkillThe agent skill data

GetAgentSkillVersionResponse

data
AgentSkillVersion
required
πŸ”— AgentSkillVersionThe agent skill version data

GetAlertsResponse

data
typing.Dict[(str, typing.List[Alert])]
required
πŸ”— AlertObject containing alert data grouped by alert name

GetApplicationDeploymentResponse

data
Any
required
Deployment

GetApplicationResponse

data
Any
required
Application

GetArtifactResponse

data
Artifact
required
πŸ”— ArtifactThe artifact data

GetArtifactVersionResponse

data
ArtifactVersion
required
πŸ”— ArtifactVersionThe artifact version data

GetAuthenticatedVcsurlResponse

authenticated_url
typing_extensions.Annotated[(str, Any, Any)]
required

GetAutoProvisioningStateResponse

state
typing.Optional[typing.Dict[(str, typing.Any)]]
State of auto-provisioning for the cluster.

GetChartsResponse

step
str
required
Step size
graphs
typing.List[Graph]
required

GetClusterResponse

data
Cluster
required

GetDataDirectoryResponse

data
DataDirectory
required
πŸ”— DataDirectoryThe data directory data

GetDockerRegistryCredentialsResponse

fqn
str
required
Docker registry FQN
registry_url
typing_extensions.Annotated[(str, Any, Any)]
required
username
str
required
Docker registry username
password
str
required
Docker registry password

GetEnvironmentResponse

data
Environment
required

GetEventsResponse

data
typing.List[Event]
required

GetJobRunResponse

data
JobRun
required

GetLogsResponse

data
typing.List[Log]
required
πŸ”— LogList of logs

GetMlRepoResponse

data
MlRepo
required

GetModelResponse

data
Model
required
πŸ”— ModelThe model data

GetModelVersionResponse

data
ModelVersion
required
πŸ”— ModelVersionThe model version data

GetOrCreatePersonalAccessTokenResponse

data
VirtualAccount
required
πŸ”— VirtualAccountPersonal Access Token data
token
str
required
Personal Access Token
created
bool
required
Whether the PAT was created (true) or already existed (false)

GetPromptResponse

data
Prompt
required
πŸ”— PromptThe prompt data

GetPromptVersionResponse

data
PromptVersion
required
πŸ”— PromptVersionThe prompt version data

GetSecretGroupResponse

data
SecretGroup
required

GetSecretResponse

data
Any
required
Secret

GetSignedUrLsRequest

id
str
required
ID of the artifact version to get signed URLs for
paths
typing.List[str]
required
List of relative file paths within the artifact version to get signed URLs for
operation
Operation
required
πŸ”— OperationOperation type for the signed URL (e.g., β€˜READ’ or β€˜WRITE’)

GetSignedUrLsResponse

data
typing.List[SignedUrl]
required
πŸ”— SignedUrlList of signed URLs for the requested file paths

GetSuggestedDeploymentEndpointResponse

host
str
required
Host name
path
typing.Optional[str]
Path
gateway
typing.Optional[ClusterGateway]
πŸ”— ClusterGatewayGateway configuration

GetTeamPermissionsResponse

data
typing.List[SubjectPermission]
required
πŸ”— SubjectPermissionRole bindings for the team

GetTeamResponse

data
Team
required

GetTokenForVirtualAccountResponse

token
str
required
Token for the virtual account

GetUserPermissionsResponse

data
typing.List[SubjectPermission]
required
πŸ”— SubjectPermissionRole bindings for the user (including team-inherited)

GetUserResourcesResponse

data
typing.List[UserResource]
required
πŸ”— UserResourceResources where user is a collaborator

GetUserResponse

data
User
required

GetUserTeamsResponse

data
typing.List[UserTeamInfo]
required
πŸ”— UserTeamInfoTeams where user is a member, with their role

GetVirtualAccountResponse

data
VirtualAccount
required
token
typing.Optional[str]
Virtual Account token (present only when creating a virtual account)

GetWorkspaceResponse

data
Workspace
required

GitHelmRepo

type
typing.Literal[Any]
default:"git-helm-repo"
required
repo_url
str
required
Git repository URL - Needs to be a valid URL.
revision
str
required
Branch/Commit SHA/Tag of the git repo.
path
str
required
Path to the chart.
value_files
typing.Optional[typing.List[str]]
Helm values files for overriding values in the helm chart. The path is relative to the Path directory defined above

GithubIntegration

type
typing.Literal[Any]
default:"integration/vcs/github"
required
name
str
required
account_name
str
required
Account Name
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

GithubProviderAccount

type
typing.Literal[Any]
default:"provider-account/github"
required
name
str
required
integrations
typing.List[GithubIntegration]
required
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

GitlabIntegration

type
typing.Literal[Any]
default:"integration/vcs/gitlab"
required
name
str
required
account_name
str
required
Account Name
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

GitlabProviderAccount

type
typing.Literal[Any]
default:"provider-account/gitlab"
required
name
str
required
integrations
typing.List[GitlabIntegration]
required
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

GitRepositoryExistsResponse

exists
bool
required
The flag if repository exists or not
id
typing.Optional[str]
The integration id of the repository

GitSource

type
typing.Literal[Any]
default:"git"
required
repo_url
str
required
The repository URL.
ref
str
required
The commit SHA.
branch_name
typing.Optional[str]
Selecting branch will select latest commit SHA of the branch.

GlobalSettings

type
typing.Literal[Any]
default:"gateway-global-settings"
required
retry_settings
typing.Optional[RetryConfig]
logging_settings
typing.Optional[LoggingMode]
semantic_cache_settings
typing.Optional[SemanticCacheSettings]

GluonFramework

type
typing.Literal[Any]
default:"gluon"
required

GoogleGeminiProviderAccount

type
typing.Literal[Any]
default:"provider-account/google-gemini"
required
name
str
required
The name of the Google Gemini provider account
auth_data
GcpApiKeyAuth
required
integrations
typing.List[GeminiModel]
required
πŸ”— GeminiModelList of integrations that are associated with the Google Gemini provider account
collaborators
typing.Optional[typing.List[Collaborator]]
πŸ”— CollaboratorList of users who have access to this provider account
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

GoogleModelArmorApiKeyAuth

type
typing.Literal[Any]
default:"api-key"
required
api_key
str
required
Google Cloud API key with Model Armor access

GoogleModelArmorGuardrailConfig

name
str
required
The name of the Guardrail Config.
description
typing.Optional[str]
Optional description for this Guardrail Config.
type
typing.Literal[Any]
default:"integration/guardrail-config/google-model-armor"
required
auth_data
GoogleModelArmorGuardrailConfigAuthData
required
πŸ”— GoogleModelArmorGuardrailConfigAuthDataAuthentication credentials for Google Cloud Model Armor
operation
GoogleModelArmorGuardrailConfigOperation
required
πŸ”— GoogleModelArmorGuardrailConfigOperationThe operation type to use for the Guardrail. Validate guardrails are used to validate requests and mutate can validate as well as mutate requests.
priority
typing.Optional[int]
default:"1"
Execution order for mutate guardrails. Lower values run first. Only applicable when operation is mutate.
enforcing_strategy
EnforcingStrategy
required
config
GoogleModelArmorGuardrailConfigConfig
required

GoogleModelArmorGuardrailConfigAuthData

Union, One Of:

GoogleModelArmorGuardrailConfigConfig

project_id
str
required
The Google Cloud project ID where Model Armor is enabled
location
GcpRegion
required
template_id
str
required
The Model Armor template name that defines which filters and confidence thresholds to apply (e.g. my-template)

GoogleModelArmorKeyFileAuth

type
typing.Literal[Any]
default:"key-file"
required
key_file_content
GoogleModelArmorKeyFileAuthKeyFileContent
required
πŸ”— GoogleModelArmorKeyFileAuthKeyFileContentThe JSON content of your Google Cloud service account key file with Model Armor permissions

GoogleModelArmorKeyFileAuthKeyFileContent

Union, One Of:

GoogleVertexProviderAccount

type
typing.Literal[Any]
default:"provider-account/google-vertex"
required
name
str
required
The name of the Google Vertex provider account
project_id
str
required
The Google Cloud project ID where Vertex AI is enabled
region
GcpRegion
required
auth_data
typing.Optional[VertexKeyFileAuth]
integrations
typing.List[VertexModel]
required
πŸ”— VertexModelList of integrations that are associated with the Google Vertex provider account
collaborators
typing.Optional[typing.List[Collaborator]]
πŸ”— CollaboratorList of users who have access to this provider account
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

Graph

name
str
required
Name
description
str
required
Description
chart
str
required
Chart name
chart_type
typing_extensions.Annotated[(GraphChartType, Any, Any)]
required
params
str
required
Chart params

GraySwanCygnalApiKeyAuth

type
typing.Literal[Any]
default:"api-key"
required
api_key
str
required
GraySwan API key for Cygnal access

GraySwanCygnalGuardrailConfig

name
str
required
The name of the Guardrail Config.
description
typing.Optional[str]
Optional description for this Guardrail Config.
type
typing.Literal[Any]
default:"integration/guardrail-config/grayswan-cygnal"
required
auth_data
GraySwanCygnalApiKeyAuth
required
operation
typing.Literal[Any]
default:"validate"
required
The operation type for this guardrail. GraySwan Cygnal guardrails can only be used for validation.
enforcing_strategy
EnforcingStrategy
required
config
GraySwanCygnalGuardrailConfigConfig
required

GraySwanCygnalGuardrailConfigConfig

base_url
typing.Optional[str]
Optional override for the Cygnal monitor endpoint. Defaults to https://api.grayswan.ai/cygnal/monitor if not provided.
policy_ids
typing.Optional[typing.List[str]]
Custom policy IDs to use for monitoring. Rules from all policies are merged in order, with earlier policies taking precedence. If not provided, the default Basic Content Safety policy is applied, refer to Docs
rules
typing.Optional[typing.Dict[(str, str)]]
Custom rule definitions for monitoring. Each key is a rule name and its value is the rule description, refer to Docs
reasoning_mode
GraySwanCygnalGuardrailConfigConfigReasoningMode
required
πŸ”— GraySwanCygnalGuardrailConfigConfigReasoningModeControls whether Cygnal uses internal reasoning steps before determining if content violates policy. β€œoff” is fastest, β€œhybrid” adds moderate reasoning, β€œthinking” performs guided reasoning for highest quality.

GroqKeyAuth

type
typing.Literal[Any]
default:"api-key"
required
api_key
str
required
The API key for Groq authentication

GroqModel

type
typing.Literal[Any]
default:"integration/model/groq"
required
name
str
required
A descriptive name to identify this model integration in the UI
model_id
str
required
The Groq model identifier (e.g., llama-3.1-8b-instant, openai/gpt-oss-20b). This is the standard model id from Groq’s model catalog.
model_types
typing.List[ModelType]
required
πŸ”— ModelTypeSpecify the type of the Groq model
cost
typing.Optional[ModelCostMetric]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

GroqProviderAccount

type
typing.Literal[Any]
default:"provider-account/groq"
required
name
str
required
The name of the Groq provider account
auth_data
GroqKeyAuth
required
integrations
typing.List[GroqIntegrations]
required
List of integrations that are associated with the Groq provider account
collaborators
typing.Optional[typing.List[Collaborator]]
πŸ”— CollaboratorList of users who have access to this provider account
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

GuardrailConfigGroup

type
typing.Literal[Any]
default:"provider-account/guardrail-config-group"
required
name
str
required
The name of the Guardrail Config Group.
collaborators
typing.Optional[typing.List[Collaborator]]
πŸ”— CollaboratorList of users who have access to this Guardrail Config Group.
integrations
typing.List[GuardrailConfigIntegrations]
required
πŸ”— GuardrailConfigIntegrationsList of Guardrail Configs, which are part of this Guardrail Config Group.
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

GuardrailConfigIntegrations

Union, One Of:

Guardrails

input_guardrails
typing.Optional[typing.List[str]]
List of guardrail names to apply to user input messages before processing.
output_guardrails
typing.Optional[typing.List[str]]
List of guardrail names to apply to AI response messages before returning to user.

GuardrailsConfig

type
typing.Literal[Any]
default:"gateway-guardrails-config"
required
rules
typing.List[GuardrailsRule]
required
πŸ”— GuardrailsRuleList of guardrail rules

GuardrailsRule

id
str
required
Unique identifier for the rule
when
GuardrailsWhen
required
llm_input_guardrails
typing.List[str]
required
Guardrail selectors of the guardrails to apply to the input (format: groupName/guardrailName)
llm_output_guardrails
typing.List[str]
required
Guardrail selectors of the guardrails to apply to the output (format: groupName/guardrailName)
mcp_tool_pre_invoke_guardrails
typing.List[str]
required
Guardrail selectors of the guardrails to apply to the MCP tool pre invoke (format: groupName/guardrailName)
mcp_tool_post_invoke_guardrails
typing.List[str]
required
Guardrail selectors of the guardrails to apply to the MCP tool post invoke (format: groupName/guardrailName)

GuardrailsWhen

target
typing.Optional[TargetConditionGroup]
subjects
typing.Optional[SubjectConditionGroup]
metadata
typing.Optional[typing.Dict[(str, str)]]

H2OFramework

type
typing.Literal[Any]
default:"h2o"
required

HashicorpAppRoleAuth

type
typing.Literal[Any]
default:"approle"
required
role_id
str
required
AppRole role ID for Vault authentication.
secret_id
str
required
AppRole secret ID for Vault authentication.

HashicorpProviderAccount

type
typing.Literal[Any]
default:"provider-account/hashicorp"
required
name
str
required
The name of the HashiCorp Vault provider account.
integrations
typing.List[HashicorpIntegrations]
required
List of integrations that are associated with the HashiCorp Vault provider account.
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

HashicorpTokenAuth

type
typing.Literal[Any]
default:"token"
required
token
str
required
Vault authentication token that you want to use for authentication.

HashicorpVaultIntegration

type
typing.Literal[Any]
default:"integration/secret-store/hashicorp/vault"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
vault_url
str
required
The URL of the HashiCorp Vault server (e.g., https://vault.example.com:8200).
kv_mount_path
str
required
Mount path of the KV v2 engine vault to use for secrets.
root_path
typing.Optional[str]
auth_data
HashicorpVaultIntegrationAuthData
required
πŸ”— HashicorpVaultIntegrationAuthDataAuthentication data for the Vault integration.
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.
namespace
typing.Optional[str]
Namespace for vault operations, used for multi-tenancy in HashiCorp Vault Enterprise. Optional for open source Vault.

HashicorpVaultIntegrationAuthData

Union, One Of:

HeaderMatch

type
typing.Literal[Any]
default:"header"
required
name
str
required
Header name to match on
exact_match
str
required
Header value to match on

HeaderRoutingConfig

Union, One Of:

HeadersOverride

remove
typing.Optional[typing.List[str]]
List of headers to remove from upstream request
set_
typing_extensions.Annotated[(typing.Optional[typing.Dict[(str, str)]], Any, Any)]

HealthProbe

config
HttpProbe
required
initial_delay_seconds
typing.Optional[int]
Time to wait after container has started before checking the endpoint
period_seconds
typing.Optional[int]
default:"10"
How often to check the endpoint
timeout_seconds
typing.Optional[int]
default:"1"
Time to wait for a response from the endpoint before considering it down
success_threshold
typing.Optional[int]
default:"1"
Number of successful responses from the endpoint before container is considered healthy
failure_threshold
typing.Optional[int]
default:"3"
Number of consecutive failures before the container is considered down

Helm

type
typing.Literal[Any]
default:"helm"
required
name
str
required
Name of the Helm deployment. This will be set as the release name of the chart you are deploying.
labels
typing.Optional[typing.Dict[(str, str)]]
Add labels to base argo app
source
HelmSource
required
πŸ”— HelmSourceSource helm repository
values
typing.Optional[typing.Dict[(str, typing.Any)]]
Values file as block file
kustomize
typing.Optional[Kustomize]
ignore_differences
typing_extensions.Annotated[(typing.Optional[typing.List[typing.Dict[(str, typing.Any)]]], Any, Any)]
workspace_fqn
typing.Optional[str]
Fully qualified name of the workspace

HelmRepo

type
typing.Literal[Any]
default:"helm-repo"
required
repo_url
str
required
Helm repository URL - Needs to be a valid URL.
integration_fqn
typing.Optional[str]
FQN of the helm repo integration. If you can’t find your integration here, add it through the Integrations page
chart
str
required
The helm chart name
version
str
required
Helm chart version

HelmSource

Union, One Of:

HostedA2AAgent

type
typing.Literal[Any]
default:"hosted-a2a-agent"
required
Type of agent source
agent_card_url
str
required
Agent Card URL for the A2A Agent
headers
typing.Optional[typing.Dict[(str, str)]]
Headers to be sent with the request to the hosted A2A agent. Primarily used for authentication.

HttpError

status_code
typing_extensions.Annotated[(int, Any, Any)]
required
message
str
required
Error Message
code
typing.Optional[HttpErrorCode]
details
typing.Optional[typing.List[typing.Dict[(str, typing.Any)]]]
Error details

HttpErrorCode

Union, One Of:

HttpProbe

type
typing.Literal[Any]
default:"http"
required
Request Type
path
str
required
Path to the health check endpoint
port
int
required
Listening port for the health check endpoint
host
typing.Optional[str]
Host name to connect to, defaults to the pod IP
scheme
typing.Optional[str]
default:"HTTP"
Scheme to use for connecting to the host

HttpValidationError

detail
typing.Optional[typing.List[ValidationError]]

HuggingfaceArtifactSource

type
typing.Literal[Any]
default:"huggingface-hub"
required
model_id
str
required
Model ID of the artifact to be downloaded
revision
str
required
Revision of the artifact to be downloaded
ignore_patterns
typing.List[str]
required
List of patterns to ignore while downloading the artifact
download_path_env_variable
str
required
Environment variable which will contain the download path of the artifact

IChange

type
IChangeOperation
required
key
str
required
value
typing.Optional[typing.Dict[(str, typing.Any)]]
old_value
typing_extensions.Annotated[(typing.Optional[typing.Dict[(str, typing.Any)]], Any, Any)]
changes
typing.Optional[typing.List[Any]]

Image

type
typing.Literal[Any]
default:"image"
required
image_uri
str
required
The image URI. Specify the name of the image and the tag. If the image is in Dockerhub, you can skip registry-url (for e.g. tensorflow/tensorflow). You can use an image from a private registry using Advanced fields
docker_registry
typing.Optional[str]
FQN of the container registry. If you can’t find your registry here, add it through the Integrations page
command
typing.Optional[ImageCommand]
πŸ”— ImageCommandOverride the command to run when container starts. When deploying a Job, the command can be templatized by defining params and referencing them in command E.g. python main.py --learning_rate \{\{learning_rate\}\}

ImageCommand

Union, One Of:

ImageContentPart

type
typing.Literal[Any]
default:"image_url"
required
Type of the content part
image_url
ImageContentPartImageUrl
required
πŸ”— ImageContentPartImageUrlImage URL linking to the image

ImageContentPartImageUrl

url
ImageContentPartImageUrlUrl
required
πŸ”— ImageContentPartImageUrlUrlImage URL linking to the image
detail
typing.Optional[str]
Details

ImageContentPartImageUrlUrl

Union, One Of:

InfraProviderAccount

Union, One Of:

IngressControllerConfig

ingress_class_name
str
default:"nginx"
required
Ingress Class Name
tls_enabled
typing.Optional[bool]
Whether TLS is managed by the ingress controller. If enabled, the ingress object will have TLS configuration.

InlineSpecSource

type
typing.Literal[Any]
default:"inline"
required
openapi_spec
InlineSpecSourceOpenapiSpec
required
πŸ”— InlineSpecSourceOpenapiSpecThe OpenAPI specification as a JSON object or a JSON/YAML string.

InlineSpecSourceOpenapiSpec

Union, One Of:

InNotInOperator

condition
InNotInOperatorCondition
required
values
typing.List[str]
required

InputOutputBasedCostMetricValue

input
NonNegativeFloat
required
output
NonNegativeFloat
required
cache_read
typing.Optional[NonNegativeFloat]
cache_write
typing.Optional[NonNegativeFloat]
input_tiers
typing.Optional[typing.List[PrivatePricingTier]]
πŸ”— PrivatePricingTierOptional volume-based pricing tiers for input tokens. Tokens up to the first tier use base rate above.
output_tiers
typing.Optional[typing.List[PrivatePricingTier]]
πŸ”— PrivatePricingTierOptional volume-based pricing tiers for output tokens. Tokens up to the first tier use base rate above.
cache_read_tiers
typing.Optional[typing.List[PrivatePricingTier]]
πŸ”— PrivatePricingTierOptional volume-based pricing tiers for cache read tokens. Tokens up to the first tier use base rate above.
cache_write_tiers
typing.Optional[typing.List[PrivatePricingTier]]
πŸ”— PrivatePricingTierOptional volume-based pricing tiers for cache write tokens. Tokens up to the first tier use base rate above.

Intercept

type
typing.Literal[Any]
default:"intercept"
required
name
str
required
Name of the service this intercept is for
rules
typing.List[InterceptRulesItem]
required

InterceptRulesItem

port
int
required
Port of service to be intercepted
match
typing.Optional[HeaderMatch]
action
InterceptRulesItemAction
required
πŸ”— InterceptRulesItemActionAction to take on succesful match

InterceptRulesItemAction

Union, One Of:

InternalArtifactVersion

id
str
required
Unique identifier for the artifact version
fqn
str
required
Fully qualified name of the artifact version in the format β€˜{artifact_type}:{tenant_name}/{ml_repo_name}/{artifact_name}:{version}’
created_by_subject
Subject
required
πŸ”— SubjectSubject (user, team, or service account) that created this artifact version
created_at
typing.Optional[dt.datetime]
Timestamp when the artifact version was created
updated_at
typing.Optional[dt.datetime]
Timestamp when the artifact version was last updated
manifest
ArtifactManifest
required
πŸ”— ArtifactManifestManifest containing metadata for a generic artifact version
ml_repo_id
str
required
ID of the ML Repo that this artifact version belongs to
tags
typing.Optional[typing.List[str]]
List of tags associated with this artifact version for filtering and organization
version_alias
typing.Optional[str]
Optional human-readable version alias (e.g. v1.0.0)
usage_code_snippet
typing.Optional[str]
Code snippet demonstrating how to use this artifact version
artifact_id
str
required
ID of the parent artifact that this version belongs to
artifact_fqn
str
required
Fully qualified name of the parent artifact (internal use only)
artifact_size
typing.Optional[int]
Total size of the artifact version in bytes (internal use only)

InternalListArtifactVersionsResponse

data
typing.List[InternalListArtifactVersionsResponseDataItem]
required
πŸ”— InternalListArtifactVersionsResponseDataItemList of artifact versions and model versions with internal metadata
pagination
Pagination
required
πŸ”— PaginationPagination information including total count, offset, and limit

InternalListArtifactVersionsResponseDataItem

Union, One Of:

InternalModelVersion

id
str
required
Unique identifier for the artifact version
fqn
str
required
Fully qualified name of the artifact version in the format β€˜{artifact_type}:{tenant_name}/{ml_repo_name}/{artifact_name}:{version}’
created_by_subject
Subject
required
πŸ”— SubjectSubject (user, team, or service account) that created this artifact version
created_at
typing.Optional[dt.datetime]
Timestamp when the artifact version was created
updated_at
typing.Optional[dt.datetime]
Timestamp when the artifact version was last updated
manifest
ModelManifest
required
πŸ”— ModelManifestManifest containing metadata specific to the model version
ml_repo_id
str
required
ID of the ML Repo that this artifact version belongs to
tags
typing.Optional[typing.List[str]]
List of tags associated with this artifact version for filtering and organization
version_alias
typing.Optional[str]
Optional human-readable version alias (e.g. v1.0.0)
usage_code_snippet
typing.Optional[str]
Code snippet demonstrating how to use this artifact version
model_id
str
required
ID of the parent model that this version belongs to
metrics
typing.Optional[typing.List[Metric]]
πŸ”— MetricList of metrics associated with this model version
deployable
typing.Optional[bool]
Whether this model version is ready for deployment
artifact_fqn
str
required
Fully qualified name of the parent model (internal use only)
artifact_size
typing.Optional[int]
Total size of the model version in bytes (internal use only)

InviteUserResponse

IsClusterConnectedResponse

is_connected
typing_extensions.Annotated[(bool, Any, Any)]
required

JfrogArtifactsRegistry

type
typing.Literal[Any]
default:"integration/docker-registry/jfrog"
required
name
str
required
The name of the integration that will be displayed in the TrueFoundry UI.
registry_url
str
required
The URL of the registry.
auth_data
typing.Optional[JfrogBasicAuth]
authorized_subjects
typing.Optional[typing.List[str]]
List of subjects that are authorized to access this integration. List of user fqn in format <user_type>:<username>.

JfrogBasicAuth

type
typing.Literal[Any]
default:"basic-auth"
required
username
str
required
The username for the basic authentication.
password
str
required
The password for the basic authentication.

JfrogProviderAccount

type
typing.Literal[Any]
default:"provider-account/jfrog"
required
name
str
required
The name of the provider account.
account_name
typing.Optional[str]
The name of the JFrog account.
auth_data
typing.Optional[JfrogBasicAuth]
integrations
typing.List[JFrogIntegrations]
required
List of integrations that are associated with the provider account.
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

Job

type
typing.Literal[Any]
default:"job"
required
name
str
required
Name of the job
image
JobImage
required
πŸ”— JobImageSpecify whether you want to deploy a Docker image or build and deploy from source code
trigger
JobTrigger
required
πŸ”— JobTriggerSpecify the trigger
trigger_on_deploy
typing.Optional[bool]
Trigger the job after deploy immediately
params
typing.Optional[typing.List[Param]]
πŸ”— ParamConfigure params and pass it to create different job runs
env
typing.Optional[typing.Dict[(str, typing.Optional[str])]]
Configure environment variables to be injected in the service either as plain text or secrets. Docs
resources
typing.Optional[Resources]
alerts
typing.Optional[typing.List[JobAlert]]
πŸ”— JobAlertConfigure alerts to be sent when the job starts/fails/completes
retries
typing.Optional[int]
Specify the maximum number of attempts to retry a job before it is marked as failed.
timeout
typing.Optional[int]
Job timeout in seconds.
concurrency_limit
typing.Optional[int]
Number of runs that can run concurrently
service_account
typing.Optional[str]
mounts
typing.Optional[typing.List[JobMountsItem]]
πŸ”— JobMountsItemConfigure data to be mounted to job pod(s) as a string, secret or volume. Docs
labels
typing.Optional[typing.Dict[(str, str)]]
Labels
kustomize
typing.Optional[Kustomize]
workspace_fqn
typing.Optional[str]
Fully qualified name of the workspace

JobAlert

notification_channel
typing.Optional[str]
Specify the notification channel to send alerts to
to_emails
typing.Optional[typing.List[str]]
List of recipients’ email addresses if the notification channel is Email.
notification_target
typing.Optional[NotificationTarget]
on_start
typing.Optional[bool]
Send an alert when the job starts
on_completion
typing.Optional[bool]
on_failure
typing.Optional[bool]
Send an alert when the job fails

JobImage

Union, One Of:

JobMountsItem

Union, One Of:

JobRun

id
str
required
JobRun ID
name
str
required
JobRun Name
application_name
typing_extensions.Annotated[(str, Any, Any)]
required
deployment_version
typing_extensions.Annotated[(str, Any, Any)]
required
created_at
typing_extensions.Annotated[(float, Any, Any)]
required
end_time
typing_extensions.Annotated[(typing.Optional[float], Any, Any)]
duration
typing.Optional[int]
Duration of JobRun
command
str
required
Command
total_retries
typing_extensions.Annotated[(int, Any, Any)]
required
error
typing.Optional[str]
Error
status
JobRunStatus
required
πŸ”— JobRunStatusStatus of JobRun
triggered_by
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
triggered_by_subject
typing_extensions.Annotated[(typing.Optional[Subject], Any, Any)]
exit_code
typing_extensions.Annotated[(typing.Optional[int], Any, Any)]
spark_ui
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
application_id
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
deployment_id
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]
tenant_name
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]

JobTrigger

Union, One Of:

JobTriggerInput

command
typing.Optional[JobTriggerInputCommand]
params
typing.Optional[typing.Dict[(str, typing.Any)]]
Parameters used to populate template command

JobTriggerInputCommand

Union, One Of:

JsonObjectResponseFormat

type
typing.Literal[Any]
default:"json_object"
required

JsonSchema

name
str
required
Name of the schema
schema_
typing_extensions.Annotated[(typing.Dict[(str, typing.Any)], Any, Any)]
required

JsonSchemaResponseFormat

type
typing.Literal[Any]
default:"json_schema"
required
json_schema
JsonSchema
required

Jwt

id
str
required
subject_type
typing_extensions.Annotated[(str, Any, Any)]
required
subject_id
typing_extensions.Annotated[(str, Any, Any)]
required
metadata
typing.Optional[typing.Dict[(str, typing.Any)]]
expiry
dt.datetime
required
created_at
typing_extensions.Annotated[(dt.datetime, Any, Any)]
required
updated_at
typing_extensions.Annotated[(dt.datetime, Any, Any)]
required

JwtAuthConfig

type
typing.Literal[Any]
default:"jwt_auth"
required
integration_fqn
str
required
FQN of the JWT Auth integration. If you can’t find your integration here, add it through the Integrations page
enable_login
typing.Optional[bool]
Enable login for the service
claims
typing.Optional[typing.List[JwtAuthConfigClaimsItem]]
πŸ”— JwtAuthConfigClaimsItemList of key-value pairs of claims to verify in the JWT token
bypass_auth_paths
typing.Optional[typing.List[str]]
List of paths that will bypass auth. needs to start with a forward slash(/) and should not contain wildcards(*)

JwtAuthConfigClaimsItem

key
str
required
values
typing.List[str]
required

KafkaInputConfig

type
typing.Literal[Any]
default:"kafka"
required
bootstrap_servers
str
required
β€˜Kafka Bootstrap servers - Comma separated list of Kafka brokers β€œhostname:port” to connect to for bootstrap’
topic_name
str
required
Kafka topic to subscribe to
consumer_group
str
required
The name of the consumer group to join for dynamic partition assignment
tls
bool
required
TLS configuration for SASL authentication
wait_time_seconds
typing.Optional[int]
default:"10"
Wait timeout for long polling.
auth
typing.Optional[KafkaSaslAuth]

KafkaMetricConfig

type
typing.Literal[Any]
default:"kafka"
required
lag_threshold
int
required
Upper limit of the number of backlog messages the auto-scaler will try to maintain per replica. If you set this number to 10 and have 30 messages in the stream and one replica, the auto-scaler will scale the number of replicas to 3.

KafkaOutputConfig

type
typing.Literal[Any]
default:"kafka"
required
bootstrap_servers
str
required
β€˜Kafka Bootstrap servers - Comma separated list of Kafka brokers β€œhostname:port” to connect to for bootstrap’
topic_name
str
required
Kafka topic to publish to
tls
bool
required
TLS configuration for SASL authentication
auth
typing.Optional[KafkaSaslAuth]

KafkaSaslAuth

username
str
required
Username for SASL authentication
password
str
required
Password for SASL authentication

KerasFramework

type
typing.Literal[Any]
default:"keras"
required

Kustomize

patch
typing.Optional[typing.Dict[(str, typing.Any)]]
Content of kustomization.yaml to perform kustomize operation. Please do not include the resources section. It is filled in automatically
additions
typing.Optional[typing.List[typing.Dict[(str, typing.Any)]]]
Additional kubernetes manifests to be included in the application

LatencyBasedLoadBalanceTarget

target
str
required
Target model or provider FQN
retry_config
typing.Optional[RetryConfig]
fallback_status_codes
typing.Optional[typing.List[str]]
Status Codes for which the request will fallback to other targets. If the status code is not present in fallback_status_codes, it fails immediately.
fallback_candidate
typing.Optional[bool]
Whether this target is a fallback candidate. If set to false, this model will not be considered as a fallback option for targets of this load-balance-rule
override_params
typing.Optional[typing.Dict[(str, typing.Any)]]
Optional parameters to override in the request
headers_override
typing.Optional[HeadersOverride]
metadata_match
typing.Optional[typing.Dict[(str, str)]]
Optional metadata key-value pairs that must match incoming request metadata headers for this target to be considered for routing.

LatencyBasedLoadBalancing

type
typing.Literal[Any]
default:"latency-based-routing"
required
load_balance_targets
typing.List[LatencyBasedLoadBalanceTarget]
required
πŸ”— LatencyBasedLoadBalanceTargetList of targets for latency-based load balancing

LatencyBasedLoadBalancingRule

id
str
required
Unique identifier for the rule
when
LoadBalancingWhen
required

LegacyAgentManifest

type
typing.Literal[Any]
default:"agent"
required
Type of the manifest
name
str
required
The name of the Agent
description
str
required
The description of the Agent
source
AgentSource
required
collaborators
typing.List[Collaborator]
required
πŸ”— CollaboratorList of users who have access to this Agent
sample_inputs
typing.Optional[typing.List[SampleAgentInput]]
πŸ”— SampleAgentInputSample inputs for your agent. These inputs are shown as an example in the β€œAgent Chat” page. (Click on Try Now in the agent listing page)
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

LightGbmFramework

type
typing.Literal[Any]
default:"lightgbm"
required

ListAgentSkillsResponse

data
typing.List[AgentSkill]
required
πŸ”— AgentSkillList of agent skills matching the query
pagination
Pagination
required
πŸ”— PaginationPagination information

ListAgentSkillVersionsResponse

data
typing.List[AgentSkillVersion]
required
πŸ”— AgentSkillVersionList of agent skill versions
pagination
Pagination
required
πŸ”— PaginationPagination information

ListApplicationDeploymentsResponse

data
typing.List[Any]
required
Array of Deployments
pagination
Pagination
required
πŸ”— PaginationPagination information

ListApplicationsResponse

data
typing.List[Any]
required
Array of Applications
pagination
Pagination
required
πŸ”— PaginationPagination information

ListArtifactsResponse

data
typing.List[Artifact]
required
πŸ”— ArtifactList of artifacts matching the query
pagination
Pagination
required
πŸ”— PaginationPagination information including total count, offset, and limit

ListArtifactVersionsResponse

data
typing.List[ArtifactVersion]
required
πŸ”— ArtifactVersionList of artifact versions matching the query
pagination
Pagination
required
πŸ”— PaginationPagination information including total count, offset, and limit

ListClusterAddonsResponse

data
typing.List[AddonComponent]
required
πŸ”— AddonComponentArray of Cluster Addons
pagination
Pagination
required
πŸ”— PaginationPagination information

ListClustersResponse

data
typing.List[Cluster]
required
πŸ”— ClusterArray of cluster
pagination
Pagination
required
πŸ”— PaginationPagination information

ListDataDirectoriesResponse

data
typing.List[DataDirectory]
required
πŸ”— DataDirectoryList of data directories matching the query
pagination
Pagination
required
πŸ”— PaginationPagination information including total count, offset, and limit

ListEnvironmentsResponse

data
typing.List[Environment]
required
πŸ”— EnvironmentArray of Environments
pagination
Pagination
required
πŸ”— PaginationPagination information

ListFilesRequest

id
str
required
ID of the artifact version to list files from
path
typing.Optional[str]
Relative path within the artifact version to list files from (defaults to root)
limit
typing.Optional[int]
Maximum number of files/directories to return
page_token
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]

ListFilesResponse

data
typing.List[FileInfo]
required
πŸ”— FileInfoList of files and directories in the artifact version
pagination
TokenPagination
required
πŸ”— TokenPaginationPagination information including page tokens for navigation

ListJobRunResponse

data
typing.List[JobRun]
required
πŸ”— JobRunJobRun History
pagination
Pagination
required
πŸ”— PaginationPagination Information

ListMlReposResponse

data
typing.List[MlRepo]
required
πŸ”— MlRepoList of ML Repos matching the query
pagination
Pagination
required
πŸ”— PaginationPagination information including total count, offset, and limit

ListModelsResponse

data
typing.List[Model]
required
πŸ”— ModelList of models matching the query
pagination
Pagination
required
πŸ”— PaginationPagination information including total count, offset, and limit

ListModelVersionsResponse

data
typing.List[ModelVersion]
required
πŸ”— ModelVersionList of model versions matching the query
pagination
Pagination
required
πŸ”— PaginationPagination information including total count, offset, and limit

ListPersonalAccessTokenResponse

data
typing.List[VirtualAccount]
required
πŸ”— VirtualAccountArray of Personal Access Tokens
pagination
Pagination
required
πŸ”— PaginationPagination Information

ListPromptsResponse

data
typing.List[Prompt]
required
πŸ”— PromptList of prompts matching the query
pagination
Pagination
required
πŸ”— PaginationPagination information including total count, offset, and limit

ListPromptVersionsResponse

data
typing.List[PromptVersion]
required
πŸ”— PromptVersionList of prompt versions matching the query
pagination
Pagination
required
πŸ”— PaginationPagination information including total count, offset, and limit

ListSecretGroupResponse

data
typing.List[SecretGroup]
required
πŸ”— SecretGroupArray of Secret Groups
pagination
Pagination
required
πŸ”— PaginationPagination information

ListSecretsResponse

data
typing.List[Any]
required
Array of Secrets
pagination
Pagination
required
πŸ”— PaginationPagination Information

ListTeamsResponse

data
typing.List[Team]
required
pagination
Pagination
required
πŸ”— PaginationPagination Information

ListUsersResponse

data
typing.List[User]
required
πŸ”— UserArray of Users
pagination
Pagination
required
πŸ”— PaginationPagination information

ListVirtualAccountResponse

data
typing.List[VirtualAccount]
required
πŸ”— VirtualAccountArray of Virtual Accounts
pagination
Pagination
required
πŸ”— PaginationPagination Information

ListWorkspacesResponse

data
typing.List[Workspace]
required
πŸ”— WorkspaceArray of Workspace
pagination
Pagination
required
πŸ”— PaginationPagination information

LoadBalanceTarget

target
str
required
Target model or provider FQN
weight
int
required
Relative weight for routing decisions (higher values mean more traffic)
retry_config
typing.Optional[RetryConfig]
fallback_status_codes
typing.Optional[typing.List[str]]
Status Codes for which the request will fallback to other targets. If the status code is not present in fallback_status_codes, it fails immediately.
fallback_candidate
typing.Optional[bool]
Whether this target is a fallback candidate. If set to false, this model will not be considered as a fallback option for targets of this load-balance-rule
override_params
typing.Optional[typing.Dict[(str, typing.Any)]]
Optional parameters to override in the request
headers_override
typing.Optional[HeadersOverride]
metadata_match
typing.Optional[typing.Dict[(str, str)]]
Optional metadata key-value pairs that must match incoming request metadata headers for this target to be considered for routing.

LoadBalancingConfig

type
typing.Literal[Any]
default:"gateway-load-balancing-config"
required
rules
typing.List[LoadBalancingRule]
required
πŸ”— LoadBalancingRuleList of load balancing rules

LoadBalancingRule

Union, One Of:

LoadBalancingWhen

subjects
typing.Optional[typing.List[str]]
List of subjects that this rule applies to
models
typing.Optional[typing.List[str]]
List of models that this rule applies to
metadata
typing.Optional[typing.Dict[(str, str)]]
Metadata key-value pairs that this rule applies to

LocalArtifactSource

type
typing.Literal[Any]
default:"local"
required
paths
typing.List[ArtifactPath]
required
πŸ”— ArtifactPathArray of ArtifactPath objects representing the source and destination paths

LocalModelSource

type
typing.Literal[Any]
default:"local"
required
file_or_folder
str
required
Path to the model file or folder

LocalSource

type
typing.Literal[Any]
default:"local"
required
project_root_path
str
default:"./"
required
Local project root path.
local_build
bool
required
run docker build locally

Log

job_name
typing.Optional[str]
Job Name
log
str
required
Log Content
stream
str
required
Log Stream
time
str
required
Log Time
container_name
typing_extensions.Annotated[(typing.Optional[str], Any, Any)]

LoggingConfig

enabled
bool
required
Whether logging is enabled for the chat prompt
tracing_project_fqn
typing.Optional[str]
The FQN of the tracing project where the logs will be stored

LoggingMode

Union, One Of:

LoggingModeAlways

type
typing.Literal[Any]
default:"always"
required

LoggingModeHeaderControlled

type
typing.Literal[Any]
default:"header_controlled"
required
log_body_by_default
bool
required
Sets the default body logging behaviour when no header is present. Enabling it will log requests by default and clients can opt out. Disabling it will NOT log by default and clients can opt in to log requests.

LoggingModeNever

type
typing.Literal[Any]
default:"never"
required

LogsFilterQuery

match_string
typing_extensions.Annotated[(str, Any, Any)]
required
type
LogsFilterQueryType
required
πŸ”— LogsFilterQueryTypequery filter type, regex or substring
operator
LogsSearchOperatorType
required
πŸ”— LogsSearchOperatorTypeComparison operator for filter. equal or not_equal

LogsResponse

logs
typing.List[Log]
required
πŸ”— LogList of logs

Manual

type
typing.Literal[Any]
default:"manual"
required

McpServerAuth

Union, One Of:

McpServerEnvAuth

type
typing.Literal[Any]
default:"env"
required
env
typing.Dict[(str, str)]
required
Map each env variable to its value. For shared, enter the actual value. For individual, use a placeholder that will be filled in by each user (e.g. API_KEY {{API_KEY}}).
auth_level
typing.Optional[McpServerEnvAuthAuthLevel]
πŸ”— McpServerEnvAuthAuthLevelLevel at which this authentication will be applied. Values: global (default), per_user

McpServerHeaderAuth

type
typing.Literal[Any]
default:"header"
required
headers
typing.Dict[(str, str)]
required
Map each header name to its value. For shared, enter the actual value. For individual, use a placeholder that will be filled in by each user (e.g. Bearer {{API_KEY}}).
auth_level
McpServerHeaderAuthAuthLevel
required
πŸ”— McpServerHeaderAuthAuthLevelLevel at which this authentication will be applied. Values: global (default), per_user

McpServerHeaderOverrideAuth

type
typing.Literal[Any]
default:"header"
required
headers
typing.Dict[(str, str)]
required

McpServerIntegration

type
typing.Literal[Any]
default:"integration/mcp-server/remote"
required
name
str
required
The name of the MCP Server.
description
str
required
Provide a brief description of the purpose of this MCP Server.
url
str
required
The endpoint URL for the MCP Server.
transport
McpServerIntegrationTransport
required
πŸ”— McpServerIntegrationTransportThe transport protocol to use for communication with the MCP Server.
auth_data
typing.Optional[McpServerAuth]
authorized_subjects
typing.Optional[typing.List[str]]
List of teams/users who can use this MCP server.

McpServerIntegrations

Union, One Of:

McpServerManifest

Union, One Of:

McpServerOAuth2

type
typing.Literal[Any]
default:"oauth2"
required
OAuth2 authentication
grant_type
McpServerOAuth2GrantType
required
πŸ”— McpServerOAuth2GrantTypeThe OAuth2 grant type to use for authentication.
authorization_url
typing.Optional[str]
URL for the authorization request
token_url
str
required
The endpoint to exchange auth code for tokens.
client_id
typing.Optional[str]
client ID for OAuth2 or the TrueFoundry secret FQN containing the client ID.
client_secret
typing.Optional[str]
Client secret or the TrueFoundry secret FQN containing the client secret for OAuth2.
registration_url
typing.Optional[str]
URL for dynamic client registration (RFC 7591). If provided, client credentials will be obtained automatically using the Dynamic Client Registration (DCR) process.
code_challenge_methods_supported
typing.Optional[typing.List[typing.Literal[Any]]]
List of supported PKCE code challenge methods (S256 only)
jwt_source
McpServerOAuth2JwtSource
required
πŸ”— McpServerOAuth2JwtSourceSource of the JWT token to be used for verification.
scopes
typing.Optional[typing.List[str]]
List of scopes to request from the OAuth2 provider.

McpServerPassthrough

type
typing.Literal[Any]
default:"passthrough"
required

McpServerProviderAccount

type
typing.Literal[Any]
default:"provider-account/mcp-server-group"
required
name
str
required
The name of the MCP Server Group.
collaborators
typing.List[Collaborator]
required
πŸ”— CollaboratorList of teams/users who can manage this MCP Server Group. These subjects can add new MCP server integrations, can edit existing ones and can also use the MCP server.
integrations
typing.List[McpServerIntegrations]
required
πŸ”— McpServerIntegrationsList of MCP Servers, which are part of this MCP Server Group.
owned_by
typing_extensions.Annotated[(typing.Optional[OwnedBy], Any, Any)]

McpServerSource

name
str
required
Name of the MCP server
enabled_tools
typing.Optional[typing.List[str]]
List of tools to enable from this source server.
auth_data
typing.Optional[McpServerHeaderOverrideAuth]

McpServerToolDetails

mcp_server_integration_id
str
required
The integration ID of the MCP server
tool_name
str
required
The name of the tool in the MCP server

McpServerWithFqn

type
typing.Literal[Any]
default:"mcp-server-fqn"
required
The FQN of the MCP server