> ## Documentation Index
> Fetch the complete documentation index at: https://www.truefoundry.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Deploy Models on TrueFoundry

> Add your own deployed models to TrueFoundry's AI Gateway for unified access and management

### Adding TrueFoundry Hosted Models to the Gateway

Follow these steps to add a model you have deployed on TrueFoundry to the AI Gateway.

<Steps>
  <Step title="Deploy a Model">
    First, deploy your open-source or private model as a service. You can refer to our documentation on [Deploying LLMs From Model Catalogue](/docs/deploying-an-llm-model-from-the-model-catalogue) for detailed instructions.

    <Frame caption="Deploy a model from the model catalogue">
      <img src="https://mintcdn.com/truefoundry/FeKcq2n1MMm83Par/images/Screenshot2025-07-22at7.02.21PM-min.png?fit=max&auto=format&n=FeKcq2n1MMm83Par&q=85&s=7e43dcdff0f58ac551064d8b5197fcf6" alt="Model catalogue interface showing available LLM models for deployment" width="3600" height="2002" data-path="images/Screenshot2025-07-22at7.02.21PM-min.png" />
    </Frame>
  </Step>

  <Step title="Add Model to AI Gateway">
    Once your model is successfully deployed, click the "Add to Gateway" button on the deployment page to begin the integration process.

    <Frame caption="Add model to AI Gateway">
      <img src="https://mintcdn.com/truefoundry/FeKcq2n1MMm83Par/images/Screenshot2025-07-22at6.55.58PM-min.png?fit=max&auto=format&n=FeKcq2n1MMm83Par&q=85&s=e25dc097570279895be9e0017445b94f" alt="Deployment page with Add to Gateway button highlighted" width="3600" height="2006" data-path="images/Screenshot2025-07-22at6.55.58PM-min.png" />
    </Frame>
  </Step>

  <Step title="Configure Model Details">
    Give your model a unique **Model Name** and choose an existing **Provider Account** to add it to, or create a new one. This helps in grouping and managing your self-hosted models.

    <Frame caption="Configure model name and provider account">
      <img src="https://mintcdn.com/truefoundry/FeKcq2n1MMm83Par/images/Screenshot2025-07-22at6.56.39PM-min.png?fit=max&auto=format&n=FeKcq2n1MMm83Par&q=85&s=ad507519dec06a4a67e9bca583e3267c" alt="Model configuration form with fields for model name and provider account selection" width="2170" height="2012" data-path="images/Screenshot2025-07-22at6.56.39PM-min.png" />
    </Frame>
  </Step>

  <Step title="Add Collaborators">
    Add collaborators to your account, this will give access to the account to other users/teams. Learn more about access control [**here**](https://docs.truefoundry.com/gateway/gateway-access-control).

    <frame name="frame" attributes={{  }} />

    <Frame caption="Add collaborators for the model">
      <img src="https://mintcdn.com/truefoundry/FeKcq2n1MMm83Par/images/Screenshot2025-07-22at6.57.17PM-min.png?fit=max&auto=format&n=FeKcq2n1MMm83Par&q=85&s=dd3254ef683a3c61c746f4a14cc968de" alt="Collaborator selection interface showing users and teams that can be added" width="1880" height="2012" data-path="images/Screenshot2025-07-22at6.57.17PM-min.png" />
    </Frame>

    After saving, your model will be live on the AI Gateway and ready for use.

    <Frame caption="Model live on AI Gateway">
      <img src="https://mintcdn.com/truefoundry/FeKcq2n1MMm83Par/images/Screenshot2025-07-22at6.57.42PM-min.png?fit=max&auto=format&n=FeKcq2n1MMm83Par&q=85&s=e94f1b7f2bddf2a42b2b5040b1852c41" alt="AI Gateway dashboard showing the newly added model with active status" width="3600" height="2002" data-path="images/Screenshot2025-07-22at6.57.42PM-min.png" />
    </Frame>
  </Step>
</Steps>

### Cost Management for Self-Hosted Models

GPUs are costly, and running GPU-powered deployments can quickly drive up expenses. TrueFoundry offers built-in solutions to help reduce deployment costs.

You can choose from two cost-saving options:

1. **Auto-shutdown based on inactivity:** Set up automatic shutdown of deployment pods if no new requests are received within a specified time frame.
2. **Manual pause/resume:** You can manually pause deployments that you anticipate won't be used for a certain period.

In both scenarios, the model status will be displayed as "paused" on the Gateway.

<Frame caption="Paused model on AI Gateway">
  <img src="https://mintcdn.com/truefoundry/-g83eZw0cKb4T5XU/images/docs/Screenshot2025-07-22at7.19.59PM-min.png?fit=max&auto=format&n=-g83eZw0cKb4T5XU&q=85&s=005c31c7c871d72ca986adafdb91708f" alt="AI Gateway dashboard showing a model with paused status" width="3600" height="1998" data-path="images/docs/Screenshot2025-07-22at7.19.59PM-min.png" />
</Frame>
