> ## Documentation Index
> Fetch the complete documentation index at: https://docs.levelrail.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Self-host LiteLLM Proxy with Docker

> One OpenAI-format gateway in front of 100+ model providers, with keys, budgets, and spend tracking.

One OpenAI-format gateway in front of 100+ model providers, with keys, budgets, and spend tracking.

This page describes the Levelrail template for LiteLLM Proxy (AI). It deploys the services below as one Docker Compose app on your own server. Project site: [https://docs.litellm.ai/docs/simple\_proxy](https://docs.litellm.ai/docs/simple_proxy).

Recommended memory: about 1024 MiB.

## Services, ports and volumes

| Service | Image | Container ports | Volumes |
| - | - | - | - |
| `db` | `postgres:16-alpine` | none | `litellm_db_data -> /var/lib/postgresql/data` |
| `litellm` | `ghcr.io/berriai/litellm:main-stable` | 4000 | none |

## Environment variables

| Service | Variable | Value |
| - | - | - |
| `db` | `POSTGRES_DB` | Preset in the template |
| `db` | `POSTGRES_PASSWORD` | Generated at deploy |
| `db` | `POSTGRES_USER` | Preset in the template |
| `litellm` | `DATABASE_URL` | Generated at deploy |
| `litellm` | `LITELLM_MASTER_KEY` | Generated at deploy |
| `litellm` | `STORE_MODEL_IN_DB` | Preset in the template |

Passwords and keys marked as generated are created for you when the app is deployed and stored as secrets. Values are not shown here.

## Deploy LiteLLM Proxy with Levelrail

In the dashboard, open **Apps**, choose **New app**, then **Browse templates**, and select LiteLLM Proxy. Review the Compose body and deploy.

With the CLI:

```bash theme={"dark"}
levelrail-cli templates deploy litellm --name my-litellm
```

See the [service template catalog](/templates-and-registry) for how templates work, and [Getting started](/getting-started) if you have not installed Levelrail yet.

## More AI templates

* [AnythingLLM](/self-host/anythingllm)
* [ComfyUI](/self-host/comfyui)
* [Flowise](/self-host/flowise)
* [Flowise (Postgres + Qdrant)](/self-host/flowise-postgres)
* [Jupyter GPU Notebook](/self-host/jupyter-gpu)

All templates are listed in the [self-host gallery](/self-host).


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.