Skip to main content
Fast open source LLM gateway that routes requests to many providers behind one OpenAI compatible API, with a web UI for keys and routing rules. This page describes the Levelrail template for Bifrost (AI). It deploys the services below as one Docker Compose app on your own server. Project site: https://docs.getbifrost.ai/. Recommended memory: about 256 MiB.

Services, ports and volumes

Environment variables

This template sets no environment variables. Passwords and keys marked as generated are created for you when the app is deployed and stored as secrets. Values are not shown here.

Security and requirements

Level: Standard. What this template needs:
  • No health check, so a deploy is judged by the process starting (bifrost).
  • Stores data in named volumes (bifrost): data.
What Levelrail adds around it:
  • Automatic HTTPS and an ingress shield in front of every domain.
  • Named volumes can be backed up and restored.
  • One-step rollback to the previous revision.
  • Exposure report shows what is reachable from outside.
  • Host firewall rules managed for published ports.

Deploy Bifrost with Levelrail

In the dashboard, open Apps, choose New app, then Browse templates, and select Bifrost. Review the Compose body and deploy. With the CLI:
See the service template catalog for how templates work, and Getting started if you have not installed Levelrail yet.

More AI templates

All templates are listed in the self-host gallery.
Last modified on November 12, 2026