Skip to main content
A local LLM runtime with an HTTP API. Pull any model yourself once it’s running. This page describes the Levelrail template for Ollama (AI). It deploys the services below as one Docker Compose app on your own server. Project site: https://github.com/ollama/ollama. Recommended memory: about 1024 MiB.

​
Services, ports and volumes

​
Environment variables

This template sets no environment variables. Passwords and keys marked as generated are created for you when the app is deployed and stored as secrets. Values are not shown here.

​
Deploy Ollama with Levelrail

In the dashboard, open Apps, choose New app, then Browse templates, and select Ollama. Review the Compose body and deploy. With the CLI:
See the service template catalog for how templates work, and Getting started if you have not installed Levelrail yet.

​
More AI templates

All templates are listed in the self-host gallery.
Last modified on October 12, 2026