Deploy LiteLLM on Your VPS
Deploy LiteLLM on your VPS in one click. One OpenAI-compatible gateway over 100+ LLM providers, with virtual keys, spend budgets, and per-request cost tracking.
LiteLLM puts a single OpenAI-compatible endpoint in front of more or less every model provider — OpenAI, Anthropic, Gemini, Bedrock, Azure, Ollama, and 100+ more. Your applications keep talking to one API while you swap models behind it, and you hand out virtual keys per team or per app with their own budgets and rate limits instead of sharing one provider key around.
Vessl deploys LiteLLM with a dedicated PostgreSQL service and runs its migrations on first boot. Sign in to the admin UI at /ui with the master key from the deploy form, add your providers, and start issuing keys — every request gets logged with its cost and latency.
What's included
- LiteLLM + PostgreSQL deployed together; migrations run on first boot
- One OpenAI-compatible API over 100+ providers
- Virtual keys per team or app, with spend budgets and rate limits
- Cost and latency tracked per request in the dashboard
- Fallbacks and load balancing across models and providers
Common use cases
- One gateway so apps stop hard-coding a single LLM provider
- Handing teams their own budgeted API keys instead of a shared secret
- Tracking what your AI features actually cost, per request
Frequently asked questions
Does LiteLLM run models itself?
No — it routes to providers you configure, whether that is a hosted API or your own Ollama instance. Deploy the Ollama template alongside it if you want local models behind the same gateway.
How do I log into the dashboard?
Visit /ui on your domain. The username is admin and the password is the master key generated for you at deploy time — copy it from the deploy form before you launch.
Can I add providers without redeploying?
Yes. Model config is stored in the database, so you add providers and keys from the admin UI and they take effect immediately.
Ready to ship?
Deploy LiteLLM in under a minute.
Connect your VPS, pick this template, fill in any required fields. Vessl handles the container, SSL, and persistent storage.
Start for FreeNo credit card · BYOS · IDR billing