I’m changing how I use AI (Open WebUI + LiteLLM)

NetworkChuck Technology Careers Career & Money

About this video

The creator shows how he replaced multiple separate AI subscriptions with one self-hosted interface: Open WebUI fronting both local models via Ollama and cloud models accessed by API, with LiteLLM as a gateway to providers Open WebUI cannot connect to directly. He sets up Open WebUI on a Hostinger VPS (he favors the KVM 2 plan, which he describes as about $6 a month with 8 GB of RAM) that preinstalls Ollama and Open WebUI on Ubuntu 24.04, with a default local Llama 3.2 1B model. He then adds an OpenAI API key funded with $5 and explains pay-as-you-go token pricing, quoting examples he shows for OpenAI models: $1.10 per 1 million tokens for o3-mini, $15 for o1, and $75 for input on GPT-4.5, and rough use cases from about 50 cents a month for casual use to $5-$10 for moderate use, with power users paying much more. LiteLLM, installed via Docker, connects 100-plus providers including Anthropic, Gemini, and Grok, and issues virtual keys so he can limit which models each user sees and set budgets, illustrated with a $20 monthly budget. In Open WebUI he creates user groups and a system prompt restricting his kids to school help without doing their work, and notes admins can view users’ chats.

Key takeaways

Use Open WebUI as a single self-hosted front end for both local Ollama models and cloud models accessed via APIs
API access is pay-as-you-go by tokens and can unlock new models earlier than consumer plans, but heavy use of premium models can cost more than a subscription
LiteLLM acts as an OpenAI-compatible proxy/gateway to 100-plus providers, solving Open WebUI’s limited direct connections
LiteLLM virtual keys let an admin control per-person model access, expiry, and monthly budgets
Admin controls in Open WebUI allow groups, model restrictions, and guardrail-style system prompts, such as a school-helper that guides rather than completes homework

Episode details: published March 13, 2025 · 24:28 long. Summary written by Self Growth Videos from the episode itself. Business results and any income figures mentioned are NetworkChuck’s own claims, shared for education — they are not typical or guaranteed.

← Previous: You’re going to get Hacked in 2025 · Next: everyone is putting AI in schools…… →

All NetworkChuck videos · NetworkChuck profile · NetworkChuck on YouTube