Self-Hosted LLM Infrastructure
10 stacks for anyone who wants the plumbing between your apps and language models. Each one is a vanilla
compose.yaml that runs locally with docker compose up, with a measured RAM footprint
and a one-step deploy to Miget from $7/month flat.
#the stacks
Cognee
The memory engine for AI agents - knowledge graph + vector memory in one self-contained container.
Dify
experimentalThe LLM app platform - visual builder, RAG, agents, observability - the catalogue’s heaviest stack, shipped honestly.
Flowise
Visual builder for LLM apps and agents - 100+ integrations, embeddable chat widgets, no prediction caps.
Langfuse
Open-source LLM observability - tracing, evals, prompt management - the full v3 stack with no per-unit metering.
Letta
experimentalThe MemGPT agent server - agents live server-side with self-editing persistent memory.
LiteLLM
One OpenAI-compatible gateway for every LLM provider - virtual keys, budgets, spend tracking - with no percentage fee.
Ollama
experimentalRun open LLMs behind a simple API - llama, mistral, qwen. The local-model server (GPU recommended).
Open WebUI
The self-hosted AI chat workspace - any model behind one UI, RAG over your documents, no per-seat pricing.
Phoenix
LLM tracing, evals, and a prompt playground in one container - the lightweight start to LLM observability.
TEI Embeddings
A self-hosted embeddings API on CPU - bge-small in 512 MB, OpenAI-compatible, zero per-token bills.
#what each one needs
RAM and disk are what the compose file allocates, not guesses, and the plan is the smallest one that holds it. Databases and caches come managed and included on Miget rather than billed per instance.
| Stack | Services | RAM | Disk | Fits plan |
|---|---|---|---|---|
| Cognee | 1 | 2 GiB | 10 GB | $13/mo |
| Dify | 11 | 6.6 GiB | 27 GB | $49/mo |
| Flowise | 2 | 2 GiB | 10 GB | $13/mo |
| Langfuse | 6 | 7 GiB | 35 GB | $49/mo |
| Letta | 3 | 2.5 GiB | 10 GB | $25/mo |
| LiteLLM | 2 | 3 GiB | 5 GB | $25/mo |
| Ollama | 1 | 4 GiB | 50 GB | $25/mo |
| Open WebUI | 1 | 2 GiB | 5 GB | $13/mo |
| Phoenix | 1 | 2 GiB | 10 GB | $13/mo |
| TEI Embeddings | 1 | 1 GiB | 2 GB | $7/mo |
Cost against the managed equivalents, per stack: Dify , Flowise , Langfuse , Letta , LiteLLM , Ollama , Open WebUI , Phoenix .
Browse the rest of the catalogue
140 stacks in total, from databases and queues to AI infrastructure - all MIT licensed, all runnable locally, all deployable in one step.