Self-Hosted LLM Infrastructure

10 stacks for anyone who wants the plumbing between your apps and language models. Each one is a vanilla compose.yaml that runs locally with docker compose up, with a measured RAM footprint and a one-step deploy to Miget from $7/month flat.

#the stacks

Cognee

The memory engine for AI agents - knowledge graph + vector memory in one self-contained container.

1 service 2 GiB RAM from $13/mo

Dify

experimental

The LLM app platform - visual builder, RAG, agents, observability - the catalogue’s heaviest stack, shipped honestly.

11 services 6.6 GiB RAM from $49/mo

Flowise

Visual builder for LLM apps and agents - 100+ integrations, embeddable chat widgets, no prediction caps.

2 services 2 GiB RAM from $13/mo

Langfuse

Open-source LLM observability - tracing, evals, prompt management - the full v3 stack with no per-unit metering.

6 services 7 GiB RAM from $49/mo

Letta

experimental

The MemGPT agent server - agents live server-side with self-editing persistent memory.

3 services 2.5 GiB RAM from $25/mo

LiteLLM

One OpenAI-compatible gateway for every LLM provider - virtual keys, budgets, spend tracking - with no percentage fee.

2 services 3 GiB RAM from $25/mo

Ollama

experimental

Run open LLMs behind a simple API - llama, mistral, qwen. The local-model server (GPU recommended).

1 service 4 GiB RAM from $25/mo

Open WebUI

The self-hosted AI chat workspace - any model behind one UI, RAG over your documents, no per-seat pricing.

1 service 2 GiB RAM from $13/mo

Phoenix

LLM tracing, evals, and a prompt playground in one container - the lightweight start to LLM observability.

1 service 2 GiB RAM from $13/mo

TEI Embeddings

A self-hosted embeddings API on CPU - bge-small in 512 MB, OpenAI-compatible, zero per-token bills.

1 service 1 GiB RAM from $7/mo

#what each one needs

RAM and disk are what the compose file allocates, not guesses, and the plan is the smallest one that holds it. Databases and caches come managed and included on Miget rather than billed per instance.

StackServicesRAMDiskFits plan
Cognee 1 2 GiB 10 GB $13/mo
Dify 11 6.6 GiB 27 GB $49/mo
Flowise 2 2 GiB 10 GB $13/mo
Langfuse 6 7 GiB 35 GB $49/mo
Letta 3 2.5 GiB 10 GB $25/mo
LiteLLM 2 3 GiB 5 GB $25/mo
Ollama 1 4 GiB 50 GB $25/mo
Open WebUI 1 2 GiB 5 GB $13/mo
Phoenix 1 2 GiB 10 GB $13/mo
TEI Embeddings 1 1 GiB 2 GB $7/mo

Cost against the managed equivalents, per stack: Dify , Flowise , Langfuse , Letta , LiteLLM , Ollama , Open WebUI , Phoenix .

Browse the rest of the catalogue

140 stacks in total, from databases and queues to AI infrastructure - all MIT licensed, all runnable locally, all deployable in one step.