Files

Unified Docker Container

These scripts create a custom llama-swap container that contains:

  • llama-server for LLMs, rerank and embedding model support
  • sd-server (stable-diffusion.cpp) for image generation
  • whisper.cpp for ASR