Files
llama-swap/docker/unified
Benson Wong 625b296720 docker/unified: add uv via pip install (#681)
Install uv after the cpp tool binaries are copied and before the
llama-swap binary, enabling `uv run` usage for Python-based inference
backends like vLLM.

- add python3-pip to runtime apt installs
- add `pip install uv --break-system-packages` after cpp installs

fixes #628

Co-authored-by: Claude <noreply@anthropic.com>
2026-04-20 20:55:51 -07:00
..

Unified Docker Container

These scripts create a custom llama-swap container that contains:

  • llama-server for LLMs, rerank and embedding model support
  • sd-server (stable-diffusion.cpp) for image generation
  • whisper.cpp for ASR