steve/llama-swap

Files

T

History

Benson Wong c176fa70f1 docker/unified: add spirv-headers to fix vulkan build (#669 )

2026-04-18 12:18:10 -07:00

..

build-image.sh

docker/unified: derive rootless image from root container (#644 )

2026-04-10 22:59:54 -07:00

config.example.yaml

.github,docker/unified: improve caching and fix bugs (#598 )

2026-03-23 22:24:40 +09:00

Dockerfile

docker/unified: add spirv-headers to fix vulkan build (#669 )

2026-04-18 12:18:10 -07:00

install-ik-llama.sh

docker: make CMAKE_CUDA_ARCHITECTURES configurable via build arg (#625 )

2026-04-04 08:49:59 +08:00

install-llama-swap.sh

.github,docker/unified: improve caching and fix bugs (#598 )

2026-03-23 22:24:40 +09:00

install-llama.sh

docker: make CMAKE_CUDA_ARCHITECTURES configurable via build arg (#625 )

2026-04-04 08:49:59 +08:00

install-sd.sh

docker: make CMAKE_CUDA_ARCHITECTURES configurable via build arg (#625 )

2026-04-04 08:49:59 +08:00

install-whisper.sh

docker: make CMAKE_CUDA_ARCHITECTURES configurable via build arg (#625 )

2026-04-04 08:49:59 +08:00

README.md

.github/workflows,docker/unified: add cuda based unified container (#597 )

2026-03-22 21:11:54 +09:00

README.md

Unified Docker Container

These scripts create a custom llama-swap container that contains:

llama-server for LLMs, rerank and embedding model support
sd-server (stable-diffusion.cpp) for image generation
whisper.cpp for ASR