steve/llama-swap

Files

T

History

Benson Wong d87f0ce2c5 docker/unified: publish rootless image variant (#630 )

2026-04-07 03:05:53 -07:00

..

build-image.sh

docker/unified: publish rootless image variant (#630 )

2026-04-07 03:05:53 -07:00

config.example.yaml

.github,docker/unified: improve caching and fix bugs (#598 )

2026-03-23 22:24:40 +09:00

Dockerfile

docker/unified: publish rootless image variant (#630 )

2026-04-07 03:05:53 -07:00

install-ik-llama.sh

docker: make CMAKE_CUDA_ARCHITECTURES configurable via build arg (#625 )

2026-04-04 08:49:59 +08:00

install-llama-swap.sh

.github,docker/unified: improve caching and fix bugs (#598 )

2026-03-23 22:24:40 +09:00

install-llama.sh

docker: make CMAKE_CUDA_ARCHITECTURES configurable via build arg (#625 )

2026-04-04 08:49:59 +08:00

install-sd.sh

docker: make CMAKE_CUDA_ARCHITECTURES configurable via build arg (#625 )

2026-04-04 08:49:59 +08:00

install-whisper.sh

docker: make CMAKE_CUDA_ARCHITECTURES configurable via build arg (#625 )

2026-04-04 08:49:59 +08:00

README.md

.github/workflows,docker/unified: add cuda based unified container (#597 )

2026-03-22 21:11:54 +09:00

README.md

Unified Docker Container

These scripts create a custom llama-swap container that contains:

llama-server for LLMs, rerank and embedding model support
sd-server (stable-diffusion.cpp) for image generation
whisper.cpp for ASR