Benson Wong
916d13f5bd
Add Docker build scripts for a unified cuda docker container with llama-server, stable-diffusion.cpp, whisper.cpp.
9 lines
234 B
Markdown
9 lines
234 B
Markdown
# Unified Docker Container
|
|
|
|
These scripts create a custom llama-swap container that contains:
|
|
|
|
- llama-server for LLMs, rerank and embedding model support
|
|
- sd-server (stable-diffusion.cpp) for image generation
|
|
- whisper.cpp for ASR
|
|
|