4 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
steveandClaude Fable 5	cecb89880e	feat(server): dispatch /v1/videos and /v1/videos/sync by model ... Registers the OpenAI/vLLM-Omni video generation endpoints as model-dispatched routes so llama-swap can swap in video upstreams (e.g. vllm serve <model> --omni, or a ComfyUI shim exposing the same shape). Extraction is content-type driven, so both multipart form and JSON bodies resolve the model field. Co-Authored-By: Claude Fable 5 <[email protected]> Claude-Session: https://claude.ai/code/session_01AXQxVhXBw8PwFAtsVrXSmj	2026-07-12 09:25:55 -04:00
steveandClaude Opus 4.8	0292c90ca1	ci: copy ui-svelte/.npmrc before npm ci in fork-cuda build ... npm ci ran without .npmrc (legacy-peer-deps=true), failing on the tailwind/vite peer dependency conflict. Copy .npmrc with the manifest. Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]>	2026-06-28 12:56:21 -04:00
steveandClaude Opus 4.8	617c7dc6b9	ci: add Gitea workflow to build fork CUDA image ... Add a Gitea Actions workflow and multi-stage Containerfile that build this fork's llama-swap (serial scheduler + embedded Svelte UI) from source and layer it on a pinned llama.cpp CUDA server base, then push to the Gitea container registry as v230-cuda-b9821. - docker/fork-cuda.Containerfile: node UI -> go build -> cuda runtime, runs as root to match the upstream non-suffixed image - .gitea/workflows/build-cuda-image.yml: workflow_dispatch (version + llama.cpp build inputs) and push-on-build-files; logs in with REGISTRY_USER/REGISTRY_PASSWORD Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]>	2026-06-28 12:48:48 -04:00
steveandClaude Opus 4.8	542b79dacf	internal/router/scheduler: add serial scheduler, default on this fork ... Add a strict one-model-at-a-time scheduler. Requests run in exact arrival order; at most one runs at a time; switching to a different model evicts every other running model first so a single model occupies memory at a time. Unlike fifo it never reorders or batches same-model requests, and it ignores group/matrix co-residency entirely, making the single-model guarantee a property of the scheduler rather than the config. - new Serial scheduler implementing the Scheduler interface - register "serial" in scheduler.New; default routing.scheduler.use to "serial" at config load (fifo still selectable for upstream behavior) - update config schema, example config, and config defaults tests Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]>	2026-06-28 12:17:32 -04:00