steve/llama-swap
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
445 Commits 3 Branches 175 Tags
fd3c28ffc50b15e1031517b88040d656c34b6a79
Commit Graph

2 Commits

Author SHA1 Message Date
Benson Wong eb5bfff0b0 proxy: unify filtering for local models and peers 
This unifies the filtering capabilities for models and peers

- stripParams: removes params in the request
- setParams: sets params in the request

fixes #453
 2026-01-15 18:59:43 -08:00
Benson Wong 22e098ac8b Add Peer Model Support (#438) 
This PR allows a single llama-swap to be the central proxy for models served by other inference servers. The peer servers can be another llama-swap or any API that supports the /v1/* inference endpoint.

Updates: #433, #299
Closes: #296
 2025-12-27 20:18:06 -08:00