Benson Wong cc77139ff8 proxy,proxy/config: add global TTL feature (#554) ...

Add a new configuration parameter globalTTL that all models will
inherit. The default value is 0 which matches the currently
functionality to never automatically unload a model.

The model.ttl's default has changed to -1, which means use the global
TTL value. Any model.ttl >=0 is now value with 0 meaning never unload.
This allows a model to override a globalTTL > 0 and be configured to
never unload.

Fixes #459
Closes #512

2026-03-01 21:02:12 -08:00

..

config

proxy,proxy/config: add global TTL feature (#554)

2026-03-01 21:02:12 -08:00

.gitignore

New UI (#157, #164)

2025-06-16 16:45:19 -07:00

discardWriter.go

Add barebones but working implementation of model preload (#209, #235)

2025-08-14 10:27:28 -07:00

events.go

proxy, ui: add pending requests count to the main dashboard (#516)

2026-02-16 09:41:15 -08:00

helpers_test.go

proxy,ui-svelte: replace old UI with svelte+playground

2026-01-31 22:49:13 -08:00

logMonitor_test.go

proxy: Improve logging performance and allow separate log streaming (#421)

2025-12-18 21:49:25 -08:00

logMonitor.go

proxy: Improve logging performance and allow separate log streaming (#421)

2025-12-18 21:49:25 -08:00

metrics_monitor_test.go

proxy: support timings for /infill from llama-server (#510)

2026-02-07 17:16:27 -08:00

metrics_monitor.go

proxy: support timings for /infill from llama-server (#510)

2026-02-07 17:16:27 -08:00

peerproxy_test.go

Add Peer Model Support (#438)

2025-12-27 20:18:06 -08:00

peerproxy.go

proxy: unify filtering for local models and peers

2026-01-15 18:59:43 -08:00

process_test.go

proxy,proxy/config: add global TTL feature (#554)

2026-03-01 21:02:12 -08:00

process_unix.go

feat: add platform-specific process attributes support (#411)

2025-11-24 21:39:56 -08:00

process_windows.go

feat: add platform-specific process attributes support (#411)

2025-11-24 21:39:56 -08:00

process.go

proxy: Improve logging performance and allow separate log streaming (#421)

2025-12-18 21:49:25 -08:00

processgroup_test.go

proxy: skip very slow tests in -short test mode (#446)

2025-12-31 14:08:56 -08:00

processgroup.go

proxy: Improve logging performance and allow separate log streaming (#421)

2025-12-18 21:49:25 -08:00

proxymanager_api.go

proxy: implement setParamsByID filter (#535)

2026-02-19 22:21:10 -08:00

proxymanager_loghandlers.go

proxy: fix path bug in /logs/stream/{model_id} (#431)

2025-12-21 21:47:14 -08:00

proxymanager_test.go

proxy,proxy/config: add global TTL feature (#554)

2026-03-01 21:02:12 -08:00

proxymanager.go

proxy: implement setParamsByID filter (#535)

2026-02-19 22:21:10 -08:00

sanitize_cors_test.go

Sanitize CORS headers (#85)

2025-04-01 08:43:53 -07:00

sanitize_cors.go

Sanitize CORS headers (#85)

2025-04-01 08:43:53 -07:00

ui_compress_test.go

proxy,ui-svelte: replace old UI with svelte+playground

2026-01-31 22:49:13 -08:00

ui_compress.go

proxy,ui-svelte: replace old UI with svelte+playground

2026-01-31 22:49:13 -08:00

ui_embed.go

New UI (#157, #164)

2025-06-16 16:45:19 -07:00