steve/llama-swap
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Commit Graph

  • 2ae48c713b add debug output for start command v127 Benson Wong 2025-06-18 07:43:23 -07:00
  • 54c519e365 update Makefile to install ui deps Benson Wong 2025-06-17 09:53:51 -07:00
  • 3fce9ee0e9 Update README.md [skip ci] Benson Wong 2025-06-17 09:53:22 -07:00
  • 5899ae7966 Update README.md [skip ci] Benson Wong 2025-06-17 09:52:47 -07:00
  • 591a9cdf4d update release.yml v126 Benson Wong 2025-06-16 16:50:25 -07:00
  • 9a3c656738 New UI (#157, #164) Benson Wong 2025-06-16 16:45:19 -07:00
  • 75015f82ea fix bug caused by macro replacement order (#166) Benson Wong 2025-06-16 15:32:09 -07:00
  • cc33b6c270 restore intel docker builds (#163) Thammachart Chinvarapon 2025-06-17 01:13:49 +07:00
  • 4fa12a429c Refactor all default config values into config.go (#162) Benson Wong 2025-06-15 12:32:00 -07:00
  • 2dc0ca0663 improve llama-swap upstream process recovery and restarts (#155) v125 Benson Wong 2025-06-05 16:24:55 -07:00
  • a84098d3b4 Add missing object type to /v1/models endpoint (#154) v124 Daniel Hofer 2025-06-02 18:25:45 +02:00
  • 4d02ccd26a Update README.md [skip ci] Benson Wong 2025-05-30 09:38:45 -07:00
  • dfd47eeac4 Readme updates [skip ci] Benson Wong 2025-05-30 09:19:08 -07:00
  • 1ac6499c08 Add macros to Configuration schema (#149) v123 Benson Wong 2025-05-29 21:51:25 -07:00
  • 25f3dc25e7 small doc update [skip ci] Benson Wong 2025-05-26 16:03:27 -07:00
  • 8422e4e6a1 move some docs to the wiki [no-ci] Benson Wong 2025-05-26 15:46:08 -07:00
  • 02ee29d881 increase default healthCheckTimeout to 120s v122 Benson Wong 2025-05-26 09:57:53 -07:00
  • b2a891f8f4 Disable building of intel container until it's fixed upstream Benson Wong 2025-05-23 22:54:43 -07:00
  • 8d2b568897 Improve install script (#144) Yuta Hayashibe 2025-05-24 01:39:55 +09:00
  • fb44cf4e08 Fix typos (#143) Yuta Hayashibe 2025-05-24 00:40:15 +09:00
  • 02aee4e86d remove noisy debug print message v121 Benson Wong 2025-05-19 15:36:15 -07:00
  • f45896d395 add guard to avoid unnecessary logic in Process.Shutdown Benson Wong 2025-05-19 15:34:30 -07:00
  • f7e46a359f Add link to unload endpoint in upstream list (#140) choyuansu 2025-05-20 08:31:44 -07:00
  • e7af671d8e remove noisy debug print message v120 Benson Wong 2025-05-19 15:36:15 -07:00
  • 8e62098eef add guard to avoid unnecessary logic in Process.Shutdown Benson Wong 2025-05-19 15:34:30 -07:00
  • c260907415 Add linux install and uninstall shell scripts (#139) choyuansu 2025-05-19 12:03:33 -07:00
  • b83a5fa291 make Failed stated recoverable (#137) v119 Benson Wong 2025-05-16 19:54:44 -07:00
  • 6e2ff28d59 improve cmdStop docs [no ci] Benson Wong 2025-05-16 13:52:04 -07:00
  • a8b81f2799 Add stopCmd for custom stopping instructions (#136) v118 Benson Wong 2025-05-16 13:48:42 -07:00
  • f9ee7156dc update configuration examples for multiline yaml commands #133 Benson Wong 2025-05-16 11:45:39 -07:00
  • 2d00120781 Update proxymanager.go (#135) v117 fakezeta 2025-05-16 15:45:09 +02:00
  • afc9aef058 Fix #133 SanitizeCommand removes comments (#134) v116 Benson Wong 2025-05-15 15:28:50 -07:00
  • d7b390df74 Add GH Action for Testing on Windows (#132) Benson Wong 2025-05-14 21:51:53 -07:00
  • 5025c2f1f3 Add GH windows tests (not working yet) Benson Wong 2025-05-14 19:58:18 -07:00
  • e3a0b013c1 add content length test for #131 Benson Wong 2025-05-14 19:50:01 -07:00
  • f5763a94a0 Fix content length being incorrect when useModelName is used (#131) Fadenfire 2025-05-14 21:37:54 -05:00
  • 8ada72eb57 Update issue templates Benson Wong 2025-05-14 16:36:32 -07:00
  • 2441b383d3 Make checking for process killed status more robust v115 Benson Wong 2025-05-14 16:26:45 -07:00
  • 25f251699c Prevent StateFailed after SIGKILL (#129) v114 Benson Wong 2025-05-14 10:47:35 -07:00
  • 7f37bcc6eb Improve testing around using SIGKILL (#127) Benson Wong 2025-05-13 21:21:52 -07:00
  • 519c3a4d22 Change /unload to not wait for inflight requests (#125) v113 Benson Wong 2025-05-13 11:39:19 -07:00
  • 9dc4bcb46c Add a concurrency limit to Process.ProxyRequest (#123) v112 Benson Wong 2025-05-12 18:12:52 -07:00
  • cb876c143b update example config v111 Benson Wong 2025-05-12 10:20:18 -07:00
  • bc652709a5 Add config hot-reload (#106) Sam 2025-05-12 10:37:00 +10:00
  • 9548931258 ci: re-enabled intel build pipeline (#121) Thammachart Chinvarapon 2025-05-11 14:19:57 +07:00
  • 5c5a5da664 Update README.md Benson Wong 2025-05-06 06:59:15 -07:00
  • aa9ef59aa5 Create .coderabbit.yaml Benson Wong 2025-05-05 19:47:23 -07:00
  • 09e52c0500 Automatic Port Numbers (#105) v110 Benson Wong 2025-05-05 17:07:43 -07:00
  • ca9063ffbe ensure aliases are unique (#116) Benson Wong 2025-05-05 15:34:18 -07:00
  • 21d7973d11 Improve content-length handling (#115) v109 Benson Wong 2025-05-05 10:46:26 -07:00
  • cc450e9c5f fix issue where proxy is still proxying with chunked transfer-encoding (#114) Yi Hong Ang 2025-05-06 01:00:03 +08:00
  • 27465fe053 bug fix with missing early return statements fix #112 Benson Wong 2025-05-04 07:34:24 -07:00
  • 9667989727 Disabling intel container build since it's been broken for weeks. Benson Wong 2025-05-04 21:39:42 -07:00
  • ab5a048584 bug fix with missing early return statements fix #112 v108 Benson Wong 2025-05-04 07:34:24 -07:00
  • d9a1ddea0d Truncate web logs to 100K characters (#111) v107 Benson Wong 2025-05-02 23:43:21 -07:00
  • e7ab024ca0 small locking optimization Benson Wong 2025-05-02 23:18:07 -07:00
  • 448ccae959 Introduce Groups Feature (#107) Benson Wong 2025-05-02 22:35:38 -07:00
  • ec0348e431 Reduce stale time for issues Benson Wong 2025-04-29 21:16:34 -07:00
  • 06eda7f591 tag all process logs with its ID (#103) v106 Benson Wong 2025-04-25 12:58:25 -07:00
  • 5fad24c16f Make checkHealthTimeout Interruptable during startup (#102) v105 Benson Wong 2025-04-24 14:39:33 -07:00
  • 8404244fab Moderate security update for golang/x/net -> v0.38.0 Benson Wong 2025-04-24 09:58:40 -07:00
  • 712cd01081 fix confusing INFO message [no ci] Benson Wong 2025-04-24 09:56:20 -07:00
  • 1f7aa359b1 Update header image Benson Wong 2025-04-23 13:00:43 -07:00
  • b138d6cf25 fix starhistory in README Benson Wong 2025-04-15 20:23:46 -07:00
  • fb7c808082 add timing for Process start, stop, total request time (#91) v104 Benson Wong 2025-04-14 14:34:59 -07:00
  • a7e640b0f7 add aider example Benson Wong 2025-04-07 12:37:14 -07:00
  • 593604dfdc Show proxy and upstream logs in separate columns in logs UI v103 Benson Wong 2025-04-05 10:36:54 -07:00
  • b8f888f864 Logging Improvements (#88) v102 Benson Wong 2025-04-04 21:01:33 -07:00
  • 192b2ae621 Remove no longer needed test v101 Benson Wong 2025-04-04 14:46:01 -07:00
  • b7f8cb5094 Limit Access-Control-Allow-Origin to OPTIONS preflight requests #85 Benson Wong 2025-04-04 14:44:35 -07:00
  • a23da6eb57 Sanitize CORS headers (#85) v100 Benson Wong 2025-04-01 08:43:53 -07:00
  • 4c3aa40564 add graceful process termination on windows (#82) v99 Grigorii Khvatskii 2025-03-25 18:26:33 -04:00
  • 84e2c07a7e Refactor wildcard out of CORS headers (#81) Benson Wong 2025-03-25 15:24:43 -07:00
  • 680af28bcc Allow very permissive CORS headers (#77) v98 Benson Wong 2025-03-20 15:50:21 -07:00
  • d94db42ffe fix bug checking incorrect error Benson Wong 2025-03-20 15:26:39 -07:00
  • 014a2fa9a3 fix bug checking incorrect error v97 Benson Wong 2025-03-20 15:26:39 -07:00
  • 93cd83c55c add override for windows (#76) Benson Wong 2025-03-20 13:23:04 -07:00
  • 5ceaef6144 add override for windows Benson Wong 2025-03-20 13:21:03 -07:00
  • 5565fca3ac add some badges to README Benson Wong 2025-03-19 11:25:06 -07:00
  • d625ab8d92 Refactor process state management (#70) (#73) v96 Benson Wong 2025-03-15 17:14:03 -07:00
  • a3f82c140b tidy up config examples in README Benson Wong 2025-03-15 10:36:45 -07:00
  • 5c97299e7b Add support for sending a custom model name to upstream (#69) (#71) v95 Benson Wong 2025-03-14 21:07:52 -07:00
  • 671c1a5a7b update deps v94 Benson Wong 2025-03-13 14:00:15 -07:00
  • 52c0196e0f clean up feature list in readme Benson Wong 2025-03-13 13:55:20 -07:00
  • 3201a68a04 Add /v1/audio/transcriptions support (#41) Benson Wong 2025-03-13 13:49:39 -07:00
  • 3ac94ad20e Adds an endpoint '/running' (#61) Florin-Gabriel Dumitru 2025-03-13 22:42:59 +02:00
  • 60355bf74a fix some potentially confusing Process.start() comment Benson Wong 2025-03-11 11:00:45 -07:00
  • 9b2ed244e2 Improve Continuous integration and fix concurrency bugs (#66) v93 Benson Wong 2025-03-11 10:39:14 -07:00
  • eeb72297f7 add first version of CI for go Benson Wong 2025-03-11 08:45:56 -07:00
  • eabfe70cc6 add GH action to close inactive issues Benson Wong 2025-03-09 19:51:48 -07:00
  • 29cd98878d better container build logic when upstream containers do not exist Benson Wong 2025-03-09 13:02:06 -07:00
  • b3d331da0d Properly strip profile name slug from models fixes (#62) v92 Benson Wong 2025-03-09 12:41:52 -07:00
  • 62275e078d add examples to restart on config change #59 Benson Wong 2025-03-06 10:50:29 -08:00
  • 88916059e1 add /unload to docs Benson Wong 2025-03-03 10:44:16 -08:00
  • 082d5d0fc5 Add /unload endpoint (#58) to unload all currently running models v91 Benson Wong 2025-03-03 10:33:36 -08:00
  • 53338938bd increase health check to a minimum of 5 seconds Benson Wong 2025-02-18 17:35:52 -08:00
  • af653347ae Update README.md w/ starhistory graph Benson Wong 2025-02-27 16:43:34 -08:00
  • cebf9c4d34 increase health check to a minimum of 5 seconds v90 Benson Wong 2025-02-18 17:35:52 -08:00
  • 1e25b44a06 add workflow_dispatch to release action Benson Wong 2025-02-18 17:27:43 -08:00
  • 0815bb4cc3 Add windows to goreleaser #54 Benson Wong 2025-02-18 17:26:43 -08:00