Benson Wong aaca9d889b add Makefile

2024-10-04 11:07:00 -07:00

bin/simple-responder

first commit

2024-10-03 20:20:01 -07:00

models

first commit

2024-10-03 20:20:01 -07:00

proxy

improve error handling

2024-10-04 10:55:02 -07:00

.gitignore

first commit

2024-10-03 20:20:01 -07:00

config.example.yaml

improve error handling

2024-10-04 10:55:02 -07:00

go.mod

move config to its own package

2024-10-03 21:08:11 -07:00

go.sum

first commit

2024-10-03 20:20:01 -07:00

LICENSE.md

.

2024-10-04 09:31:08 -07:00

llama-proxy.go

add Makefile

2024-10-04 11:07:00 -07:00

Makefile

add Makefile

2024-10-04 11:07:00 -07:00

S

Description

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

golangllamallamacpplocalllamalocalllmopenaiopenai-apivllm

78 MiB

Languages

Go 68.8%

Svelte 19.6%

TypeScript 5.8%

Shell 3.9%

Dockerfile 1.1%

Other 0.8%