steve
34119e5a00
Five OpenAI-compatible providers join the library as first-class constructors (llm.DeepSeek, llm.Moonshot, llm.XAI, llm.Groq, llm.Ollama). Their wire-level implementation is shared via a new v2/openaicompat package which is the extracted guts of the old v2/openai provider; each provider supplies its own Rules value to declare per-model constraints (e.g., DeepSeek Reasoner rejects tools and temperature, Moonshot/xAI accept images only on *-vision* models, Groq rejects audio input). v2/openai itself becomes a thin wrapper that sets RestrictTemperature for o-series and gpt-5 models. A new provider registry (v2/registry.go) exposes llm.Providers() and drives the TUI's provider picker so adding a provider in future is a single-file change. The TUI at cmd/llm was migrated from v1 to v2 and moved to v2/cmd/llm. With nothing else depending on v1, the v1 code at the repo root (all .go files, schema/, internal/, provider/, root go.mod/go.sum) is deleted. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
26 lines
937 B
Go
26 lines
937 B
Go
// Package ollama implements the go-llm v2 provider interface for Ollama
|
|
// (https://ollama.com), a local model runner that exposes an OpenAI Chat
|
|
// Completions-compatible endpoint. No API key is required; capability depends
|
|
// on whichever model the user has pulled locally, so Rules are intentionally
|
|
// empty — we trust the local user.
|
|
package ollama
|
|
|
|
import (
|
|
"gitea.stevedudenhoeffer.com/steve/go-llm/v2/openaicompat"
|
|
)
|
|
|
|
// DefaultBaseURL points at a local Ollama instance with default port.
|
|
const DefaultBaseURL = "http://localhost:11434/v1"
|
|
|
|
// Provider is a type alias over openaicompat.Provider.
|
|
type Provider = openaicompat.Provider
|
|
|
|
// New creates a new Ollama provider. An empty baseURL uses DefaultBaseURL.
|
|
// Ollama ignores the API key; callers may pass "".
|
|
func New(apiKey, baseURL string) *Provider {
|
|
if baseURL == "" {
|
|
baseURL = DefaultBaseURL
|
|
}
|
|
return openaicompat.New(apiKey, baseURL, openaicompat.Rules{})
|
|
}
|