Steve Dudenhoeffer 4b401fcc0d feat(v2): populate CacheHints on provider.Request when caching enabled ...

buildProviderRequest now computes cache-breakpoint positions automatically
when the WithPromptCaching() option is set. It places up to 3 hints:
tools, system, and the index of the last non-system message. Providers
that don't support caching (OpenAI, Google) ignore the field.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-04-09 19:22:00 +00:00

.gitea/workflows

Add Gitea CI workflow for build, test, vet, and lint

2026-02-07 20:01:01 -05:00

cmd/llm

Implement interactive CLI for LLM providers with chat, tools, and image support

2026-01-24 15:53:36 -05:00

docs

Add sandbox package for isolated Linux containers via Proxmox LXC

2026-02-08 00:47:45 -05:00

internal/imageutil

Refactor: modularize and streamline LLM providers and utility functions

2026-01-24 15:40:38 -05:00

provider

Refactor: modularize and streamline LLM providers and utility functions

2026-01-24 15:40:38 -05:00

schema

Add MCP integration with MCPServer for tool-based interactions

2026-01-24 16:25:28 -05:00

v2

feat(v2): populate CacheHints on provider.Request when caching enabled

2026-04-09 19:22:00 +00:00

.gitignore

Add MCP integration with MCPServer for tool-based interactions

2026-01-24 16:25:28 -05:00

anthropic.go

Refactor: modularize and streamline LLM providers and utility functions

2026-01-24 15:40:38 -05:00

CLAUDE.md

Add MCP integration with MCPServer for tool-based interactions

2026-01-24 16:25:28 -05:00

context.go

Refactor: modularize and streamline LLM providers and utility functions

2026-01-24 15:40:38 -05:00

error.go

Refactor: modularize and streamline LLM providers and utility functions

2026-01-24 15:40:38 -05:00

function.go

Refactor: modularize and streamline LLM providers and utility functions

2026-01-24 15:40:38 -05:00

functions.go

Refactor: modularize and streamline LLM providers and utility functions

2026-01-24 15:40:38 -05:00

go.mod

Add MCP integration with MCPServer for tool-based interactions

2026-01-24 16:25:28 -05:00

go.sum

Fix corrupted checksum for charmbracelet/bubbles in go.sum

2026-02-07 21:39:32 -05:00

google.go

Refactor: modularize and streamline LLM providers and utility functions

2026-01-24 15:40:38 -05:00

llm.go

Refactor: modularize and streamline LLM providers and utility functions

2026-01-24 15:40:38 -05:00

mcp.go

Add MCP integration with MCPServer for tool-based interactions

2026-01-24 16:25:28 -05:00

message.go

Refactor: modularize and streamline LLM providers and utility functions

2026-01-24 15:40:38 -05:00

openai_transcriber.go

Update openaiTranscriber to handle audio file metadata in transcription parameters

2026-01-25 02:38:45 -05:00

openai.go

Refactor: modularize and streamline LLM providers and utility functions

2026-01-24 15:40:38 -05:00

parse.go

Refactor: modularize and streamline LLM providers and utility functions

2026-01-24 15:40:38 -05:00

request.go

Refactor: modularize and streamline LLM providers and utility functions

2026-01-24 15:40:38 -05:00

response.go

Refactor: modularize and streamline LLM providers and utility functions

2026-01-24 15:40:38 -05:00

toolbox.go

Add MCP integration with MCPServer for tool-based interactions

2026-01-24 16:25:28 -05:00

transcriber.go

Add OpenAI-based transcriber implementation

2026-01-25 01:46:29 -05:00

Description

Abstraction layer interface for various similar LLM services

536 KiB

Languages

Go 100%