Steve Dudenhoeffer 4b401fcc0d feat(v2): populate CacheHints on provider.Request when caching enabled ...

buildProviderRequest now computes cache-breakpoint positions automatically
when the WithPromptCaching() option is set. It places up to 3 hints:
tools, system, and the index of the last non-system message. Providers
that don't support caching (OpenAI, Google) ignore the field.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-04-09 19:22:00 +00:00

..

agent

feat: comprehensive token usage tracking for V2

2026-03-02 04:33:18 +00:00

anthropic

feat: comprehensive token usage tracking for V2

2026-03-02 04:33:18 +00:00

google

feat: comprehensive token usage tracking for V2

2026-03-02 04:33:18 +00:00

internal

Add go-llm v2: redesigned API for simpler LLM abstraction

2026-02-07 20:00:08 -05:00

openai

feat: comprehensive token usage tracking for V2

2026-03-02 04:33:18 +00:00

provider

feat(v2/provider): add CacheHints to Request for prompt caching

2026-04-09 19:14:44 +00:00

sandbox

Add comprehensive test suite for sandbox package (78 tests)

2026-02-08 01:10:59 -05:00

tools

Add go-llm v2: redesigned API for simpler LLM abstraction

2026-02-07 20:00:08 -05:00

chat_test.go

feat: comprehensive token usage tracking for V2

2026-03-02 04:33:18 +00:00

chat.go

feat: comprehensive token usage tracking for V2

2026-03-02 04:33:18 +00:00

CLAUDE.md

Add sandbox package for isolated Linux containers via Proxmox LXC

2026-02-08 00:47:45 -05:00

constructors.go

Add agent sub-package for composable LLM agents

2026-02-07 23:17:19 -05:00

errors.go

Add structured output support with Generate[T] and GenerateWith[T]

2026-02-07 22:36:33 -05:00

generate_test.go

feat: comprehensive token usage tracking for V2

2026-03-02 04:33:18 +00:00

generate.go

feat: comprehensive token usage tracking for V2

2026-03-02 04:33:18 +00:00

go.mod

Add sandbox package for isolated Linux containers via Proxmox LXC

2026-02-08 00:47:45 -05:00

go.sum

Add sandbox package for isolated Linux containers via Proxmox LXC

2026-02-08 00:47:45 -05:00

llm.go

feat(v2): populate CacheHints on provider.Request when caching enabled

2026-04-09 19:22:00 +00:00

mcp.go

Add go-llm v2: redesigned API for simpler LLM abstraction

2026-02-07 20:00:08 -05:00

message_test.go

Add comprehensive test suite for v2 module with mock provider

2026-02-07 22:00:49 -05:00

message.go

feat: add audio input support to v2 providers

2026-02-08 21:00:56 -05:00

middleware_test.go

feat: comprehensive token usage tracking for V2

2026-03-02 04:33:18 +00:00

middleware.go

feat: comprehensive token usage tracking for V2

2026-03-02 04:33:18 +00:00

mock_provider_test.go

Add comprehensive test suite for v2 module with mock provider

2026-02-07 22:00:49 -05:00

model_test.go

Add agent sub-package for composable LLM agents

2026-02-07 23:17:19 -05:00

pricing_test.go

feat: comprehensive token usage tracking for V2

2026-03-02 04:33:18 +00:00

pricing.go

feat: comprehensive token usage tracking for V2

2026-03-02 04:33:18 +00:00

request_test.go

feat(v2): populate CacheHints on provider.Request when caching enabled

2026-04-09 19:22:00 +00:00

request.go

feat(v2): add WithPromptCaching() request option

2026-04-09 19:17:55 +00:00

response.go

feat: comprehensive token usage tracking for V2

2026-03-02 04:33:18 +00:00

stream_test.go

Add comprehensive test suite for v2 module with mock provider

2026-02-07 22:00:49 -05:00

stream.go

Add go-llm v2: redesigned API for simpler LLM abstraction

2026-02-07 20:00:08 -05:00

tool_test.go

Add go-llm v2: redesigned API for simpler LLM abstraction

2026-02-07 20:00:08 -05:00

tool.go

Add go-llm v2: redesigned API for simpler LLM abstraction

2026-02-07 20:00:08 -05:00

transcriber.go

Add transcription API to v2 module

2026-02-07 20:24:20 -05:00