Steve Dudenhoeffer 4b401fcc0d feat(v2): populate CacheHints on provider.Request when caching enabled ...

buildProviderRequest now computes cache-breakpoint positions automatically
when the WithPromptCaching() option is set. It places up to 3 hints:
tools, system, and the index of the last non-system message. Providers
that don't support caching (OpenAI, Google) ignore the field.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-04-09 19:22:00 +00:00

5.5 KiB

Raw Blame History

View Raw