steve/go-llm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
62 Commits 4 Branches 0 Tags
b4bf73136a49805acead73cfa171f7dc6f3bc0ce
Commit Graph
5 Commits
Author SHA1 Message Date
steveandClaude Opus 4.6 b4bf73136a feat(v2/provider): add CacheHints to Request for prompt caching 
Adds an optional CacheHints field on provider.Request that carries
cache-breakpoint placement directives from the public llm package down
to individual provider implementations. Anthropic will consume these in
a follow-up commit; OpenAI and Google ignore them.

Co-Authored-By: Claude Opus 4.6 <[email protected]>
 2026-04-09 19:14:44 +00:00
steveandClaude Opus 4.6 5b687839b2 feat: comprehensive token usage tracking for V2
CI / Lint (pull_request) Successful in 10m18s
Details
CI / Root Module (pull_request) Successful in 11m4s
Details
CI / V2 Module (pull_request) Successful in 11m5s
Details 
Add provider-specific usage details, fix streaming usage, and return
usage from all high-level APIs (Chat.Send, Generate[T], Agent.Run).

Breaking changes:
- Chat.Send/SendMessage/SendWithImages now return (string, *Usage, error)
- Generate[T]/GenerateWith[T] now return (T, *Usage, error)
- Agent.Run/RunMessages now return (string, *Usage, error)

New features:
- Usage.Details map for provider-specific token breakdowns
  (reasoning, cached, audio, thoughts tokens)
- OpenAI streaming now captures usage via StreamOptions.IncludeUsage
- Google streaming now captures UsageMetadata from final chunk
- UsageTracker.Details() for accumulated detail totals
- ModelPricing and PricingRegistry for cost computation

Closes #2

Co-Authored-By: Claude Opus 4.6 <[email protected]>
 2026-03-02 04:33:18 +00:00
steveandClaude Opus 4.6 7e1705c385 feat: add audio input support to v2 providers
CI / Lint (push) Successful in 9m37s
Details
CI / Root Module (push) Successful in 10m53s
Details
CI / V2 Module (push) Successful in 11m9s
Details 
Add Audio struct alongside Image for sending audio attachments to
multimodal LLMs. OpenAI uses input_audio content parts (wav/mp3),
Google Gemini uses genai.NewPartFromBytes, and Anthropic skips
audio gracefully since it's not supported.

Co-Authored-By: Claude Opus 4.6 <[email protected]>
 2026-02-08 21:00:56 -05:00
steveandClaude Opus 4.6 9e288954f2 Add transcription API to v2 module
CI / Lint (push) Failing after 5m0s
Details
CI / Root Module (push) Failing after 5m3s
Details
CI / V2 Module (push) Successful in 10m48s
Details 
Migrate speech-to-text transcription types and OpenAI transcriber
implementation from v1. Types are defined in provider/ to avoid
import cycles and re-exported via type aliases from the root package.

Co-Authored-By: Claude Opus 4.6 <[email protected]>
 2026-02-07 20:24:20 -05:00
steveandClaude Opus 4.6 a4cb4baab5 Add go-llm v2: redesigned API for simpler LLM abstraction 
v2 is a new Go module (v2/) with a dramatically simpler API:
- Unified Message type (no more Input marker interface)
- Define[T] for ergonomic tool creation with standard context.Context
- Chat session with automatic tool-call loop (agent loop)
- Streaming via pull-based StreamReader
- MCP one-call connect (MCPStdioServer, MCPHTTPServer, MCPSSEServer)
- Middleware support (logging, retry, timeout, usage tracking)
- Decoupled JSON Schema (map[string]any, no provider coupling)
- Sample tools: WebSearch, Browser, Exec, ReadFile, WriteFile, HTTP
- Providers: OpenAI, Anthropic, Google (all with streaming)

Co-Authored-By: Claude Opus 4.6 <[email protected]>
 2026-02-07 20:00:08 -05:00