Shared inference interfaces (TextModel, Backend, Token). Zero deps, compiles everywhere.
Find a file
Snider 15ee86ec62 fix: add json struct tags to Message for API serialization
Message is used as a type alias by go-ml. Without json tags,
HTTP backends that serialize messages to JSON (e.g. OpenAI API)
would produce incorrect field names.

Co-Authored-By: Virgil <virgil@lethean.io>
2026-02-20 02:05:46 +00:00
CLAUDE.md feat: define shared TextModel, Backend, Token, Message interfaces 2026-02-19 19:37:27 +00:00
discover.go feat: add Discover() for scanning model directories 2026-02-19 23:37:30 +00:00
FINDINGS.md feat: define shared TextModel, Backend, Token, Message interfaces 2026-02-19 19:37:27 +00:00
go.mod feat: define shared TextModel, Backend, Token, Message interfaces 2026-02-19 19:37:27 +00:00
inference.go fix: add json struct tags to Message for API serialization 2026-02-20 02:05:46 +00:00
options.go feat: add batch inference API (Classify, BatchGenerate) 2026-02-19 23:29:28 +00:00
README.md Initial commit 2026-02-19 19:35:54 +00:00
TODO.md feat: define shared TextModel, Backend, Token, Message interfaces 2026-02-19 19:37:27 +00:00

go-inference

Shared inference interfaces (TextModel, Backend, Token). Zero deps, compiles everywhere.