core/go-inference
8
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
Shared inference interfaces (TextModel, Backend, Token). Zero deps, compiles everywhere.
2 commits 1 branch 4 tags 146 KiB
Find a file
Snider 07cd917259 feat: define shared TextModel, Backend, Token, Message interfaces 
Zero-dependency interface package for the Core inference ecosystem.
Backends (go-mlx, go-rocm) implement these interfaces.
Consumers (go-ml, go-ai, go-i18n) import them.

Includes:
- TextModel: Generate, Chat, Err, Close (with context.Context)
- Backend: Named engine registry with platform preference
- Functional options: WithMaxTokens, WithTemperature, WithTopK, etc.
- LoadModel: Auto-selects best available backend

Co-Authored-By: Virgil <virgil@lethean.io>
2026-02-19 19:37:27 +00:00
CLAUDE.md feat: define shared TextModel, Backend, Token, Message interfaces 2026-02-19 19:37:27 +00:00
FINDINGS.md feat: define shared TextModel, Backend, Token, Message interfaces 2026-02-19 19:37:27 +00:00
go.mod feat: define shared TextModel, Backend, Token, Message interfaces 2026-02-19 19:37:27 +00:00
inference.go feat: define shared TextModel, Backend, Token, Message interfaces 2026-02-19 19:37:27 +00:00
options.go feat: define shared TextModel, Backend, Token, Message interfaces 2026-02-19 19:37:27 +00:00
README.md Initial commit 2026-02-19 19:35:54 +00:00
TODO.md feat: define shared TextModel, Backend, Token, Message interfaces 2026-02-19 19:37:27 +00:00

README.md

go-inference

Shared inference interfaces (TextModel, Backend, Token). Zero deps, compiles everywhere.