core/go-ml
8
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
ML inference backends, scoring engine, agent orchestrator
33 commits 1 branch 5 tags 988 KiB
Find a file
Snider 52f27fc476 feat(llama): return Result from Generate/Chat 
Delegates to HTTPBackend which already returns Result.

Co-Authored-By: Virgil <virgil@lethean.io>
2026-02-22 17:37:34 +00:00
api feat(api): add REST route group for ML endpoints via go-api 2026-02-20 16:00:52 +00:00
cmd feat: migrate cmd/ml from CLI repo, resolve forge deps 2026-02-21 19:14:58 +00:00
docs docs: graduate TODO/FINDINGS into production documentation 2026-02-20 15:01:55 +00:00
scripts feat: add Ubuntu workstation setup script from CLI 2026-02-21 21:20:13 +00:00
adapter.go feat(adapter): return Result with Metrics from TextModel 2026-02-22 17:36:53 +00:00
adapter_test.go feat: Phase 2 backend consolidation — Message alias, GenOpts, deprecation 2026-02-20 02:05:59 +00:00
agent_config.go refactor: extract hardcoded values into package constants 2026-02-20 03:18:19 +00:00
agent_eval.go refactor: extract hardcoded values into package constants 2026-02-20 03:18:19 +00:00
agent_execute.go refactor: extract hardcoded values into package constants 2026-02-20 03:18:19 +00:00
agent_influx.go refactor: extract hardcoded values into package constants 2026-02-20 03:18:19 +00:00
agent_ssh.go feat: add RemoteTransport interface for SSH abstraction 2026-02-20 03:09:42 +00:00
agent_test.go test: add agent subsystem tests (25 tests, 528 LOC) 2026-02-20 03:23:13 +00:00
approve.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
backend_http.go feat(http): return Result from Generate/Chat 2026-02-22 17:37:18 +00:00
backend_http_test.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
backend_http_textmodel.go feat: Phase 2 backend consolidation — Message alias, GenOpts, deprecation 2026-02-20 02:05:59 +00:00
backend_http_textmodel_test.go feat(backend): add HTTP/Llama TextModel wrappers + verify downstream 2026-02-20 01:23:34 +00:00
backend_llama.go feat(llama): return Result from Generate/Chat 2026-02-22 17:37:34 +00:00
backend_llama_test.go test: add Phase 4 test coverage and benchmarks 2026-02-20 03:49:07 +00:00
backend_mlx.go feat(adapter): bridge go-inference TextModel to ml.Backend/StreamingBackend 2026-02-20 00:52:34 +00:00
backend_mlx_test.go test: add Phase 4 test coverage and benchmarks 2026-02-20 03:49:07 +00:00
benchmark_test.go test: add Phase 4 test coverage and benchmarks 2026-02-20 03:49:07 +00:00
CLAUDE.md docs: graduate TODO/FINDINGS into production documentation 2026-02-20 15:01:55 +00:00
compare.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
consolidate.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
convert.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
coverage.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
db.go refactor: extract hardcoded values into package constants 2026-02-20 03:18:19 +00:00
exact.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
exact_test.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
expand.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
export.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
gguf.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
go.mod feat: migrate cmd/ml from CLI repo, resolve forge deps 2026-02-21 19:14:58 +00:00
go.sum feat: migrate cmd/ml from CLI repo, resolve forge deps 2026-02-21 19:14:58 +00:00
heuristic.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
heuristic_test.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
import_all.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
inference.go feat: add Result type, break Backend interface to return Result 2026-02-22 17:36:16 +00:00
influx.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
ingest.go refactor: extract hardcoded values into package constants 2026-02-20 03:18:19 +00:00
inventory.go refactor: extract hardcoded values into package constants 2026-02-20 03:18:19 +00:00
io.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
judge.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
judge_test.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
metrics.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
normalize.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
ollama.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
parquet.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
probes.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
probes_test.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
prompts.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
publish.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
README.md docs: add README with quick start and docs links 2026-02-20 15:11:19 +00:00
score.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
score_race_test.go test: add Phase 4 test coverage and benchmarks 2026-02-20 03:49:07 +00:00
score_test.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
seed_influx.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
service.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
status.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
types.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00
worker.go feat: extract go-ml from go-ai as standalone ML package 2026-02-19 18:32:04 +00:00

README.md

go-ml

ML inference backends, multi-suite scoring engine, and agent orchestrator for the Lethean AI stack. The package provides pluggable backends (Apple Metal via go-mlx, managed llama-server subprocesses, and OpenAI-compatible HTTP APIs), a concurrent scoring engine that evaluates model responses across heuristic, semantic, content, and standard benchmark suites, 23 capability probes, GGUF model management, and an SSH-based agent orchestrator that streams checkpoint evaluation results to InfluxDB and DuckDB.

Module: forge.lthn.ai/core/go-ml Licence: EUPL-1.2 Language: Go 1.25

Quick Start

import "forge.lthn.ai/core/go-ml"

// HTTP backend (Ollama, LM Studio, any OpenAI-compatible endpoint)
backend := ml.NewHTTPBackend("http://localhost:11434", "qwen3:8b")
resp, err := backend.Generate(ctx, "Hello", ml.GenOpts{MaxTokens: 256})

// Scoring engine
engine := ml.NewEngine(backend, ml.Options{Suites: "heuristic,semantic", Concurrency: 4})
scores := engine.ScoreAll(responses)

Documentation

Build & Test

go test ./...
go test -race ./...
go test -bench=. ./...
go build ./...

Licence

European Union Public Licence 1.2 — see LICENCE for details.