ML inference backends, scoring engine, agent orchestrator
- Go 96.9%
- JavaScript 1.8%
- Shell 1.3%
087a470136
Bundling in-flight work in go/ + go/cmd so go-mlx can pull this
repo in as an external/ submodule for the auto-tuning Codex
sandbox to see.
New surfaces:
- go/lql.go (+ example + test) — LARQL primitive
- go/capability_example_test.go
Refactor / iteration touches most of go/ + go/cmd (backend,
adapter, agent, train, serve, expand, ingest, gguf, parquet,
ollama, publish, status, worker, workflow, etc.) plus the
serve_backend_{default, mlx} surfaces and the tui_train shell.
WIP — passes local build but no test sweep before this commit;
revisit when Codex returns its sandbox findings.
Co-Authored-By: Virgil <virgil@lethean.io>
|
||
|---|---|---|
| .core | ||
| .forgejo/workflows | ||
| .idea | ||
| docs | ||
| external | ||
| go | ||
| .editorconfig | ||
| .gitignore | ||
| .gitmodules | ||
| .golangci.yml | ||
| AGENTS.md | ||
| CLAUDE.md | ||
| CONTRIBUTING.md | ||
| go.work | ||
| go.work.sum | ||
| LICENCE | ||
| README.md | ||
go-ml
ML inference backends, multi-suite scoring engine, and agent orchestrator for the Lethean AI stack. The package provides pluggable backends (Apple Metal via go-mlx, managed llama-server subprocesses, and OpenAI-compatible HTTP APIs), a concurrent scoring engine that evaluates model responses across heuristic, semantic, content, and standard benchmark suites, 23 capability probes, GGUF model management, and an SSH-based agent orchestrator that streams checkpoint evaluation results to InfluxDB and DuckDB.
Module: dappco.re/go/core/ml
Licence: EUPL-1.2
Language: Go 1.25
Quick Start
import "dappco.re/go/core/ml"
// HTTP backend (Ollama, LM Studio, any OpenAI-compatible endpoint)
backend := ml.NewHTTPBackend("http://localhost:11434", "qwen3:8b")
resp, err := backend.Generate(ctx, "Hello", ml.GenOpts{MaxTokens: 256})
// Scoring engine
engine := ml.NewEngine(backend, ml.Options{Suites: "heuristic,semantic", Concurrency: 4})
scores := engine.ScoreAll(responses)
Documentation
- Architecture — backends, scoring engine, agent orchestrator, data pipeline
- Development Guide — building, testing, contributing
- Project History — completed phases and known limitations
Build & Test
go test ./...
go test -race ./...
go test -bench=. ./...
go build ./...
Licence
European Union Public Licence 1.2 — see LICENCE for details.