cli/cmd/ml/serve_backend_mlx.go
Claude a43cc099cd
Some checks are pending
Security Scan / Go Vulnerability Check (push) Waiting to run
Security Scan / Secret Detection (push) Waiting to run
Security Scan / Dependency & Config Scan (push) Waiting to run
feat(cli): migrate imports to split repos + wire go-agentic registry
Virgil split go-ai into standalone modules (go-agentic, go-ml, go-mlx,
go-rag). This migrates all CLI imports to the new module paths and fixes
API mismatches from the split.

Key changes:
- go-ai/agentic → go-agentic (cmd/ai, cmd/dev)
- go-ai/ml → go-ml (31 files in cmd/ml)
- go-ai/rag → go-rag (3 files in cmd/rag)
- go-ai/mlx → go-mlx (1 file)
- Fix go.work path (../core → ../go)
- Add all split repos to go.work and go.mod
- Simplify daemon to goroutine-based MCP (remove missing supervisor)
- Wire go-agentic SQLiteRegistry into dispatch watch (--agent-id flag)
- Add `core ai agent fleet` command for local registry status
- Fix rag collections API (PointCount, Status string)
- Fix ml live/expand-status to use available go-ml API

Co-Authored-By: Charon <charon@lethean.io>
2026-02-20 12:47:02 +00:00

22 lines
439 B
Go

//go:build darwin && arm64
package ml
import (
"fmt"
"log/slog"
"forge.lthn.ai/core/go-ml"
)
func createServeBackend() (ml.Backend, error) {
if serveModelPath != "" {
slog.Info("ml serve: loading native MLX backend", "path", serveModelPath)
b, err := ml.NewMLXBackend(serveModelPath)
if err != nil {
return nil, fmt.Errorf("mlx backend: %w", err)
}
return b, nil
}
return ml.NewHTTPBackend(apiURL, modelName), nil
}