go/pkg/ml
Claude 478bbdd44c
fix: add Metal cache management to prevent memory growth
- Add ClearCache() wrapping mlx_clear_cache
- Clear Metal allocator cache every 8 tokens during generation
- Set 16GB cache limit on backend init
- Prevents GPU memory from growing unbounded during inference

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-16 02:27:10 +00:00
..
agent.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
backend_http.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
backend_http_test.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
backend_llama.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
backend_mlx.go fix: add Metal cache management to prevent memory growth 2026-02-16 02:27:10 +00:00
compare.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
convert.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
db.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
exact.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
exact_test.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
expand.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
export.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
gguf.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
heuristic.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
heuristic_test.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
inference.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
influx.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
io.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
judge.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
judge_test.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
ollama.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
parquet.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
probes.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
probes_test.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
prompts.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
score.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
score_test.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
service.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
status.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
types.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00
worker.go feat: add ML inference, scoring, and training pipeline (pkg/ml) 2026-02-16 00:34:53 +00:00