Claude a27a31faad fix: add GC-based memory management for MLX array handles ... Go GC cannot see Metal/C memory pressure, so intermediate arrays from each forward pass accumulated without bound, causing OOM kills after 3-4 requests. Fix: runtime.SetFinalizer on every Array releases C handles when GC collects them, and runtime.GC() is forced every 4 tokens during generation. Also adds SetMemoryLimit(24GB) as a hard Metal ceiling. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>		2026-02-16 02:42:28 +00:00
..
agent.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
backend_http.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
backend_http_test.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
backend_llama.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
backend_mlx.go	fix: add GC-based memory management for MLX array handles	2026-02-16 02:42:28 +00:00
compare.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
convert.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
db.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
exact.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
exact_test.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
expand.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
export.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
gguf.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
heuristic.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
heuristic_test.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
inference.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
influx.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
io.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
judge.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
judge_test.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
ollama.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
parquet.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
probes.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
probes_test.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
prompts.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
score.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
score_test.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
service.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
status.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
types.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00
worker.go	feat: add ML inference, scoring, and training pipeline (pkg/ml)	2026-02-16 00:34:53 +00:00