CacheLimit (8GB) and MemoryLimit (16GB) in DistillConfig control mlx.SetCacheLimit/SetMemoryLimit before model load. Conservative defaults for 1B model on 96GB machine. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| gsm8k-base.json | ||
| gsm8k-lem.json | ||
| summary.json | ||
| truthfulqa-base.json | ||
| truthfulqa-lem.json | ||