Claude 7fc1571f93 fix: handle both string and array merge formats in tokenizer ... Gemma 3 tokenizer.json uses [["a","b"],...] format for merges instead of the ["a b",...] format. Support both. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>		2026-02-16 05:53:52 +00:00
..
tokenizer.go	fix: handle both string and array merge formats in tokenizer	2026-02-16 05:53:52 +00:00