1
0
Fork 0
forked from lthn/LEM
LEM/pkg/lem
Claude 4eaf1bfb39
feat: add parquet, publish, metrics, convert commands
- `lem parquet` — export JSONL training splits to Parquet (parquet-go)
- `lem publish` — push Parquet files to HuggingFace dataset repo
- `lem metrics` — push DuckDB golden set stats to InfluxDB
- `lem convert` — MLX LoRA adapter → HuggingFace PEFT format
  (pure Go safetensors read/write/transpose, no PyTorch needed)

Dependencies added: parquet-go, go-huggingface, go-rocm, go-pytorch, gotch

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-15 17:05:08 +00:00
..
client.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
client_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
compare.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
compare_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
conv.go feat: add lem conv command for conversational training data 2026-02-15 16:42:46 +00:00
conv_test.go refactor: remove Vi identity from calm conversations 2026-02-15 16:48:23 +00:00
conversations.go refactor: remove Vi identity from calm conversations 2026-02-15 16:48:23 +00:00
convert.go feat: add parquet, publish, metrics, convert commands 2026-02-15 17:05:08 +00:00
convert_test.go feat: add parquet, publish, metrics, convert commands 2026-02-15 17:05:08 +00:00
db.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
db_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
engine.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
engine_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
exact.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
exact_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
expand.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
expand_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
export.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
export_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
heuristic.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
heuristic_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
influx.go feat: add lem conv command for conversational training data 2026-02-15 16:42:46 +00:00
influx_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
ingest.go feat: add lem ingest command + go-huggingface dependency 2026-02-15 16:55:17 +00:00
ingest_test.go feat: add lem ingest command + go-huggingface dependency 2026-02-15 16:55:17 +00:00
io.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
io_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
judge.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
judge_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
metrics.go feat: add parquet, publish, metrics, convert commands 2026-02-15 17:05:08 +00:00
parquet.go feat: add parquet, publish, metrics, convert commands 2026-02-15 17:05:08 +00:00
parquet_test.go feat: add parquet, publish, metrics, convert commands 2026-02-15 17:05:08 +00:00
probe.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
probe_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
prompts.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
publish.go feat: add parquet, publish, metrics, convert commands 2026-02-15 17:05:08 +00:00
status.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
status_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
types.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00