4eaf1bfb39
- `lem parquet` — export JSONL training splits to Parquet (parquet-go) - `lem publish` — push Parquet files to HuggingFace dataset repo - `lem metrics` — push DuckDB golden set stats to InfluxDB - `lem convert` — MLX LoRA adapter → HuggingFace PEFT format (pure Go safetensors read/write/transpose, no PyTorch needed) Dependencies added: parquet-go, go-huggingface, go-rocm, go-pytorch, gotch Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
31 lines
1.1 KiB
Modula-2
31 lines
1.1 KiB
Modula-2
module forge.lthn.ai/lthn/lem
|
|
|
|
go 1.25.6
|
|
|
|
require (
|
|
github.com/marcboeker/go-duckdb v1.8.5
|
|
github.com/parquet-go/parquet-go v0.27.0
|
|
)
|
|
|
|
require (
|
|
github.com/andybalholm/brotli v1.1.1 // indirect
|
|
github.com/apache/arrow-go/v18 v18.1.0 // indirect
|
|
github.com/go-viper/mapstructure/v2 v2.2.1 // indirect
|
|
github.com/goccy/go-json v0.10.5 // indirect
|
|
github.com/google/flatbuffers v25.1.24+incompatible // indirect
|
|
github.com/google/uuid v1.6.0 // indirect
|
|
github.com/klauspost/compress v1.17.11 // indirect
|
|
github.com/klauspost/cpuid/v2 v2.2.9 // indirect
|
|
github.com/parquet-go/bitpack v1.0.0 // indirect
|
|
github.com/parquet-go/jsonlite v1.0.0 // indirect
|
|
github.com/pierrec/lz4/v4 v4.1.22 // indirect
|
|
github.com/twpayne/go-geom v1.6.1 // indirect
|
|
github.com/zeebo/xxh3 v1.0.2 // indirect
|
|
golang.org/x/exp v0.0.0-20250128182459-e0ece0dbea4c // indirect
|
|
golang.org/x/mod v0.22.0 // indirect
|
|
golang.org/x/sync v0.10.0 // indirect
|
|
golang.org/x/sys v0.38.0 // indirect
|
|
golang.org/x/tools v0.29.0 // indirect
|
|
golang.org/x/xerrors v0.0.0-20240903120638-7835f813f4da // indirect
|
|
google.golang.org/protobuf v1.36.1 // indirect
|
|
)
|