1
0
Fork 0
forked from lthn/LEM
LEM/pkg/lem
Claude 91ee389377
feat: convert all pipeline.py commands to Go
Complete conversion of pipeline.py into Go `lem` CLI:
- import-all: bulk import all LEM data into DuckDB from M3
- consolidate: pull worker JSONLs, merge, deduplicate
- normalize: seeds → deduplicated expansion_prompts table
- approve: filter scored expansions → training JSONL
- tier-score: heuristic/judge tiered expansion scoring
- expand-status: expansion pipeline progress from DuckDB
- inventory: DuckDB table counts and summary
- coverage: seed coverage gap analysis
- seed-influx: bootstrap InfluxDB from DuckDB golden_gen
- query: ad-hoc SQL against DuckDB

22 commands total, 49 Go files. Replaces entire pipeline.py.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-15 17:12:03 +00:00
..
approve.go feat: convert all pipeline.py commands to Go 2026-02-15 17:12:03 +00:00
client.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
client_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
compare.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
compare_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
consolidate.go feat: convert all pipeline.py commands to Go 2026-02-15 17:12:03 +00:00
conv.go feat: add lem conv command for conversational training data 2026-02-15 16:42:46 +00:00
conv_test.go refactor: remove Vi identity from calm conversations 2026-02-15 16:48:23 +00:00
conversations.go refactor: remove Vi identity from calm conversations 2026-02-15 16:48:23 +00:00
convert.go feat: add parquet, publish, metrics, convert commands 2026-02-15 17:05:08 +00:00
convert_test.go feat: add parquet, publish, metrics, convert commands 2026-02-15 17:05:08 +00:00
coverage.go feat: convert all pipeline.py commands to Go 2026-02-15 17:12:03 +00:00
db.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
db_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
engine.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
engine_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
exact.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
exact_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
expand.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
expand_status.go feat: convert all pipeline.py commands to Go 2026-02-15 17:12:03 +00:00
expand_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
export.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
export_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
heuristic.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
heuristic_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
import.go feat: convert all pipeline.py commands to Go 2026-02-15 17:12:03 +00:00
influx.go feat: add lem conv command for conversational training data 2026-02-15 16:42:46 +00:00
influx_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
ingest.go feat: add lem ingest command + go-huggingface dependency 2026-02-15 16:55:17 +00:00
ingest_test.go feat: add lem ingest command + go-huggingface dependency 2026-02-15 16:55:17 +00:00
inventory.go feat: convert all pipeline.py commands to Go 2026-02-15 17:12:03 +00:00
io.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
io_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
judge.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
judge_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
metrics.go feat: add parquet, publish, metrics, convert commands 2026-02-15 17:05:08 +00:00
normalize.go feat: convert all pipeline.py commands to Go 2026-02-15 17:12:03 +00:00
parquet.go feat: add parquet, publish, metrics, convert commands 2026-02-15 17:05:08 +00:00
parquet_test.go feat: add parquet, publish, metrics, convert commands 2026-02-15 17:05:08 +00:00
probe.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
probe_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
prompts.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
publish.go feat: add parquet, publish, metrics, convert commands 2026-02-15 17:05:08 +00:00
query.go feat: convert all pipeline.py commands to Go 2026-02-15 17:12:03 +00:00
seed_influx.go feat: convert all pipeline.py commands to Go 2026-02-15 17:12:03 +00:00
status.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
status_test.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00
tier_score.go feat: convert all pipeline.py commands to Go 2026-02-15 17:12:03 +00:00
types.go refactor: move Go library to pkg/lem, thin main.go 2026-02-15 16:30:09 +00:00