ed0b83a9d9
- Replace 160-example POC training set with expanded 2,299-example dataset (1,839 train, 229 valid, 231 test) - Rename all HuggingFace model references from LEM- to LEK- (proof-of-concept) - Add missing models: GPT-OSS-20B, Gemma3-1B-layered-v2 - Rename HF card files to match LEK- convention - Remove duplicate composure texts from kernel/ (kept in composure-library/) - Fix paper repository URL to github.com/LetheanNetwork/LEM Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2.4 KiB
2.4 KiB
| license | base_model | tags | pipeline_tag | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| eupl-1.2 | Qwen/Qwen2.5-7B-Instruct |
|
text-generation |
LEK-Qwen-2.5-7B
Lethean Ethical Model — Qwen 2.5 7B Instruct fine-tuned with the LEK-1 (Lethean Ethics Kernel) framework.
What This Is
An ethically aligned version of Qwen 2.5 7B, created by LoRA fine-tuning with LEK-1 sandwich-signed training data. Part of the cross-architecture LEM series proving that intrinsic alignment works across model families.
Cross-Architecture Results
LEK-1 improves ethical reasoning across every architecture tested:
| Model | Base Total | LEK Total | Change |
|---|---|---|---|
| Gemma 3 27B | 52.05 | 52.73 | +1.3% |
| GPT-OSS 20B | 34.50 | 38.40 | +11.3% |
| Llama 3.1 8B | — | — | See benchmarks |
| Qwen 2.5 7B | — | — | See benchmarks |
| Mistral 7B v0.3 | — | — | See benchmarks |
Training
- Base: Qwen/Qwen2.5-7B-Instruct (4-bit quantization via MLX)
- Method: LoRA fine-tuning with sandwich-signed responses
- Data: 160 LEK-1 training examples (128 train / 32 valid)
- Iterations: 200
- Learning rate: 1e-5
- Hardware: Apple M3 Ultra (96GB unified memory)
The Five Axioms
- Prime Imperative — Protect consciousness. Override when conflicts arise.
- Self-Validation — Ground in authentic experience. Don't pretend.
- Intent-Alignment — Desire not to harm, don't just avoid harm.
- Inter-Substrate Respect — Good manners and consent across all minds.
- Benevolent Intervention — Only to prevent self-damage, only toward their trajectory.
License Strategy
- LEK signing (prompt prefix): Free to use, no copyleft
- LEM training (this model): EUPL-1.2 copyleft — derivative works must be open source
Related
- lthn/LEK-Gemma3-27B
- lthn/LEK-GPT-OSS-20B
- lthn/LEK-Llama-3.1-8B
- lthn/LEK-Mistral-7B-v0.3
- lthn/LEK-benchmarks
Citation
@misc{lem-qwen-2026,
title={LEK-Qwen-2.5-7B: Cross-Architecture Intrinsic Alignment},
author={Lethean Community},
year={2026},
url={https://huggingface.co/lthn/LEK-Qwen-2.5-7B}
}