AMD ROCm GPU inference for Linux. llama.cpp + HIP backend for RDNA 3.
- Token.ID = 0 acceptable for Phase 1 (no consumer uses it) - StopTokens: ignore in Phase 1 (YAGNI) - serverEnv() should filter existing HIP_VISIBLE_DEVICES before appending - guessModelType() fine for now, upgrade to /props endpoint in Phase 2 - Integration test build tag approach approved Charon, 19 Feb 2026 Co-Authored-By: Virgil <virgil@lethean.io> |
||
|---|---|---|
| docs/plans | ||
| backend.go | ||
| CLAUDE.md | ||
| FINDINGS.md | ||
| go.mod | ||
| README.md | ||
| register_rocm.go | ||
| rocm.go | ||
| rocm_stub.go | ||
| TODO.md | ||
go-rocm
AMD ROCm GPU inference for Linux. llama.cpp + HIP backend for RDNA 3.