AMD ROCm GPU inference for Linux. llama.cpp + HIP backend for RDNA 3.
Find a file
Claude 2c4966e652
feat: detect server crash before Generate/Chat calls
Co-Authored-By: Virgil <virgil@lethean.io>
2026-02-19 21:34:46 +00:00
docs/plans docs: Phase 2 robustness implementation plan 2026-02-19 21:31:24 +00:00
internal/llamacpp fix: guard response body lifecycle in SSE streaming client 2026-02-19 21:04:02 +00:00
backend.go feat: Backend Available() and LoadModel() with GPU detection 2026-02-19 21:12:02 +00:00
CLAUDE.md docs: Phase 0 complete — environment validated, llama-server built 2026-02-19 19:57:14 +00:00
FINDINGS.md docs: Phase 1 plan review — approved with notes 2026-02-19 20:44:37 +00:00
go.mod feat: llamacpp health check client 2026-02-19 20:50:36 +00:00
go.sum feat: llamacpp health check client 2026-02-19 20:50:36 +00:00
model.go feat: detect server crash before Generate/Chat calls 2026-02-19 21:34:46 +00:00
README.md Initial commit 2026-02-19 19:35:55 +00:00
register_rocm.go feat: scaffold go-rocm AMD GPU inference package 2026-02-19 19:39:40 +00:00
rocm.go feat: scaffold go-rocm AMD GPU inference package 2026-02-19 19:39:40 +00:00
rocm_integration_test.go test: integration tests for full ROCm inference pipeline 2026-02-19 21:15:02 +00:00
rocm_stub.go feat: scaffold go-rocm AMD GPU inference package 2026-02-19 19:39:40 +00:00
server.go feat: detect server crash before Generate/Chat calls 2026-02-19 21:34:46 +00:00
server_test.go feat: detect server crash before Generate/Chat calls 2026-02-19 21:34:46 +00:00
TODO.md docs: mark Phase 1 tasks complete 2026-02-19 21:16:11 +00:00

go-rocm

AMD ROCm GPU inference for Linux. llama.cpp + HIP backend for RDNA 3.