core/go-rocm
8
0
Fork 0
Code Issues 4 Pull requests Projects Releases Packages Wiki Activity Actions
AMD ROCm GPU inference for Linux. llama.cpp + HIP backend for RDNA 3.
11 commits 4 branches 2 tags 203 KiB
Find a file
Claude def3167199
feat: llamacpp SSE streaming client for chat completions 
Add ChatComplete() and Complete() methods to the llamacpp Client,
backed by a shared parseSSE() line parser. Types include ChatMessage,
ChatRequest, CompletionRequest and their chunked response structs.

Tests cover multi-chunk streaming, empty responses, HTTP errors, and
context cancellation — all using httptest SSE servers.

Co-Authored-By: Virgil <virgil@lethean.io>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-19 20:58:46 +00:00
docs/plans docs: incorporate Charon review — safer serverEnv() filtering 2026-02-19 20:47:16 +00:00
internal/llamacpp feat: llamacpp SSE streaming client for chat completions 2026-02-19 20:58:46 +00:00
backend.go feat: scaffold go-rocm AMD GPU inference package 2026-02-19 19:39:40 +00:00
CLAUDE.md docs: Phase 0 complete — environment validated, llama-server built 2026-02-19 19:57:14 +00:00
FINDINGS.md docs: Phase 1 plan review — approved with notes 2026-02-19 20:44:37 +00:00
go.mod feat: llamacpp health check client 2026-02-19 20:50:36 +00:00
go.sum feat: llamacpp health check client 2026-02-19 20:50:36 +00:00
README.md Initial commit 2026-02-19 19:35:55 +00:00
register_rocm.go feat: scaffold go-rocm AMD GPU inference package 2026-02-19 19:39:40 +00:00
rocm.go feat: scaffold go-rocm AMD GPU inference package 2026-02-19 19:39:40 +00:00
rocm_stub.go feat: scaffold go-rocm AMD GPU inference package 2026-02-19 19:39:40 +00:00
TODO.md docs: Phase 0 complete — environment validated, llama-server built 2026-02-19 19:57:14 +00:00

README.md

go-rocm

AMD ROCm GPU inference for Linux. llama.cpp + HIP backend for RDNA 3.