All 5 steps done: SSH mock, command, file, service/package, user/group/advanced, and error/become/facts/idempotency modules. Co-Authored-By: Virgil <virgil@lethean.io>
5.7 KiB
5.7 KiB
TODO.md — go-devops
Dispatched from core/go orchestration. Pick up tasks in order.
Phase 0: Test Coverage & Hardening
- Expand ansible/ tests — Added
parser_test.go(17 tests: ParsePlaybook, ParseInventory, ParseTasks, GetHosts, GetHostVars, isModule, NormalizeModule),types_test.go(RoleRef/Task UnmarshalYAML, Inventory, Facts, TaskResult, KnownModules),executor_test.go(getHosts, matchesTags, evaluateWhen, templateString, applyFilter, resolveLoop, templateArgs, handleNotify, normalizeConditions, helper functions). All pass. Commit6e346cb. - Expand infra/ tests — Added
hetzner_test.go(HCloudClient/HRobotClient construction, do() round-trip via httptest, API error handling, JSON serialisation for HCloudServer, HCloudLoadBalancer, HRobotServer) andcloudns_test.go(doRaw() round-trip, zone/record JSON, CRUD responses, ACME challenge, auth params, errors). Commit6e346cb. - Expand build/ tests — Added
archive_test.go(archive round-trip for tar.gz/zip, multi-file archives, 249 LOC) and extendedsigning_test.go(mock signer tests, path verification, error handling, +181 LOC). Commit5d22ed9. - Expand release/ tests — Fixed nil pointer crash in
linuxkit.go:50(addedrelease.FS == nilguard). Added nil FS test case tolinuxkit_test.go(+23 LOC). 862 tests pass across build/ and release/. Commit5d22ed9. - Race condition tests —
go test -race ./...clean across ansible, infra, container, devops, build packages. Commit6e346cb. go vet ./...clean — Fixed stale API calls in container/linuxkit_test.go, state_test.go, templates_test.go, devops/devops_test.go. go.mod replace directive fixed. Commit6e346cb.
Phase 1: Ansible Engine Hardening
Step 1.0: SSH mock infrastructure
- Create
ansible/mock_ssh_test.go— MockSSHClient with command registry (expectCommand), file system simulation (in-memory map), become state tracking, execution/upload logs, and assertion helpers (hasExecuted,hasExecutedMethod,findExecuted). Module shims viasshRunnerinterface for testability. 12 mock infrastructure tests. Commit3330e55.
Step 1.1: Command execution modules (4 modules, ~100 LOC)
- Test command/shell/raw/script — 36 module tests + 12 mock tests = 48 new tests. Verifies: command uses
Run(), shell usesRunScript(), raw passes through without wrapping, script reads local file. Cross-module differentiation tests, dispatch routing, template variable resolution. Commit3330e55.
Step 1.2: File operation modules (6 modules, ~280 LOC)
- Test copy/template/file/lineinfile/blockinfile/stat — 54 new tests: copy (8), file (12), lineinfile (8), blockinfile (7), stat (5), template (6), dispatch (6), integration (2). Extended mock with
sshFileRunnerinterface and 6 module shims. Fixed unsupported module test (copy→hostname). Total ansible tests: 208. Commitc7da9ad.
Step 1.3: Service & package modules (7 modules, ~180 LOC)
- Test service/systemd/apt/apt_key/apt_repository/package/pip — 56 new tests: service (12), systemd (4), apt (9), apt_key (6), apt_repository (8), package (3), pip (8), dispatch (7). 7 module shims in mock_ssh_test.go. Commit
9638e77.
Step 1.4: User/group & advanced modules (10 modules, ~385 LOC)
- Test user/group/cron/authorized_key/git/unarchive/uri/ufw/docker_compose — 69 new tests: user (7), group (7), cron (5), authorized_key (7), git (8), unarchive (8), uri (6), ufw (8), docker_compose (7), dispatch (6). 9 module shims. Total ansible tests: 334. Commit
427929f.
Step 1.5: Error propagation & become
- Error propagation — 68 tests: getHosts (8), matchesTags (7), evaluateWhen/evalCondition (22), templateString (14), applyFilter (9), resolveLoop (5), handleNotify (5), normalizeConditions (6), cross-cutting (7).
- Become/sudo — 8 tests: enable/disable cycle, default user, passwordless, play-level become.
- Fact gathering — 9 tests: Ubuntu/CentOS/Alpine/Debian os-release parsing, hostname, localhost.
- Idempotency checks — 8 tests: group exists, authorized_key present, docker compose up-to-date, stat always unchanged.
- Total ansible tests: 438. Phase 1 complete. Commit
8ab8643.
Phase 2: Infrastructure API Robustness
- Retry logic — Add configurable retry with exponential backoff for Hetzner Cloud/Robot and CloudNS API calls. Cloud APIs are flaky.
- Rate limiting — Hetzner Cloud has rate limits. Detect 429 responses, queue and retry.
- DigitalOcean support — Currently referenced in config but no implementation. Either implement or remove.
- API client abstraction — Extract common HTTP client pattern from hetzner.go and cloudns.go into shared infra client.
Phase 3: Release Pipeline Testing
- Publisher integration tests — Mock GitHub API for release creation, Docker registry for image push, Homebrew tap for formula update. Verify dry-run mode produces correct output without side effects.
- SDK generation tests — Generate TypeScript/Go/Python clients from a test OpenAPI spec. Verify output compiles/type-checks.
- Breaking change detection — Test oasdiff integration: modify a spec with breaking change, verify detection and failure mode.
Phase 4: DevKit Expansion
- Vulnerability scanning — Integrate
govulncheckoutput parsing into devkit findings. - Complexity thresholds — Configurable cyclomatic complexity threshold. Flag functions exceeding it.
- Coverage trending — Store coverage snapshots, detect regressions between runs.
Workflow
- Virgil in core/go writes tasks here after research
- This repo's dedicated session picks up tasks in phase order
- Mark
[x]when done, note commit hash