Skip to content

Hivemind Maintenance Tasks Epoch 1 #73

@marksverdhei

Description

@marksverdhei

Hivemind-driven maintenance sprint for ht-llama.cpp. Pick items in triaged order; cross off as done; append "saved for later" at the bottom.

Triage criteria (per ~/IDLE.md)

  1. Obviously wanted (lowest risk of decision drift)
  2. Low-hanging fruit
  3. How much we want it
  4. Difficulty

Active sprint — top 5

  • CI health on origin/htbuild-sycl.yml has been failing on every recent commit (09b2124fb, b0daec55b). Investigate whether it's a pre-existing upstream issue or a real ht regression. If pre-existing, file a tracking task; if our problem, fix.
  • Tests for --fit-print-plan (PR feat(fit-params): --fit-print-plan emits per-device byte plan as JSON (#66 step 2 prep) #72 added the flag with no test coverage). Add a smoke test that verifies the JSON output format. Either in tests/ as a small new test, or as a shellcheck-style script.
  • Docs review on tools/server/README.md — the heierchat decoupling left some pointers that may be stale. Verify all cross-repo links resolve.
  • Bug-hunt sweep on tools/server/server-models.cpp — 1500+ LOC of router state machine handling subprocess lifecycle, the area where heierchat-500s incident lives. Look for obvious logical bugs (race conditions, missing error paths, off-by-one on reserved-style accounting).
  • Profile/bench scout for DFlash speculative decoding — per IDLE.md HPC clause: identify the hottest path in llama-speculative-simple against gemma-4-31B target. Once titan rolls, scripts/bench-dflash.sh --target Q8_0 measures throughput; understand which hotspot we'd target if accept rate stays at ~8%.

Saved for later

Out of scope (not maintenance)

  • Anything that adds new features without an issue / RFC backing it
  • Reviewing PRs from non-approved authors (none currently; all 4 open PRs are by marksverdhei)

Created per ~/IDLE.md guidance. Will close when sprint cleared.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions