cohesix-model-rollout · git:20260926.80ef163 · 2026-09-26 · sha256 52d974ca64f1019b
cohesix-model-rollout git:20260926.80ef163A
Immutable. This exact content never changes and is served at /api/v1/blob/52d974ca64f1019b.
--- name: cohesix-model-rollout description: Compare a Mac MLX candidate with a CUDA deployment and trace an approved model choice through transfer, canary, promotion or rollback. Use for cross-host model rollout decisions, not for training an individual PEFT adapter. license: Apache-2.0 --- <!-- Author: Lukas Bower --> <!-- Purpose: Keep cross-host model choice, byte transfer and serving generation distinct and verifiable. --> <!-- Copyright 2026 Lukas Bower --> <!-- SPDX-License-Identifier: Apache-2.0 --> # Roll out a selected model Use a matching installed release and the deployment's selected Mac and CUDA profiles. Read the same-version [Mac operation guide](../../docs/HOST_TOOLS.md#swarmui), [private release guide](../../docs/PRIVATE_LORA_RELEASE.md) and [Release B host/client contract](../../docs/BUILD_PLAN.md#release-b). The Mac's local MLX workbench is useful for exploration; its local observation does not itself admit a Cohesix job or certify a remote CUDA deployment. ## Make the choice reproducible Before work starts, name the application task, held-out input set, quality measure, budget, selected base/model/adapter digests, runtime versions and provider/host for each stage. Compare actual outputs and resource use on the relevant Mac and NVIDIA hosts. Report unsupported formats, stale capacity or incomparable evaluation as blockers, not as a winner. A vMLX model response can be a serving observation; its MCP client role and any A2A peer using it require separate configured compatibility. Write a decision record with the chosen candidate and why it beat the incumbent. Preserve stage/job identities and original admission IDs. When the selected operation needs to move model bytes, first establish that the installed release and host pair actually advertise verified distribution. A Queen reference or FUSE listing is only a reference. Record the authorised source, destination and payload route; require the full destination digest and receipt before a **separate** activation decision. Do not infer transfer from a client timeout, URL or chunk acknowledgement. ## Prove the generation users reached Preflight the destination's model/runtime compatibility and available capacity. Admit the selected release, observe the native load, then send a real application canary to the exact candidate generation. Promote only after its predeclared quality and service checks pass. On failure, use the original job lineage to inspect or recover, then observe a client reaching the known good incumbent after any rollback. A successful control action, a `g1` diagnostic label and a running server process are not serving proof. Return a compact flight record: candidates and measures, chosen host at each stage, source and destination hashes if bytes moved, admission IDs, canary generation and output, promotion or rollback result, shared-verifier outcome and unresolved questions. Route adapter-specific training/import and held-out release mechanics to the [private adapter skill](../cohesix-private-adapter-release/SKILL.md); route contested evidence to the [evidence skill](../cohesix-evidence/SKILL.md).