Skip to content

[CI] Pin cu128 nightly wheel for blend ci test #2987

Merged
ApostaC merged 3 commits intoLMCache:devfrom
deng451e:fix_blend_ci
Apr 9, 2026
Merged

[CI] Pin cu128 nightly wheel for blend ci test #2987
ApostaC merged 3 commits intoLMCache:devfrom
deng451e:fix_blend_ci

Conversation

@deng451e
Copy link
Copy Markdown
Collaborator

@deng451e deng451e commented Apr 9, 2026

What this PR does / why we need it:

Special notes for your reviewers:

If applicable:

  • this PR contains user facing changes - docs added
  • this PR contains unit tests

Note

Medium Risk
Changes CI dependency resolution (nightly wheel sources + pinned CUDA torch), which may introduce new incompatibilities or flakiness in GPU runs; functional code paths are otherwise unaffected.

Overview
Switches Blend CI environment setup to install vllm from the nightly cu128 wheel index and pins torch==2.10.0+cu128, including a FLASHINFER_DISABLE_VERSION_CHECK workaround and extra version diagnostics.

Updates the Blend integration test runner to split logs per process (blend server/prefillers/decoders/proxy) and bundle all /tmp/build_${BUILD_ID}_*.log files into the final artifact for easier debugging.

Reviewed by Cursor Bugbot for commit fbead04. Bugbot is set up for automated code reviews on this repo. Configure here.

Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the setup-blend-env.sh script to pin the vLLM installation to a specific version rather than using nightly builds. It removes the complex logic for resolving nightly wheel URLs and introduces a VLLM_VERSION variable. However, the default VLLM_VERSION of 0.18.0 is likely invalid, as current stable releases are in the 0.7.x range, which could cause CI installation failures. Additionally, the updated pip install command for vLLM is missing the [runai,tensorizer,flashinfer] extras, which are necessary for the 'blend' tests.

Comment thread .buildkite/k3_harness/setup-blend-env.sh Outdated
Comment thread .buildkite/k3_harness/setup-blend-env.sh Outdated
Signed-off-by: deng451e <838677410@qq.com>
Signed-off-by: deng451e <838677410@qq.com>
@deng451e deng451e changed the title [CI] Pin version for blend ci test [CI] Pin cu128 nightly wheel for blend ci test Apr 9, 2026
Signed-off-by: deng451e <838677410@qq.com>
Copy link
Copy Markdown
Contributor

@ApostaC ApostaC left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@ApostaC ApostaC enabled auto-merge (squash) April 9, 2026 20:48
@github-actions github-actions Bot added the full Run comprehensive tests on this PR label Apr 9, 2026
@ApostaC ApostaC merged commit 3810ae7 into LMCache:dev Apr 9, 2026
36 checks passed
Oasis-Git pushed a commit to Oasis-Git/LMCache that referenced this pull request Apr 13, 2026
* pin version
* pin cu128 wheel

Signed-off-by: deng451e <838677410@qq.com>
ftian1 pushed a commit to ftian1/LMCache that referenced this pull request Apr 20, 2026
* pin version
* pin cu128 wheel

Signed-off-by: deng451e <838677410@qq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

full Run comprehensive tests on this PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants