Skip to content

Refactore script to set VLLM_TARGET_DEVICE=rocm only for AMD GPUs#2324

Merged
cb-github-robot merged 1 commit intocloud-barista:mainfrom
leehyeoklee:main
Feb 23, 2026
Merged

Refactore script to set VLLM_TARGET_DEVICE=rocm only for AMD GPUs#2324
cb-github-robot merged 1 commit intocloud-barista:mainfrom
leehyeoklee:main

Conversation

@leehyeoklee
Copy link
Copy Markdown
Contributor

Changes

  • Refactor the script to remove unnecessary configurations.
  • Set VLLM_TARGET_DEVICE=rocm only when an AMD GPU is detected, with cuda as the default.

https://docs.vllm.ai/en/v0.4.3/serving/env_vars.html

image

@seokho-son
Copy link
Copy Markdown
Member

LGTM!

@seokho-son
Copy link
Copy Markdown
Member

/approve

@github-actions github-actions bot added the approved This PR is approved and will be merged soon. label Feb 23, 2026
@cb-github-robot cb-github-robot merged commit c039c32 into cloud-barista:main Feb 23, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved This PR is approved and will be merged soon.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants