Skip to content

AI usecase supporting scripts vllm and netdata#2252

Merged
cb-github-robot merged 2 commits intocloud-barista:mainfrom
seokho-son:main
Jan 5, 2026
Merged

AI usecase supporting scripts vllm and netdata#2252
cb-github-robot merged 2 commits intocloud-barista:mainfrom
seokho-son:main

Conversation

@seokho-son
Copy link
Copy Markdown
Member

@seokho-son seokho-son commented Jan 5, 2026

Adds AI infrastructure supporting scripts for

  • deploying vLLM (a high-throughput LLM inference engine)
  • Netdata (system monitoring agent),
  • enhancements to the CUDA driver installation script to support NVSwitch/Fabric Manager for multi-GPU systems.

Signed-off-by: Seokho Son <shsongist@gmail.com>
Copilot AI review requested due to automatic review settings January 5, 2026 04:54
@seokho-son seokho-son requested a review from yunkon-kim as a code owner January 5, 2026 04:54
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This pull request adds AI infrastructure supporting scripts for deploying vLLM (a high-throughput LLM inference engine) and Netdata (system monitoring agent), along with enhancements to the CUDA driver installation script to support NVSwitch/Fabric Manager for multi-GPU systems.

Key Changes:

  • Added automated NVSwitch detection and NVIDIA Fabric Manager installation for H100/A100 multi-GPU systems
  • Created vLLM deployment script with virtual environment setup, installation automation, and OpenAI-compatible API server helper
  • Created Netdata monitoring agent installation script for real-time system performance monitoring

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 11 comments.

File Description
scripts/usecases/llm/installCudaDriver.sh Enhanced to detect NVSwitch topology and automatically install/configure NVIDIA Fabric Manager for multi-GPU systems
scripts/usecases/llm/deployvLLM.sh New script that installs vLLM in a Python virtual environment and creates a helper script for serving LLM models via OpenAI-compatible API
scripts/usecases/llm/deployNetdataMonitor.sh New script that installs and configures Netdata monitoring agent using the official kickstart script

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@seokho-son seokho-son force-pushed the main branch 2 times, most recently from cd368f4 to 7dc3c23 Compare January 5, 2026 05:17
Signed-off-by: Seokho Son <shsongist@gmail.com>
@seokho-son
Copy link
Copy Markdown
Member Author

/approve

@github-actions github-actions bot added the approved This PR is approved and will be merged soon. label Jan 5, 2026
@cb-github-robot cb-github-robot merged commit b5d9c2f into cloud-barista:main Jan 5, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved This PR is approved and will be merged soon.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants