Skip to content

Add run_guidellm.sh script for GPU benchmarking with GuideLLM#2333

Merged
cb-github-robot merged 3 commits intocloud-barista:mainfrom
leehyeoklee:gpu-telemetry
Mar 2, 2026
Merged

Add run_guidellm.sh script for GPU benchmarking with GuideLLM#2333
cb-github-robot merged 3 commits intocloud-barista:mainfrom
leehyeoklee:gpu-telemetry

Conversation

@leehyeoklee
Copy link
Copy Markdown
Contributor

Add GuideLLM-based vLLM Benchmarking Script

Overview

Added run_guidellm.sh script for benchmarking vLLM inference servers using the official GuideLLM tool.

image

💾 Result Management

  • Timestamped output directories: results_<IP>_<TIMESTAMP>/
  • Multiple formats: JSON (detailed), CSV (tabular), HTML (visual)
  • Prevents result overwriting across multiple runs
  • Results stored in ~/guidellm_bench/
image

Usage Examples

Basic Synthetic Benchmark:

./run_guidellm.sh --ip 99.79.191.224

HuggingFace Dataset:

./run_guidellm.sh --ip 99.79.191.224 \
  --data "abisee/cnn_dailymail" \
  --data-args '{"name":"3.0.0"}' \
  --data-column-mapper '{"text_column":"article"}' \
  --data-samples 1000

Copy link
Copy Markdown
Member

@seokho-son seokho-son left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@leehyeoklee Please remove Korean comments in this PR. :)
Using Korean in the source code is not recommended in this repo.

@leehyeoklee
Copy link
Copy Markdown
Contributor Author

@seokho-son
I got it. 😊 I've updated the PR to remove the Korean comments!

@seokho-son
Copy link
Copy Markdown
Member

/approve

Thanks!

@github-actions github-actions bot added the approved This PR is approved and will be merged soon. label Mar 2, 2026
@cb-github-robot cb-github-robot merged commit b9bbd2d into cloud-barista:main Mar 2, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved This PR is approved and will be merged soon.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants