Skip to content

apmbench: Support multiple apm servers in cloud#8119

Merged
marclop merged 2 commits intoelastic:mainfrom
marclop:f/support-multiple-apm-server-instances-behind-cloud-proxy
May 25, 2022
Merged

apmbench: Support multiple apm servers in cloud#8119
marclop merged 2 commits intoelastic:mainfrom
marclop:f/support-multiple-apm-server-instances-behind-cloud-proxy

Conversation

@marclop
Copy link
Copy Markdown
Contributor

@marclop marclop commented May 17, 2022

Motivation/summary

Adds support for benchmarking multiple APM Servers running in ESS / ECE
behind the cloud proxy. It uses the cloud proxy response headers and
auto-discovers the number of APM Servers respond to the /debug/vars
requests, and aggregates the final responses.

Checklist

- [ ] Update CHANGELOG.asciidoc
- [ ] Update package changelog.yml (only if changes to apmpackage have been made)
- [ ] Documentation has been updated

How to test these changes

  1. cd testing/benchmark
  2. make terraform.tfvars
  3. Set the following settings in terraform.tfvars:
apm_server_size = "4g"
apm_server_zone_count = 2
elasticsearch_size = "8g"
worker_instance_type = "c6i.2xlarge"
  1. make
  2. make run-benchmark BENCHMARK_AGENTS=1000 BENCHMARK_WARMUP=0 BENCHMARK_TIME=1m
    Warm up timeouts seem to be broken atm that's why they're set to 0.

Related issues

Closes #7841

Adds support for benchmarking multiple APM Servers running in ESS / ECE
behind the cloud proxy. It uses the cloud proxy response headers and
auto-discovers the number of APM Servers respond to the `/debug/vars`
requests, and aggregates the final responses.

Signed-off-by: Marc Lopez Rubio <marc5.12@outlook.com>
@marclop marclop added benchmarking backport-skip Skip notification from the automated backport with mergify v8.3.0 labels May 17, 2022
@marclop marclop requested a review from a team May 17, 2022 08:32
@ghost
Copy link
Copy Markdown

ghost commented May 17, 2022

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

Build stats

  • Start Time: 2022-05-25T06:35:30.075+0000

  • Duration: 29 min 19 sec

Test stats 🧪

Test Results
Failed 0
Passed 3990
Skipped 13
Total 4003

🤖 GitHub comments

To re-run your PR in the CI, just comment with:

  • /test : Re-trigger the build.

  • /hey-apm : Run the hey-apm benchmark.

  • /package : Generate and publish the docker images.

  • /test windows : Build & tests on Windows.

  • run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

@ghost
Copy link
Copy Markdown

ghost commented May 17, 2022

🌐 Coverage report

Name Metrics % (covered/total) Diff
Packages 100.0% (42/42) 💚
Files 91.878% (181/197) 👍
Classes 93.392% (424/454) 👍
Methods 89.156% (1077/1208) 👎 -0.083
Lines 76.844% (13118/17071) 👍
Conditionals 100.0% (0/0) 💚

Comment thread systemtest/benchtest/expvar.go
@marclop marclop enabled auto-merge (squash) May 25, 2022 06:35
@marclop marclop merged commit b08ae36 into elastic:main May 25, 2022
@marclop marclop deleted the f/support-multiple-apm-server-instances-behind-cloud-proxy branch May 25, 2022 07:05
Comment thread systemtest/benchtest/expvar.go
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport-skip Skip notification from the automated backport with mergify benchmarking test-plan v8.3.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

apmbench: Support multi-node APM Server deployment through cloud proxy

4 participants