Skip to content

[scalability testing] extend FTR config with optional scalability configuration#132047

Merged
dmlemeshko merged 2 commits intoelastic:mainfrom
dmlemeshko:extend-ftr-config-for-scalability
May 11, 2022
Merged

[scalability testing] extend FTR config with optional scalability configuration#132047
dmlemeshko merged 2 commits intoelastic:mainfrom
dmlemeshko:extend-ftr-config-for-scalability

Conversation

@dmlemeshko
Copy link
Copy Markdown
Contributor

@dmlemeshko dmlemeshko commented May 11, 2022 •
edited
Loading

Summary

Closes #131498

This PR changes FTR config schema to support optional configuration that includes:

  • ES & KBN archives, that will be loaded during beforeTests FTR lifecycle phase and unloaded during cleanup phase
testData: {
  kbnArchives: [
    'test/functional/fixtures/kbn_archiver/many_fields_data_view'
  ],
  esArchives: [
    'test/functional/fixtures/es_archiver/many_fields'
  ]
}
  • Scalability benchmarking data, that defines the setup for auto-generated Gatling simulation:
    • both warmup and test phases and scalability run maxDuration are required
    • at least single stage should be defined in each phase
    • 2 Gatling setup actions are supported: constantConcurrentUsers & rampConcurrentUsers
    • constantConcurrentUsers requires only maxUsersCount
    • rampConcurrentUsers requires both minUsersCount and maxUsersCount
    • duration / maxDuration supports format [number][m|s], e.g. 90s (90 seconds), 5m (5 minutes)
    scalabilitySetup: {
      warmup: {
        stages: [
          {
            action: 'constantConcurrentUsers',
            maxUsersCount: 20,
            duration: '90s',
          },
        ],
      },
      test: {
        stages: [
          {
            action: 'rampConcurrentUsers',
            minUsersCount: 20,
            maxUsersCount: 100,
            duration: '2m',
          },
          {
            action: 'constantConcurrentUsers',
            maxUsersCount: 100,
            duration: '5m',
          },
        ],
      },
      maxDuration: '10m',
    },

@dmlemeshko dmlemeshko added wg:performance Work tracked by the performance workgroup v8.3.0 release_note:skip Skip the PR/issue when compiling release notes labels May 11, 2022
spalger
spalger approved these changes May 11, 2022
View reviewed changes
Copy link
Copy Markdown
Contributor

@spalger spalger left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Little nit, but LGTM

@dmlemeshko dmlemeshko marked this pull request as ready for review May 11, 2022 17:02
@dmlemeshko dmlemeshko requested a review from a team as a code owner May 11, 2022 17:02
@kibana-ci
Copy link
Copy Markdown

kibana-ci commented May 11, 2022

💚 Build Succeeded

Metrics [docs]

✅ unchanged

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@dmlemeshko dmlemeshko merged commit 80427ea into elastic:main May 11, 2022
@kibanamachine kibanamachine added the backport:skip This PR does not require backporting label May 11, 2022
This was referenced May 12, 2022
Open
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@danielmitterdorfer danielmitterdorfer Awaiting requested review from danielmitterdorfer

@suchcodemuchwow suchcodemuchwow Awaiting requested review from suchcodemuchwow

1 more reviewer

@spalger spalger spalger approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

backport:skip This PR does not require backporting release_note:skip Skip the PR/issue when compiling release notes v8.3.0 wg:performance Work tracked by the performance workgroup

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Extend FTR config file with optional scalability benchmarking metadata

4 participants

@dmlemeshko @kibana-ci @spalger @kibanamachine