Skip to content

[O11y][MySQL] Rally benchmark mysql.galera_status#8923

Merged
ali786XI merged 14 commits intoelastic:mainfrom
ali786XI:mysql_benchmark_galera_status
Feb 7, 2024
Merged

[O11y][MySQL] Rally benchmark mysql.galera_status#8923
ali786XI merged 14 commits intoelastic:mainfrom
ali786XI:mysql_benchmark_galera_status

Conversation

@ali786XI
Copy link
Copy Markdown
Contributor

@ali786XI ali786XI commented Jan 18, 2024 •
edited
Loading

Proposed commit message

  • This PR adds benchmarking templates to the galera_status data stream of MySQL

Note:- There might be some elastic-package check commands changes related to previous PRs on rally which I have fixed in this. Ignore them in case of reviewing only Rally changes

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.

How to test this PR locally

Run this command from package root

  • elastic-package benchmark rally --benchmark galera_status-benchmark -v
  • elastic-package benchmark stream --benchmark galera_status-benchmark -v

Related issues

Screenshots

--- Benchmark results for package: mysql - START ---
╭────────────────────────────────────────────────────────────────────────────────────╮
│ info                                                                               │
├────────────────────────┬───────────────────────────────────────────────────────────┤
│ benchmark              │                                    galerastatus-benchmark │
│ description            │       Benchmark 20000 mysql.galera_status events ingested │
│ run ID                 │                      b3aabecf-0f99-48db-89e9-09c0d4d21c78 │
│ package                │                                                     mysql │
│ start ts (s)           │                                                1705557115 │
│ end ts (s)             │                                                1705557163 │
│ duration               │                                                       48s │
│ generated corpora file │ /root/.elastic-package/tmp/rally_corpus/corpus-2158553113 │
╰────────────────────────┴───────────────────────────────────────────────────────────╯
╭────────────────────────────────────────────────────────────────────────────╮
│ parameters                                                                 │
├─────────────────────────────────┬──────────────────────────────────────────┤
│ package version                 │                                   1.17.0 │
│ data_stream.name                │                            galera_status │
│ corpora.generator.total_events  │                                    20000 │
│ corpora.generator.template.path │ ./galerastatus-benchmark/template.ndjson │
│ corpora.generator.template.raw  │                                          │
│ corpora.generator.template.type │                                   gotext │
│ corpora.generator.config.path   │      ./galerastatus-benchmark/config.yml │
│ corpora.generator.config.raw    │                                    map[] │
│ corpora.generator.fields.path   │      ./galerastatus-benchmark/fields.yml │
│ corpora.generator.fields.raw    │                                    map[] │
╰─────────────────────────────────┴──────────────────────────────────────────╯
╭───────────────────────╮
│ cluster info          │
├───────┬───────────────┤
│ name  │ elasticsearch │
│ nodes │             1 │
╰───────┴───────────────╯
╭───────────────────────────────────────╮
│ disk usage for index metrics-mysql.ga │
│ lera_status-ep (for all fields)       │
├──────────────────────────────┬────────┤
│ total                        │ 9.6 MB │
│ inverted_index.total         │ 1.3 MB │
│ inverted_index.stored_fields │ 5.5 MB │
│ inverted_index.doc_values    │ 2.5 MB │
│ inverted_index.points        │ 288 kB │
│ inverted_index.norms         │    0 B │
│ inverted_index.term_vectors  │    0 B │
│ inverted_index.knn_vectors   │    0 B │
╰──────────────────────────────┴────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ rally stats                                                                                 │
├────────────────────────────────────────────────────────────────┬────────────────────────────┤
│ Cumulative indexing time of primary shards                     │     2.6696166666666667 min │
│ Min cumulative indexing time across primary shards             │                      0 min │
│ Median cumulative indexing time across primary shards          │                 0.0203 min │
│ Max cumulative indexing time across primary shards             │                0.81555 min │
│ Cumulative indexing throttle time of primary shards            │                      0 min │
│ Min cumulative indexing throttle time across primary shards    │                      0 min │
│ Median cumulative indexing throttle time across primary shards │                    0.0 min │
│ Max cumulative indexing throttle time across primary shards    │                      0 min │
│ Cumulative merge time of primary shards                        │    0.44018333333333337 min │
│ Cumulative merge count of primary shards                       │                        349 │
│ Min cumulative merge time across primary shards                │                      0 min │
│ Median cumulative merge time across primary shards             │                    0.0 min │
│ Max cumulative merge time across primary shards                │    0.07106666666666667 min │
│ Cumulative merge throttle time of primary shards               │                      0 min │
│ Min cumulative merge throttle time across primary shards       │                      0 min │
│ Median cumulative merge throttle time across primary shards    │                    0.0 min │
│ Max cumulative merge throttle time across primary shards       │                      0 min │
│ Cumulative refresh time of primary shards                      │     0.9774666666666667 min │
│ Cumulative refresh count of primary shards                     │                      11469 │
│ Min cumulative refresh time across primary shards              │                      0 min │
│ Median cumulative refresh time across primary shards           │   0.013508333333333334 min │
│ Max cumulative refresh time across primary shards              │    0.23248333333333332 min │
│ Cumulative flush time of primary shards                        │      17.28853333333333 min │
│ Cumulative flush count of primary shards                       │                      11202 │
│ Min cumulative flush time across primary shards                │ 1.6666666666666667e-05 min │
│ Median cumulative flush time across primary shards             │                 0.0231 min │
│ Max cumulative flush time across primary shards                │     3.2431833333333335 min │
│ Total Young Gen GC time                                        │                    0.033 s │
│ Total Young Gen GC count                                       │                          3 │
│ Total Old Gen GC time                                          │                        0 s │
│ Total Old Gen GC count                                         │                          0 │
│ Store size                                                     │     0.11293432861566544 GB │
│ Translog size                                                  │    0.041520082391798496 GB │
│ Heap used for segments                                         │                       0 MB │
│ Heap used for doc values                                       │                       0 MB │
│ Heap used for terms                                            │                       0 MB │
│ Heap used for norms                                            │                       0 MB │
│ Heap used for points                                           │                       0 MB │
│ Heap used for stored fields                                    │                       0 MB │
│ Segment count                                                  │                        485 │
│ Total Ingest Pipeline count                                    │                      20046 │
│ Total Ingest Pipeline time                                     │                    1.414 s │
│ Total Ingest Pipeline failed                                   │                          0 │
│ Min Throughput                                                 │            26415.43 docs/s │
│ Mean Throughput                                                │            26415.43 docs/s │
│ Median Throughput                                              │            26415.43 docs/s │
│ Max Throughput                                                 │            26415.43 docs/s │
│ 50th percentile latency                                        │       699.0864200051874 ms │
│ 100th percentile latency                                       │       808.1832510069944 ms │
│ 50th percentile service time                                   │       699.0864200051874 ms │
│ 100th percentile service time                                  │       808.1832510069944 ms │
│ error rate                                                     │                     0.00 % │
╰────────────────────────────────────────────────────────────────┴────────────────────────────╯

--- Benchmark results for package: mysql - END   ---
Done

@ali786XI ali786XI self-assigned this Jan 18, 2024
@ali786XI ali786XI added enhancement New feature or request Integration:mysql MySQL labels Jan 18, 2024
@ali786XI ali786XI mentioned this pull request Jan 18, 2024
Closed
@elasticmachine
Copy link
Copy Markdown

elasticmachine commented Jan 18, 2024 •
edited
Loading

🚀 Benchmarks report

To see the full report comment with /test benchmark fullreport

@ali786XI ali786XI marked this pull request as ready for review January 19, 2024 05:59
@ali786XI ali786XI requested a review from a team as a code owner January 19, 2024 05:59
@tommyers-elastic tommyers-elastic changed the title [O11y][MySQL] Rally benchmark nginx.galera_status [O11y][MySQL] Rally benchmark mysql.galera_status Jan 24, 2024
@elasticmachine
Copy link
Copy Markdown

elasticmachine commented Feb 7, 2024

💚 Build Succeeded

History

cc @aliabbas-elastic

@elastic-sonarqube
Copy link
Copy Markdown

elastic-sonarqube bot commented Feb 7, 2024

Quality Gate passed Quality Gate passed

Kudos, no new issues were introduced!

0 New issues
0 Security Hotspots
No Coverage information No data about Coverage
No Duplication information No data about Duplication

See analysis details on SonarQube

@ali786XI ali786XI merged commit 3bf73eb into elastic:main Feb 7, 2024
@ali786XI ali786XI mentioned this pull request Feb 7, 2024
Closed
29 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@tommyers-elastic tommyers-elastic tommyers-elastic approved these changes

+1 more reviewer

@milan-elastic milan-elastic milan-elastic approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

@ali786XI ali786XI

Labels

enhancement New feature or request Integration:mysql MySQL Integration:nginx Nginx

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@ali786XI @elasticmachine @tommyers-elastic @milan-elastic @andrewkroh