Skip to content

Add Load Tests GBK Dataflow Batch Go workflow#28449

Merged
damccorm merged 2 commits intoapache:masterfrom
akvelon:load-tests-go-gbk-github-actions
Sep 21, 2023
Merged

Add Load Tests GBK Dataflow Batch Go workflow#28449
damccorm merged 2 commits intoapache:masterfrom
akvelon:load-tests-go-gbk-github-actions

Conversation

@Amar3tto
Copy link
Copy Markdown
Collaborator

The following jenkins job has been migrated:

https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch
https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch_PR

How has it been tested?

The job has been tested on Self-hosted GKE runners ubuntu 20.04.
The following test cases are passed:

  • by adding a comment to the PR

Screenshot from 2023-09-14 11-19-24


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
  • Update CHANGES.md with noteworthy changes.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests
Go tests

See CI.md for more information about GitHub Actions CI or the workflows README to see a list of phrases to trigger workflows.

@github-actions github-actions bot added the build label Sep 14, 2023
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure about the correct answer, but could we implement a matrix of file names here and execute them all in parallel? Is this suitable for load testing?
For example, a matrix could be: file_names: [config_GBK_Go_Batch_10b.txt, config_GBK_Go_Batch_100b.txt, ..., etc]. The other steps seem similar.
Thank you.

Copy link
Copy Markdown
Collaborator Author

@Amar3tto Amar3tto Sep 15, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think no, because:

  • there is no need to run 2MB test if 10KB test is failing
  • sometimes in load tests we have steps that should be done before one bunch of tests (e.g. start flink) and some steps before another bunch (e.g. restart flink), and some steps that should be done only after all tests (e.g. teardown flink)

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree with not doing it via matrix, but could we simplify this with a list/loop? If its ugly in bash, we could also consider https://github.com/actions/github-script

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

@Amar3tto Amar3tto force-pushed the load-tests-go-gbk-github-actions branch from a8593e1 to c6ba677 Compare September 18, 2023 08:10
@Amar3tto Amar3tto marked this pull request as ready for review September 18, 2023 08:10
@github-actions
Copy link
Copy Markdown
Contributor

Assigning reviewers. If you would like to opt out of this review, comment assign to next reviewer:

R: @damccorm for label build.

Available commands:

  • stop reviewer notifications - opt out of the automated review tooling
  • remind me after tests pass - tag the comment author after tests pass
  • waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

The PR bot will only process comments in the main thread (not review comments).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think I mentioned this on another pr, but could we add an explanatory comment describing why we're doing this step? It is hard to determine intent from reading the code.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree with not doing it via matrix, but could we simplify this with a list/loop? If its ugly in bash, we could also consider https://github.com/actions/github-script

Copy link
Copy Markdown
Contributor

@damccorm damccorm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@damccorm
Copy link
Copy Markdown
Contributor

Looks like there are conflicts, please resolve and I'll merge

@Amar3tto Amar3tto force-pushed the load-tests-go-gbk-github-actions branch from daf19b3 to 7c06607 Compare September 21, 2023 15:04
@Amar3tto
Copy link
Copy Markdown
Collaborator Author

Looks like there are conflicts, please resolve and I'll merge

Resolved

@damccorm damccorm merged commit 18ce60c into apache:master Sep 21, 2023
kennknowles pushed a commit to kennknowles/beam that referenced this pull request Sep 22, 2023
* Add Load Tests GBK Dataflow Batch Go workflow

* Refactoring
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants