Skip to content

Update ramble modules to have data file management#1837

Merged
nick-stroud merged 5 commits into
GoogleCloudPlatform:developfrom
douglasjacobsen:ramble-data-files
Oct 19, 2023
Merged

Update ramble modules to have data file management#1837
nick-stroud merged 5 commits into
GoogleCloudPlatform:developfrom
douglasjacobsen:ramble-data-files

Conversation

@douglasjacobsen

Copy link
Copy Markdown
Collaborator

This merge updates the ramble modules to have similar functionality to the spack modules, including data file creation / transfer.

Submission Checklist

Please take the following actions before submitting this pull request.

  • Fork your PR branch from the Toolkit "develop" branch (not main)
  • Test all changes with pre-commit in a local branch #
  • Confirm that "make tests" passes all tests
  • Add or modify unit tests to cover code changes
  • Ensure that unit test coverage remains above 80%
  • Update all applicable documentation
  • Follow Cloud HPC Toolkit Contribution guidelines #

This commit updates the ramble modules to have similar functionality to
the spack modules, including data file creation / transfer.
@douglasjacobsen douglasjacobsen added the release-module-improvements Added to release notes under the "Module Improvements" heading. label Oct 13, 2023
Previously, the spack and ramble execute modules assumed a gcs bucket
was passed in (to allow them to be chained together). This commit
updates both modules to allow the execute and setup to be used
independently.
Comment thread community/modules/scripts/spack-execute/outputs.tf Outdated
Comment thread community/modules/scripts/spack-execute/main.tf Outdated
Comment thread community/modules/scripts/ramble-setup/outputs.tf Outdated
Comment thread community/modules/scripts/ramble-setup/outputs.tf Outdated
Comment thread community/modules/scripts/ramble-execute/main.tf Outdated
Comment thread community/modules/scripts/ramble-execute/main.tf Outdated
Comment thread community/modules/scripts/ramble-execute/outputs.tf Outdated
Comment thread community/modules/scripts/ramble-execute/variables.tf Outdated
Comment thread community/modules/scripts/ramble-execute/variables.tf Outdated
Comment thread tools/duplicate-diff.py
Comment thread community/modules/scripts/ramble-execute/variables.tf
Comment thread community/modules/scripts/spack-execute/variables.tf Outdated
Comment thread community/modules/scripts/spack-execute/main.tf Outdated
Comment thread community/modules/scripts/spack-execute/variables.tf Outdated
Comment thread community/modules/scripts/spack-execute/main.tf Outdated
Comment thread community/modules/scripts/ramble-execute/main.tf Outdated
Comment thread community/modules/scripts/ramble-execute/variables.tf Outdated
@nick-stroud

Copy link
Copy Markdown
Collaborator

My comments are under the assumption that the following usage is permitted:

spack-execute: use: [spack-setup] required
ramble-execute: use: [ramble-setup] required
ramble-execute: use: [spack-setup] optional

If we get a little down the road and we want to change these assumptions, and the expression of theses assumptions in the code, I think that is fine. But if the above are our expectations then the code should reflect that.

@nick-stroud

Copy link
Copy Markdown
Collaborator

Running tests.

@nick-stroud nick-stroud merged commit 2e51fc7 into GoogleCloudPlatform:develop Oct 19, 2023
@mr0re1 mr0re1 mentioned this pull request Nov 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

release-module-improvements Added to release notes under the "Module Improvements" heading.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants