Skip to content

Run Engine tests in dev Engine (on top of stable Engine)#5652

Merged
gerhard merged 2 commits intodagger:mainfrom
gerhard:test-engine-in-dev-engine
Aug 17, 2023
Merged

Run Engine tests in dev Engine (on top of stable Engine)#5652
gerhard merged 2 commits intodagger:mainfrom
gerhard:test-engine-in-dev-engine

Conversation

@gerhard
Copy link
Copy Markdown
Contributor

@gerhard gerhard commented Aug 17, 2023

So that we can find potential failures earlier, as we've learned from v0.8.0 & v0.8.3 releases. cc @sipsma @vito

Allow PRs to use both Dagger runners & paid GitHub runners (same size). It's OK if these fail for now - continue-on-error - since we seem to have a configuration issue on the self-hosted runners themselves (they are attempting to use the same Engine). We can follow-up with a fix. cc @jlongtine

By the way, if we like this change, we can roll it out to other jobs - supersedes #5359


Stop uploading journal.log. Since we are reusing workflows, we cannot easily determine the journal log file name (the same one gets overwritten by different workflows). If we use inputs.mage-targets to distinguish, this fails since it contains :, an unsupported character by the upload-artifact action. We could do this better (e.g. by requiring another input, by handling this in code, etc.), but I am unsure what is the current value of journal.log when we use Dagger Cloud. Removing it for now, let's see if others miss it.

Signed-off-by: Gerhard Lazu <gerhard@dagger.io>
@gerhard gerhard changed the title Test engine in dev engine PR WORKFLOW TEST - Mean to be closed, not merged: Test engine in dev engine Aug 17, 2023
@gerhard gerhard changed the title PR WORKFLOW TEST - Mean to be closed, not merged: Test engine in dev engine Test Engine in dev Engine Aug 17, 2023
@gerhard gerhard changed the title Test Engine in dev Engine Run Engine tests in dev Engine (on top of stable Engine) Aug 17, 2023
So that we can find potential failures earlier, as we've learned from
v0.8.0 & v0.8.3 releases.

Allow PRs to use both Dagger runners & paid GitHub runners (same size).
It's OK if these fail for now - `continue-on-error` - since we seem to
have a configuration issue on the self-hosted runners themselves (they
are attempting to use the same Engine). We can follow-up with a fix.

By the way, if we like this change, we can roll it out to other jobs
- supersedes #5359

Stop uploading journal.log. Since we are reusing workflows, we cannot
easily determine the journal log file name (the same one gets
overwritten by different workflows). If we use inputs.mage-targets to
distinguish, this fails since it contains ':', an unsupported character
by the upload-artifact action. We could do this better (e.g. by
requiring another input, by handling this in code, etc.), but I am
unsure what is the current value of journal.log when we use Dagger
Cloud. Removing it for now, let's see if others miss it.

Signed-off-by: Gerhard Lazu <gerhard@dagger.io>
@gerhard gerhard requested review from aluzzardi, jlongtine, sipsma and vito and removed request for aluzzardi, sipsma and vito August 17, 2023 15:59
@gerhard gerhard marked this pull request as ready for review August 17, 2023 15:59
@gerhard
Copy link
Copy Markdown
Contributor Author

gerhard commented Aug 17, 2023

Engine tests ran successfully in a dev Engine: https://github.com/dagger/dagger/actions/runs/5893199071/job/15984222717?pr=5652#step:4:517

image

The dagger-runner failures are expected & the jobs use continue-on-error as a result. Something worth looking into as a follow-up, for sure. cc @jlongtine

Copy link
Copy Markdown
Contributor

@sipsma sipsma left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great, thanks! Gonna save us all a lot of pain!

@gerhard
Copy link
Copy Markdown
Contributor Author

gerhard commented Aug 17, 2023

Another issue that this PR is going to help address: https://github.com/dagger/dagger/actions/runs/5893416043/job/15984907482#step:5:182

image

@gerhard gerhard merged commit 32700f5 into dagger:main Aug 17, 2023
@gerhard gerhard deleted the test-engine-in-dev-engine branch August 17, 2023 18:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants