Skip to content

More regression tests#14973

Merged
Mytherin merged 12 commits intoduckdb:mainfrom
lnkuiper:fivetran_regression
Nov 29, 2024
Merged

More regression tests#14973
Mytherin merged 12 commits intoduckdb:mainfrom
lnkuiper:fivetran_regression

Conversation

@lnkuiper
Copy link
Copy Markdown
Collaborator

No description provided.

@duckdb-draftbot duckdb-draftbot marked this pull request as draft November 26, 2024 09:37
@lnkuiper lnkuiper marked this pull request as ready for review November 26, 2024 09:38
@duckdb-draftbot duckdb-draftbot marked this pull request as draft November 27, 2024 11:45
@lnkuiper lnkuiper marked this pull request as ready for review November 28, 2024 10:56
Copy link
Copy Markdown
Contributor

@carlopi carlopi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Two comments, but cool stuff.

@duckdb-draftbot duckdb-draftbot marked this pull request as draft November 28, 2024 13:22
@lnkuiper lnkuiper marked this pull request as ready for review November 28, 2024 13:22
Comment on lines +93 to +94
git clone https://github.com/duckdb/duckdb.git
git checkout $(gh run list --repo duckdb/duckdb --branch=main --workflow=Regression --status=success --json=headSha --limit=1 --jq '.[0].headSha')
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am not sure of the syntax here, I think it should be:

git clone https://github.com/duckdb/duckdb.git
cd duckdb
git checkout $(gh run list --repo duckdb/duckdb --branch=main --workflow=Regression --status=success --json=headSha --limit=1 --jq '.[0].headSha')
cd ..
make
cd duckdb
make
cd ..

this is since you need to checkout the repo in the duckdb folder / keep the workflows as similar as possible (same direction of what's new and what's old)

@duckdb-draftbot duckdb-draftbot marked this pull request as draft November 28, 2024 15:04
@lnkuiper lnkuiper marked this pull request as ready for review November 28, 2024 15:25
run: |
make
git clone https://github.com/duckdb/duckdb.git
git checkout $(gh run list --repo duckdb/duckdb --branch=main --workflow=Regression --status=success --json=headSha --limit=1 --jq '.[0].headSha')
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
git checkout $(gh run list --repo duckdb/duckdb --branch=main --workflow=Regression --status=success --json=headSha --limit=1 --jq '.[0].headSha')
cd duckdb && git checkout $(gh run list --repo duckdb/duckdb --branch=main --workflow=Regression --status=success --json=headSha --limit=1 --jq '.[0].headSha') && cd ..

Me again 👋, I think checkout needs to be done IN the duckdb folder.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think adding this suggestion + merging is cool to me

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry I was not paying attention well, I think it should be good now

@duckdb-draftbot duckdb-draftbot marked this pull request as draft November 29, 2024 07:44
@lnkuiper lnkuiper marked this pull request as ready for review November 29, 2024 07:45
@Mytherin Mytherin merged commit a5b1742 into duckdb:main Nov 29, 2024
@Mytherin
Copy link
Copy Markdown
Collaborator

Thanks!

Mytherin added a commit that referenced this pull request Dec 2, 2024
Since #14973, our nightly no longer runs regressions against itself
(always succeeding) but against the last successful nightly regression,
now sometimes failing. This has caught a [CSV
regression](https://github.com/duckdb/duckdb/actions/runs/12110544726/job/33761104729#step:17:228).

If we don't fix this regression, subsequent workflow runs will fail
indefinitely. Sometimes, however, we want to accept regressions, for
example, so the CSV reader can parse more timestamp types (at the cost
of taking more time - at least, I think that's what's happening here).
In such cases, we need to re-run the regression workflow against itself
so that it succeeds.

This PR adds an input parameter to run the regression test against a
specific DuckDB version. This would also allow us to run the current
main against v.1.13.
krlmlr added a commit to duckdb/duckdb-r that referenced this pull request Dec 27, 2024
Fix extension entries (duckdb/duckdb#15027)
[PySpark] Add more functions such as slice, split, standard deviations, etc. (duckdb/duckdb#14863)
More regression tests (duckdb/duckdb#14973)
github-actions bot pushed a commit to duckdb/duckdb-r that referenced this pull request Dec 27, 2024
Fix extension entries (duckdb/duckdb#15027)
[PySpark] Add more functions such as slice, split, standard deviations, etc. (duckdb/duckdb#14863)
More regression tests (duckdb/duckdb#14973)
github-actions bot added a commit to duckdb/duckdb-r that referenced this pull request Dec 27, 2024
Fix extension entries (duckdb/duckdb#15027)
[PySpark] Add more functions such as slice, split, standard deviations, etc. (duckdb/duckdb#14863)
More regression tests (duckdb/duckdb#14973)

Co-authored-by: krlmlr <krlmlr@users.noreply.github.com>
@lnkuiper lnkuiper deleted the fivetran_regression branch April 14, 2025 09:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants