Skip to content

Ensure only snapshot jdbc driver versions are testing when running check#89560

Merged
mark-vieira merged 1 commit intoelastic:mainfrom
mark-vieira:fix_jdbc_bwc_testing
Aug 24, 2022
Merged

Ensure only snapshot jdbc driver versions are testing when running check#89560
mark-vieira merged 1 commit intoelastic:mainfrom
mark-vieira:fix_jdbc_bwc_testing

Conversation

@mark-vieira
Copy link
Copy Markdown
Contributor

@mark-vieira mark-vieira commented Aug 23, 2022

This was an interesting find. Because of the way we distinguish between StandaloneRestIntegTestTask and RestIntegTestTask we were mistakenly running all BWC version tests when running the check task on the JDBC driver projects instead of only snapshot versions.

RestTestBasePlugin by convention wires all RestIntegTestTasks to the check task. For our BWC testing, we instead create StandaloneRestIntegTest tasks. These get fewer conventions applied, as they are typically used when manually wiring tasks, as is often the case with BWC testing. The JDBC driver tests are a form of BWC testing, but were mistakenly setup using RestIntegTestTask. We only want to test snapshot versions when running check. The full suite of versions gets testing in the periodic BWC job. This PR fixes this behavior such that we are only testing snapshot (in development) versions as expected.

This is a very easy mistake to make so there definitely room for improvement here in terms of developer convenience. You can see in this build scan how the check task depends on the full suite of versions incorrectly.

@elasticsearchmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-delivery (Team:Delivery)

@elasticsearchmachine elasticsearchmachine added v8.5.0 Team:Delivery Meta label for Delivery team labels Aug 23, 2022
Copy link
Copy Markdown
Contributor

@breskeby breskeby left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lgtm. Yeah long term one of those tasks will disappear and we apply the additional conventions in a different way and not by task type.

@elasticsearchmachine
Copy link
Copy Markdown
Collaborator

💔 Backport failed

Status Branch Result
8.4
7.17 Commit could not be cherrypicked due to conflicts

You can use sqren/backport to manually backport by running backport --upstream elastic/elasticsearch --pr 89560

mark-vieira added a commit to mark-vieira/elasticsearch that referenced this pull request Aug 24, 2022
…eck (elastic#89560)

# Conflicts:
#	x-pack/plugin/sql/qa/jdbc/build.gradle
elasticsearchmachine pushed a commit that referenced this pull request Aug 24, 2022
…eck (#89560) (#89596)

# Conflicts:
#	x-pack/plugin/sql/qa/jdbc/build.gradle
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Delivery/Build Build or test infrastructure >non-issue Team:Delivery Meta label for Delivery team test-full-bwc Trigger full BWC version matrix tests v7.17.7 v8.4.1 v8.5.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants