Skip to content

KAFKA-14209 : Integration tests 3/3#12676

Merged
vvcephei merged 2 commits into
apache:trunkfrom
vpapavas:self-join-integration-test
Oct 7, 2022
Merged

KAFKA-14209 : Integration tests 3/3#12676
vvcephei merged 2 commits into
apache:trunkfrom
vpapavas:self-join-integration-test

Conversation

@vpapavas

Copy link
Copy Markdown
Contributor

Integration test and upgrade test for the self-join rewriting. The upgrade test ensures that a user does not lose data if they have a topology without the rewriting and then turn-on the rewriting.

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

@vvcephei vvcephei left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, @vpapavas !

This looks good to me overall, just two points:

  1. I was confused by the name of a test (see below)
  2. What's the contract if you run with the flag enabled and then disable it? I assume you have to reset the application, since we would have only the LHS store populated. Is there any warning or error that we produce? If so, then we should test for it. If not, then we should make sure it's well documented.

@vvcephei vvcephei left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, @vpapavas !

After discussing offline, we'll rename this method and file a follow-on task to clarify the docs that disabling the optimization once enabled is not supported (an application reset would be required). This is pretty typical for optimizations anyway.

That update is orthogonal to this test, though, so it need not block this PR.

@vvcephei

vvcephei commented Oct 7, 2022

Copy link
Copy Markdown
Contributor

These test failures are not related:

[Build / JDK 8 and Scala 2.12 / kafka.api.TransactionsTest.testAbortTransactionTimeout(String).quorum=zk](https://ci-builds.apache.org/job/Kafka/job/kafka-pr/job/PR-12676/3/testReport/junit/kafka.api/TransactionsTest/Build___JDK_8_and_Scala_2_12___testAbortTransactionTimeout_String__quorum_zk/)
    [Build / JDK 17 and Scala 2.13 / kafka.api.TransactionsExpirationTest.testTransactionAfterProducerIdExpires(String).quorum=kraft](https://ci-builds.apache.org/job/Kafka/job/kafka-pr/job/PR-12676/3/testReport/junit/kafka.api/TransactionsExpirationTest/Build___JDK_17_and_Scala_2_13___testTransactionAfterProducerIdExpires_String__quorum_kraft/)
    [Build / JDK 17 and Scala 2.13 / org.apache.kafka.streams.integration.SmokeTestDriverIntegrationTest.shouldWorkWithRebalance](https://ci-builds.apache.org/job/Kafka/job/kafka-pr/job/PR-12676/3/testReport/junit/org.apache.kafka.streams.integration/SmokeTestDriverIntegrationTest/Build___JDK_17_and_Scala_2_13___shouldWorkWithRebalance/)
    [Build / JDK 17 and Scala 2.13 / org.apache.kafka.trogdor.coordinator.CoordinatorTest.testTaskRequestWithOldStartMsGetsUpdated()](https://ci-builds.apache.org/job/Kafka/job/kafka-pr/job/PR-12676/3/testReport/junit/org.apache.kafka.trogdor.coordinator/CoordinatorTest/Build___JDK_17_and_Scala_2_13___testTaskRequestWithOldStartMsGetsUpdated__/)

@vvcephei vvcephei merged commit 1cb7736 into apache:trunk Oct 7, 2022
showuon pushed a commit that referenced this pull request Nov 5, 2022
Tests for 21a15c6
Implements KIP-862: https://cwiki.apache.org/confluence/x/WSf1D

Reviewer: John Roesler <vvcephei@apache.org>
guozhangwang pushed a commit to guozhangwang/kafka that referenced this pull request Jan 25, 2023
Tests for 21a15c6
Implements KIP-862: https://cwiki.apache.org/confluence/x/WSf1D

Reviewer: John Roesler <vvcephei@apache.org>
rutvijmehta-harness pushed a commit to rutvijmehta-harness/kafka that referenced this pull request Feb 9, 2024
Tests for 21a15c6
Implements KIP-862: https://cwiki.apache.org/confluence/x/WSf1D

Reviewer: John Roesler <vvcephei@apache.org>
rutvijmehta-harness added a commit to rutvijmehta-harness/kafka that referenced this pull request Feb 9, 2024
Tests for 21a15c6
Implements KIP-862: https://cwiki.apache.org/confluence/x/WSf1D

Reviewer: John Roesler <vvcephei@apache.org>

Co-authored-by: Vicky Papavasileiou <vpapavas@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants