Skip to content

Conversation

@poorbarcode
Copy link
Contributor

Motivation

Background

  • Envs: broker.conf: allowAutoTopicCreationType = TopicType.PARTITIONED
  • Users may start 2 clusters with the Geo-Replication feature with Global ZK
  • Users want to hire one cluster, so remove the cluster from namespace-level replicatedClusters
    • Broker will remove the topics of the cluster removed automatically.
  • Issue occurs:
    • The system topic __change_events being deleted first.
    • User topics can not be deleted anymore, because the operation delete topic-level policies can not be executed successfully anymore.
    • The task topic.checkReplication and other operations will retry again and again

You can reproduce by the new test OneWayReplicatorUsingGlobalPartitionedTest. testRemoveCluster

Modifications

  • Skip removing topic-level policies if the system topic __change_event has been deleted.

Documentation

  • doc
  • doc-required
  • doc-not-needed
  • doc-complete

Matching PR in forked repository

PR in forked repository: x

…icated clusters set and caused OOM when using partitioned system topic
@poorbarcode poorbarcode added type/bug The PR fixed a bug or issue reported a bug release/4.0.4 release/3.0.11 release/3.3.6 labels Mar 19, 2025
@poorbarcode poorbarcode added this to the 4.1.0 milestone Mar 19, 2025
@poorbarcode poorbarcode self-assigned this Mar 19, 2025
@github-actions github-actions bot added the doc-not-needed Your PR changes do not impact docs label Mar 19, 2025
@poorbarcode poorbarcode requested a review from shibd March 26, 2025 08:46
@poorbarcode
Copy link
Contributor Author

/pulsarbot rerun-failure-checks

@poorbarcode poorbarcode merged commit abd5121 into apache:master Mar 28, 2025
58 checks passed
lhotari pushed a commit that referenced this pull request Mar 28, 2025
…r from replicated clusters modifying when using partitioned system topic (#24097)

(cherry picked from commit abd5121)
lhotari pushed a commit that referenced this pull request Mar 31, 2025
…r from replicated clusters modifying when using partitioned system topic (#24097)

(cherry picked from commit abd5121)
lhotari pushed a commit that referenced this pull request Mar 31, 2025
…r from replicated clusters modifying when using partitioned system topic (#24097)

(cherry picked from commit abd5121)
nikhil-ctds pushed a commit to datastax/pulsar that referenced this pull request Apr 3, 2025
…r from replicated clusters modifying when using partitioned system topic (apache#24097)

(cherry picked from commit abd5121)
(cherry picked from commit f10df17)
nikhil-ctds pushed a commit to datastax/pulsar that referenced this pull request Apr 3, 2025
…r from replicated clusters modifying when using partitioned system topic (apache#24097)

(cherry picked from commit abd5121)
(cherry picked from commit eb3001c)
nikhil-ctds pushed a commit to datastax/pulsar that referenced this pull request Apr 3, 2025
…r from replicated clusters modifying when using partitioned system topic (apache#24097)

(cherry picked from commit abd5121)
(cherry picked from commit f10df17)
nikhil-ctds pushed a commit to datastax/pulsar that referenced this pull request Apr 8, 2025
…r from replicated clusters modifying when using partitioned system topic (apache#24097)

(cherry picked from commit abd5121)
(cherry picked from commit f10df17)
srinath-ctds pushed a commit to datastax/pulsar that referenced this pull request Apr 8, 2025
…r from replicated clusters modifying when using partitioned system topic (apache#24097)

(cherry picked from commit abd5121)
(cherry picked from commit f10df17)
srinath-ctds pushed a commit to datastax/pulsar that referenced this pull request Apr 11, 2025
…r from replicated clusters modifying when using partitioned system topic (apache#24097)

(cherry picked from commit abd5121)
(cherry picked from commit eb3001c)
nodece pushed a commit to nodece/pulsar that referenced this pull request Apr 22, 2025
…r from replicated clusters modifying when using partitioned system topic (apache#24097)

(cherry picked from commit abd5121)
walkinggo pushed a commit to walkinggo/pulsar that referenced this pull request Oct 8, 2025
…r from replicated clusters modifying when using partitioned system topic (apache#24097)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants