Skip to content

KAFKA-7904: Add AtMinIsr partition metric and TopicCommand option (KIP-427)#6421

Closed
KevinLiLu wants to merge 4 commits into
apache:trunkfrom
KevinLiLu:KAFKA-7904
Closed

KAFKA-7904: Add AtMinIsr partition metric and TopicCommand option (KIP-427)#6421
KevinLiLu wants to merge 4 commits into
apache:trunkfrom
KevinLiLu:KAFKA-7904

Conversation

@KevinLiLu

@KevinLiLu KevinLiLu commented Mar 11, 2019

Copy link
Copy Markdown
Contributor
  • Add AtMinIsrPartitionCount metric to ReplicaManager
  • Add AtMinIsr metric to Partition
  • Add --at-min-isr-partitions describe TopicCommand option

https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=103089398

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

@KevinLiLu KevinLiLu changed the title KAFKA-7904: Add AtMinIsr partition metric and TopicCommand option KAFKA-7904: Add AtMinIsr partition metric and TopicCommand option (KIP-427) Mar 11, 2019
@KevinLiLu

Copy link
Copy Markdown
Contributor Author

Hi @harshach @vahidhashemian @lindong28 , can I get a review for this?

@KevinLiLu

Copy link
Copy Markdown
Contributor Author

Bumping this as it has been a couple weeks. Can I get a review? @harshach @vahidhashemian @lindong28 @gwenshap

@gwenshap gwenshap left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. One small request.

allTopicLevelOpts -- Set(describeOpt) + reportUnderMinIsrPartitionsOpt + reportUnavailablePartitionsOpt + reportAtMinIsrPartitionsOpt + topicsWithOverridesOpt)
CommandLineUtils.checkInvalidArgs(parser, options, reportUnderMinIsrPartitionsOpt,
allTopicLevelOpts -- Set(describeOpt) + reportUnderReplicatedPartitionsOpt + reportUnavailablePartitionsOpt + topicsWithOverridesOpt + zkConnectOpt)
allTopicLevelOpts -- Set(describeOpt) + reportUnderReplicatedPartitionsOpt + reportUnavailablePartitionsOpt + reportAtMinIsrPartitionsOpt + topicsWithOverridesOpt + zkConnectOpt)

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit:
We repeatedly add reportUnderReplicatedPartitionsOpt, reportUnavailablePartitionsOpt, reportAtMinIsrPartitionsOpt and reportUnderMinIsrPartitionsOpt to the set of disallowed options, and it is messy to read (and a . Maybe create a new set like allReplicationReportOpts and use this everywhere?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great idea. Thanks!

@KevinLiLu

Copy link
Copy Markdown
Contributor Author

Hi @gwenshap , thanks for the review. I have refactored the options code to use an allReplicationReportOpts Set.

@gwenshap

gwenshap commented Apr 5, 2019

Copy link
Copy Markdown
Contributor

Thank you. Looks good and tests pass. Merging.

@gwenshap gwenshap closed this in 31d191f Apr 5, 2019
pengxiaolong pushed a commit to pengxiaolong/kafka that referenced this pull request Jun 14, 2019
…P-427)

- Add `AtMinIsrPartitionCount` metric to `ReplicaManager`
- Add `AtMinIsr` metric to `Partition`
- Add `--at-min-isr-partitions` describe `TopicCommand` option

https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=103089398

Author: Kevin Lu <lu.kevin@berkeley.edu>
Author: lu.kevin@berkeley.edu <kelu@paypal.com>

Reviewers: Gwen Shapira

Closes apache#6421 from KevinLiLu/KAFKA-7904
xiowu0 pushed a commit to xiowu0/kafka that referenced this pull request Jul 15, 2019
…and TopicCommand option (KIP-427)

TICKET = KAFKA-7904
LI_DESCRIPTION =
This patch includes broker metrics for AtMinIsr and modified unit tests. However, it doesn't include topiccommand related change from the original cherry-picked commit because of extra dependency.

EXIT_CRITERIA = HASH [31d191f]
ORIGINAL_DESCRIPTION =

- Add `AtMinIsrPartitionCount` metric to `ReplicaManager`
- Add `AtMinIsr` metric to `Partition`
- Add `--at-min-isr-partitions` describe `TopicCommand` option

https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=103089398

Author: Kevin Lu <lu.kevin@berkeley.edu>
Author: lu.kevin@berkeley.edu <kelu@paypal.com>

Reviewers: Gwen Shapira

Closes apache#6421 from KevinLiLu/KAFKA-7904

(cherry picked from commit 31d191f)
xiowu0 added a commit to linkedin/kafka that referenced this pull request Jul 16, 2019
…and TopicCommand option (KIP-427) (#30)

TICKET = KAFKA-7904
LI_DESCRIPTION =
This patch includes broker metrics for AtMinIsr and modified unit tests. However, it doesn't include topiccommand related change from the original cherry-picked commit because of extra dependency.

EXIT_CRITERIA = HASH [31d191f]
ORIGINAL_DESCRIPTION =

- Add `AtMinIsrPartitionCount` metric to `ReplicaManager`
- Add `AtMinIsr` metric to `Partition`
- Add `--at-min-isr-partitions` describe `TopicCommand` option

https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=103089398

Author: Kevin Lu <lu.kevin@berkeley.edu>
Author: lu.kevin@berkeley.edu <kelu@paypal.com>

Reviewers: Gwen Shapira

Closes apache#6421 from KevinLiLu/KAFKA-7904

(cherry picked from commit 31d191f)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants