Skip to content

KAFKA-8306: Initialize log end offset accurately when start offset is non-zero#6652

Merged
hachikuji merged 6 commits into
apache:trunkfrom
dhruvilshah3:log-end-offset
May 4, 2019
Merged

KAFKA-8306: Initialize log end offset accurately when start offset is non-zero#6652
hachikuji merged 6 commits into
apache:trunkfrom
dhruvilshah3:log-end-offset

Conversation

@dhruvilshah3

Copy link
Copy Markdown
Contributor

No description provided.

Comment thread core/src/main/scala/kafka/log/Log.scala Outdated
@@ -573,13 +573,13 @@ class Log(@volatile var dir: File,
if (logSegments.isEmpty) {
// no existing segments, create a new mutable segment beginning at offset 0

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems like the comment needs to be updated.

@hachikuji hachikuji left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the patch. I had one question.

Comment thread core/src/main/scala/kafka/log/Log.scala
Comment thread core/src/main/scala/kafka/log/Log.scala Outdated
- Add a warning message when deleting segments.

@hachikuji hachikuji left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks for the fix!

@dhruvilshah3

Copy link
Copy Markdown
Contributor Author

Failures look unrelated. Retest this please.

@hachikuji hachikuji merged commit 56b92a5 into apache:trunk May 4, 2019
hachikuji pushed a commit that referenced this pull request May 4, 2019
… non-zero (#6652)

This patch ensures that the log end offset of each partition is initialized consistently with the checkpointed log start offset.

Reviewers: Ismael Juma <ismael@juma.me.uk>, Jason Gustafson <jason@confluent.io>
hachikuji pushed a commit that referenced this pull request May 4, 2019
… non-zero (#6652)

This patch ensures that the log end offset of each partition is initialized consistently with the checkpointed log start offset.

Reviewers: Ismael Juma <ismael@juma.me.uk>, Jason Gustafson <jason@confluent.io>
hachikuji pushed a commit that referenced this pull request May 4, 2019
… non-zero (#6652)

This patch ensures that the log end offset of each partition is initialized consistently with the checkpointed log start offset.

Reviewers: Ismael Juma <ismael@juma.me.uk>, Jason Gustafson <jason@confluent.io>
ijuma added a commit to ijuma/kafka that referenced this pull request May 8, 2019
…s-hashcode

* apache-github/trunk:
  KAFKA-8158: Add EntityType for Kafka RPC fields (apache#6503)
  MINOR: correctly parse version OffsetCommitResponse version < 3
  KAFKA-8284: enable static membership on KStream (apache#6673)
  KAFKA-8304: Fix registration of Connect REST extensions (apache#6651)
  KAFKA-8275; Take throttling into account when choosing least loaded node (apache#6619)
  KAFKA-3522: Interactive Queries must return timestamped stores (apache#6661)
  MINOR: MetricsIntegrationTest should set StreamsConfig.STATE_DIR_CONFIG (apache#6687)
  MINOR: Remove unused field in `ListenerConnectionQuota`
  KAFKA-8131; Move --version implementation into CommandLineUtils (apache#6481)
  KAFKA-8056; Use automatic RPC generation for FindCoordinator (apache#6408)
  MINOR: Remove workarounds for lz4-java bug affecting byte buffers (apache#6679)
  KAFKA-7455: Support JmxTool to connect to a secured RMI port. (apache#5968)
  MINOR: Document improvement (apache#6682)
  MINOR: Fix ThrottledReplicaListValidator doc error. (apache#6537)
  KAFKA-8306; Initialize log end offset accurately when start offset is non-zero (apache#6652)
pengxiaolong pushed a commit to pengxiaolong/kafka that referenced this pull request Jun 14, 2019
… non-zero (apache#6652)

This patch ensures that the log end offset of each partition is initialized consistently with the checkpointed log start offset.

Reviewers: Ismael Juma <ismael@juma.me.uk>, Jason Gustafson <jason@confluent.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants