Skip to content

Introduced Global checkpoints for Sequence Numbers#15485

Merged
bleskes merged 15 commits intoelastic:feature/seq_nofrom
bleskes:global_checkpoint
Jun 6, 2016
Merged

Introduced Global checkpoints for Sequence Numbers#15485
bleskes merged 15 commits intoelastic:feature/seq_nofrom
bleskes:global_checkpoint

Conversation

@bleskes
Copy link
Copy Markdown
Contributor

@bleskes bleskes commented Dec 16, 2015

This is a work in progress PR for introducing Global Checkpoints into the feature/seq_no branch. I made it to get some feedback before things are finalized / cycles are spent on docs etc. It is fairly solid, but a couple of things miss:

  1. Lucene level doc rejections are not yet dealt with (I need to do some work on master).
  2. Nothing is persisted yet. This will be a future PR.
  3. No tests - I'll add those if we're good on the setup.

@bleskes
Copy link
Copy Markdown
Contributor Author

bleskes commented Dec 17, 2015

@jasontedor I fixed the issue we ran into yesterday where the a primary relocation target started updating the global checkpoint too early

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit: the indentation is off throughout the body of the anonymous implementation of TransportRequestHandler<ShardResponse> here.


/**
* A shard component that is responsible of tracking the global checkpoint. The global checkpoint
* is the highest seq_no for which all lower (or equal) seq no have been process on all shards that
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit: "seq no" -> "seq_no" (inconsistencies will make searching more difficult)

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit: "process" -> "processed"

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@jasontedor
Copy link
Copy Markdown
Member

Since this has gone through a few rounds of review before, I largely have the same thoughts I had then. I gave it a thorough re-read and left some comments.

@bleskes
Copy link
Copy Markdown
Contributor Author

bleskes commented Jun 6, 2016

@jasontedor thx for the review. I pushed another commit addressing it.

@jasontedor
Copy link
Copy Markdown
Member

LGTM.

@bleskes bleskes merged commit 4844325 into elastic:feature/seq_no Jun 6, 2016
@bleskes bleskes deleted the global_checkpoint branch June 6, 2016 10:53
@clintongormley clintongormley added :Engine :Distributed/Engine Anything around managing Lucene and the Translog in an open shard. and removed :Sequence IDs labels Feb 14, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Distributed/Engine Anything around managing Lucene and the Translog in an open shard.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants