Skip to content

HADOOP-1381. The distance between sync blocks in SequenceFiles should be configurable#147

Closed
QwertyManiac wants to merge 1 commit intoapache:trunkfrom
QwertyManiac:HADOOP-1381
Closed

HADOOP-1381. The distance between sync blocks in SequenceFiles should be configurable#147
QwertyManiac wants to merge 1 commit intoapache:trunkfrom
QwertyManiac:HADOOP-1381

Conversation

@QwertyManiac
Copy link
Contributor

@QwertyManiac QwertyManiac commented Oct 26, 2016 •
edited
Loading

  • Allowed the sync interval size to be configurable via a new parameter in the Writer argument API
  • New default sync interval size is 200 KiB
  • Added tests with varied sync interval sizes, and kept a test for the older default as-is for compatibility checks
  • Moved some older Reader API usage in modified tests to support newer constructions

@QwertyManiac QwertyManiac force-pushed the HADOOP-1381 branch 2 times, most recently from cad79b9 to 937269b Compare November 16, 2016 05:18
@QwertyManiac QwertyManiac changed the title HADOOP-1381. The distance between sync blocks in SequenceFiles should… HADOOP-1381. The distance between sync blocks in SequenceFiles should be configurable Nov 16, 2016
HADOOP-1381. The distance between sync blocks in SequenceFiles should…
25d97f6 
… be configurable rather than hard coded to 2000 bytes.
@QwertyManiac
Copy link
Contributor Author

QwertyManiac commented Nov 25, 2016

Fixed via 07825f2

@QwertyManiac QwertyManiac deleted the HADOOP-1381 branch November 25, 2016 16:57
This was referenced Aug 3, 2021
Merged
Merged
Closed
Merged
Closed
Merged
This was referenced Aug 10, 2021
Merged
Merged
Closed
Closed
Merged
Closed
Merged
Merged
This was referenced Aug 19, 2021
Merged
Merged
Merged
Closed
This was referenced Aug 26, 2021
Merged
Closed
Closed
Merged
This was referenced Jun 12, 2025
Closed
Closed
Closed
Closed
Closed
Closed
Merged
Closed
This was referenced Jun 20, 2025
Merged
Closed
Merged
Merged
Open
Merged
Open
Merged
Closed
Closed
Closed
Merged
This was referenced Jun 27, 2025
Merged
Merged
Merged
Merged
Merged
Closed
Closed
Closed
Merged
@hadoop-yetus hadoop-yetus mentioned this pull request Jul 5, 2025
Closed
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@QwertyManiac