Skip to content

Streaming repartition to honor num_rows_per_block #57165

@srinathk10

Description

@srinathk10

Current repartition has target_num_rows_per_block which is upper limit on rows per block.

Need to make this a hard guarantee on num_rows_per_block.

  • If Block has fewer rows, need to combine.
  • If Block has more rows, need to split (as done today).

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions