Skip to content

jdbc rangeSplitStrategy extension #914

@Paddy0523

Description

@Paddy0523

Range slices can be read sequentially on disk if splitPk is incremented in the table. It can improve performance to some extent
1.incremental mode with parallelism >1 ,support range splitStrategy
image

2.polling mode support range splitStrategy

  • JdbcInputSplit Added splitStrategy and isPolling attributes
  • Get minValue and maxValue from splitPk in the database table, slice these data using rangeSplitStrategy first
  • Set maxValue as startLocation and start polling according to the modSplitStrategy

Metadata

Metadata

Assignees

No one assigned

    Labels

    feature-requestthis is a feature requests on the product

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions