Skip to content

[Feature] Ingestion Load #47932

@gnehil

Description

@gnehil

Search before asking

  • I had searched in the issues and found no similar issues.

Description

Load Job for new spark load.

Ingestion Load is used to load pre-processed data into doris.

Preprocessing refers to writing the result data to an external storage system after the data is processed according to the partitioning, bucketing and aggregation methods defined by the doris table.

The preprocessing is completed by the external system, and then the BE reads the data and converts it into segment files and saves it.

The basic flow is as follows:

Image

Use case

No response

Related issues

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Labels

    Stalekind/featureCategorizes issue or PR as related to a new feature.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions