Skip to content

Spark task component only support spark1.X using sprak-submit, not suitable for spark2 #839

@Eights-Li

Description

@Eights-Li

Spark task submit can specify the spark version
Spark task component only support spark1.X using sprak-submit, not suitable for spark2

add the spark version selector to specify the spark version
In 1.1.0, shell component can submit spark2 job

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions