feat(glue): add ExecutionClass for FLEX#26203
Conversation
|
|
| if (executable.type !== JobType.ETL) { | ||
| throw new Error('FLEX ExecutionClass is only available for JobType.ETL jobs'); | ||
| } | ||
| if ([GlueVersion.V0_9, GlueVersion.V1_0, GlueVersion.V2_0].includes(executable.glueVersion)) { | ||
| throw new Error('FLEX ExecutionClass is only available for GlueVersion 3.0 or later'); | ||
| } | ||
| if (props.workerType && (props.workerType !== WorkerType.G_1X && props.workerType !== WorkerType.G_2X)) { | ||
| throw new Error('FLEX ExecutionClass is only available for WorkerType G_1X or G_2X'); | ||
| } |
There was a problem hiding this comment.
In this page, the following.
Only jobs with AWS Glue version 3.0 and above and command type glueetl will be allowed to set ExecutionClass to FLEX. The flexible execution class is available for Spark jobs.
In this page, the following.
Flexible job runs are supported for jobs using AWS Glue version 3.0 or later and G.1X or G.2X worker types.
|
Thank you for contributing! Your pull request will be updated from main and then merged automatically (do not update manually, and be sure to allow changes to be pushed to your fork). |
AWS CodeBuild CI Report
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository |
|
Thank you for contributing! Your pull request will be updated from main and then merged automatically (do not update manually, and be sure to allow changes to be pushed to your fork). |
This PR adds ExecutionClass for Glue job's L2 construct. This allows you to specify
FLEXoption.Closes #22224
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license