Skip to content

(aws-glue-alpha): S3 path specified in --spark-event-logs-path needs to end with slash #29356

@moomindani

Description

@moomindani

Describe the bug

When only bucket is provided for spark event log path in job, the s3 path does not end with slash.
It is accepted in job API, but it does not work on actual Spark UI.

Expected Behavior

S3 path specified in --spark-event-logs-path ends with slash

Current Behavior

S3 path specified in --spark-event-logs-path does not end with slash in case only bucket is provided but prefix is not provided

Reproduction Steps

      sparkUI: {
        enabled: true,
      },

Possible Solution

Add trailing slash when it does not end with slash

Additional Information/Context

No response

CDK CLI Version

2.131.0

Framework Version

No response

Node.js Version

20.11.1

OS

macOS Ventura 13.6.4

Language

TypeScript

Language Version

No response

Other information

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    @aws-cdk/aws-glueRelated to AWS GluebugThis issue is a bug.effort/mediumMedium work item – several days of effortp2

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions