Describe the feature
As a user of aws-cdk, I would like to create a step function with a step to start a Glue Crawler so I don't have invoke a crawler via a Lambda. Lambdas have a 15 min timeout which is too short for some crawlers of large datasets to be fully crawled.
Use Case
When I'm in the step function design studio, I do see an option for a StartCrawler step. This step is not available in the CDK modules so I'm unable to create step functions that has this step in it.
Proposed Solution
I would like a new task type that allows me to kick off a glue crawler. Something like:
const runGlueCrawler = new tasks.GlueStartCrawler(....
Other Information
No response
Acknowledgements
CDK version used
"aws-cdk": "^2.58.1"
Environment details (OS name and version, etc.)
Amazon Linux 2
Describe the feature
As a user of aws-cdk, I would like to create a step function with a step to start a Glue Crawler so I don't have invoke a crawler via a Lambda. Lambdas have a 15 min timeout which is too short for some crawlers of large datasets to be fully crawled.
Use Case
When I'm in the step function design studio, I do see an option for a
StartCrawlerstep. This step is not available in the CDK modules so I'm unable to create step functions that has this step in it.Proposed Solution
I would like a new task type that allows me to kick off a glue crawler. Something like:
Other Information
No response
Acknowledgements
CDK version used
"aws-cdk": "^2.58.1"
Environment details (OS name and version, etc.)
Amazon Linux 2