Skip to content

Faster --touch runs #3342

@bsmith89

Description

@bsmith89

Is your feature request related to a problem? Please describe.
Even after dependency resolution, running --touch on large workflows can take a very long time. Surprisingly, --dry-run is much faster.

Describe the solution you'd like
I'd like --touch to run (nearly) as fast as --dry-run. While I don't fully understand the cause of this slowness, it may come down to a variety of optimizations to reduce the overhead associated with executing rules and tracking their completion.

Describe alternatives you've considered
Alternatively, execution with --touch could be completely re-engineered to entirely skip many of the checks that are needed for "real" execution.

Additional context
It could be related to #2517 , in which case the fix could be as simple as shortening the time.sleep(...).

Less overhead in rule running would also be beneficial for workflows with lots of small jobs.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions