Problem
The package task in taskfile.yaml currently depends on deps:spider but does not track changes to spider artifacts through checksums or direct source dependencies. This means the package task might not re-run when spider artifacts (spider_scheduler and spider_worker) change.
Proposed Solutions
- Option 1: Let
deps:spider compute a checksum file and add it to the package task's source list
- Option 2: Add
spider_scheduler and spider_worker binaries directly to the package task's source list
Context
Problem
The
packagetask intaskfile.yamlcurrently depends ondeps:spiderbut does not track changes to spider artifacts through checksums or direct source dependencies. This means thepackagetask might not re-run when spider artifacts (spider_schedulerandspider_worker) change.Proposed Solutions
deps:spidercompute a checksum file and add it to thepackagetask'ssourcelistspider_schedulerandspider_workerbinaries directly to thepackagetask'ssourcelistContext