Skip to content

[tune] S3 sync from workers #1546

@ericl

Description

@ericl

Describe the problem

Currently the tune S3 syncer only syncs from experiment logs from the head node. This is a problem if you have custom logs that you put in $CWD, since those are not sent to the head node.

We should also sync those, separately. Note that this requires granting worker nodes S3 access.

cc @vlad17 @richardliaw

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions