-
-
Notifications
You must be signed in to change notification settings - Fork 757
Description
I get the error "Inputs contain futures that were created by another client" when I try to join a published dataset within a client different from the one that originally published it. The whole flow can be summarised as follows:
Client 1
df = dd.read_csv(...)
client.persist(df)
client.publish_dataset(ds_name=df)
Client 2
df = client.get_dataset("ds_name")
df2 = dd.read_csv(...)
df2.join(df)
client.persist(df2)
Is this expected behavior?
For reference, this check was added in the commit c02ea63#diff-96a27223dc91b5c9ea3d03684d79ad3f%5D which is part of the pull request #2227
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels