-
Notifications
You must be signed in to change notification settings - Fork 7.4k
[Data] [Doc] whether map() supports generator UDF #52279
Copy link
Copy link
Closed
Labels
P2Important issue, but not time-criticalImportant issue, but not time-criticalcommunity-backlogdataRay Data-related issuesRay Data-related issuesdocsAn issue or change related to documentationAn issue or change related to documentationgood-first-issueGreat starter issue for someone just starting to contribute to RayGreat starter issue for someone just starting to contribute to Ray
Description
Description
https://docs.ray.io/en/latest/data/api/doc/ray.data.Dataset.map.html#ray.data.Dataset.map
Kind of minor .. but currently the doc claims the UDF can be a generator ( Callable[..., Iterator])
Since map() is supposed to be 1-to-1 (row) ops, is this actually supported? or it's actually ok if the generator yields once?
Link
No response
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
P2Important issue, but not time-criticalImportant issue, but not time-criticalcommunity-backlogdataRay Data-related issuesRay Data-related issuesdocsAn issue or change related to documentationAn issue or change related to documentationgood-first-issueGreat starter issue for someone just starting to contribute to RayGreat starter issue for someone just starting to contribute to Ray