Description
https://docs.ray.io/en/latest/data/api/doc/ray.data.Dataset.map.html#ray.data.Dataset.map
Kind of minor .. but currently the doc claims the UDF can be a generator ( Callable[..., Iterator])
Since map() is supposed to be 1-to-1 (row) ops, is this actually supported? or it's actually ok if the generator yields once?
Link
No response
Description
https://docs.ray.io/en/latest/data/api/doc/ray.data.Dataset.map.html#ray.data.Dataset.map
Kind of minor .. but currently the doc claims the UDF can be a generator (
Callable[..., Iterator])Since
map()is supposed to be 1-to-1 (row) ops, is this actually supported? or it's actually ok if the generator yields once?Link
No response