Add Points to TVTensors #8728
Description
🚀 The feature
A new TVTensor subclass that represents a (N, 2) tensor.
It can be used to represent points, and should be affected by the augmentation pipelines as such (for example, RandomRotation should also affect the points coordinates)
Motivation, pitch
TVTensors allow the easy integration of augmentation pipelines with semi-complex data structure, by tagging tensors as being linked to the augmentation and being affected by it. However, TVTensors is far from covering the entire wealth of complexity.
Allowing a set of points to be manipulated as such would allow more complex structures, like skeletons, polygons, rotated bboxes, and tracking points to be handled 1.
The signature should be similar to all others TVTensors, which, as a whole, are very usable.
Alternatives
No response
Additional context
No response
Footnotes
-
Specific support is, IMO better, but supporting arbitrary points and then building on them is an easily implementable trajectory that may lead to wider support later. ↩