🚀 Feature
#46471 is adding support for profiling torch.distributed APIs such as allgather, allreduce, etc. for NCCL and Gloo backends. Currently, we only support collective communication APIs such as the aformentioned ones, but not point-to-point ones (such as send/recv). We should add and test support for send/recv for backends that support it.
🚀 Feature
#46471 is adding support for profiling torch.distributed APIs such as allgather, allreduce, etc. for NCCL and Gloo backends. Currently, we only support collective communication APIs such as the aformentioned ones, but not point-to-point ones (such as send/recv). We should add and test support for send/recv for backends that support it.