Skip to content

all_gather for TPU doesn't support backward gradients. #6295

Closed
#15003
Closed
all_gather for TPU doesn't support backward gradients.#6295
#15003
Labels
accelerator: tpuTensor Processing UnitfeatureIs an improvement or enhancementgood first issueGood for newcomershelp wantedOpen to be worked onwon't fixThis will not be worked on
@tchaton

Description

@tchaton
tchaton
opened on Mar 2, 2021

Currently, we rely on AllGatherGrad to compute gather for GPUs.

TODO:

  • [] Extend this class to support TPU
  • [] Add tests

Metadata

Metadata

Assignees

No one assigned

    Labels

    accelerator: tpuTensor Processing UnitfeatureIs an improvement or enhancementgood first issueGood for newcomershelp wantedOpen to be worked onwon't fixThis will not be worked on

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions