Skip to content

Commit ce37039

Browse files
Yi Wangfacebook-github-bot
authored andcommitted
[Gradient Compression] Remove the extra comma after "bucket" in PowerSGD hook signatures (#50197)
Summary: Pull Request resolved: #50197 Remove the extra comma after "bucket". ghstack-source-id: 119513484 Test Plan: waitforbuildbot Reviewed By: rohan-varma Differential Revision: D25823117 fbshipit-source-id: acf048f7cb732c23cba3a81ccce1e70f6b9f4299
1 parent 09eefec commit ce37039

1 file changed

Lines changed: 2 additions & 8 deletions

File tree

torch/distributed/algorithms/ddp_comm_hooks/powerSGD_hook.py

Lines changed: 2 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -82,10 +82,7 @@ def __init__(
8282
self.q_memory_dict = {}
8383

8484

85-
def powerSGD_hook(
86-
state: PowerSGDState,
87-
bucket,
88-
) -> torch.futures.Future:
85+
def powerSGD_hook(state: PowerSGDState, bucket) -> torch.futures.Future:
8986
"""
9087
This DDP communication hook implements the original PowerSGD gradient compression
9188
algorithm described in https://arxiv.org/abs/1905.13727.
@@ -322,10 +319,7 @@ def decompress(fut):
322319
)
323320

324321

325-
def batched_powerSGD_hook(
326-
state: PowerSGDState,
327-
bucket,
328-
) -> torch.futures.Future:
322+
def batched_powerSGD_hook(state: PowerSGDState, bucket) -> torch.futures.Future:
329323
"""
330324
This DDP communication hook implements a simplified PowerSGD gradient compression
331325
algorithm described in https://arxiv.org/abs/1905.13727.

0 commit comments

Comments
 (0)