Skip to content

Commit d6cd73d

Browse files
committed
fix undefined name
Signed-off-by: aeeeeeep <aeeeeeep@proton.me>
1 parent 30814fa commit d6cd73d

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

deepspeed/runtime/zero/partition_parameters.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2005,7 +2005,8 @@ def _allgather_params(self, param_list, hierarchy=0):
20052005
partitions = []
20062006
for i in range(self.num_partitions):
20072007
start = partition_size * i
2008-
partitions.append(flat_tensor.narrow(0, start, partition_size))
2008+
partitioned_tensor = flat_tensor.narrow(0, start, partition_size)
2009+
partitions.append(partitioned_tensor)
20092010

20102011
if i == self.get_partition_rank():
20112012
partitioned_tensor.copy_(param.ds_tensor.data)

0 commit comments

Comments
 (0)