Skip to content

Commit 6e3e13c

Browse files
loadamstjruwase
andauthored
Remove warnings from autodoc and sphinx (#6788)
Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
1 parent 8efbcc4 commit 6e3e13c

File tree

3 files changed

+14
-12
lines changed

3 files changed

+14
-12
lines changed

deepspeed/runtime/fp16/onebit/zoadam.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,9 +12,11 @@
1212

1313

1414
class ZeroOneAdam(torch.optim.Optimizer):
15-
"""Implements the 0/1 Adam algorithm. Currently GPU-only.
15+
"""
16+
Implements the 0/1 Adam algorithm. Currently GPU-only.
1617
For usage example please see https://www.deepspeed.ai/tutorials/zero-one-adam/
1718
For technical details please read https://arxiv.org/abs/2202.06009
19+
1820
Arguments:
1921
params (iterable): iterable of parameters to optimize or dicts defining
2022
parameter groups.

deepspeed/runtime/lr_schedules.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -274,7 +274,7 @@ class LRRangeTest(object):
274274
"""Sets the learning rate of each parameter group according to
275275
learning rate range test (LRRT) policy. The policy increases learning
276276
rate starting from a base value with a constant frequency, as detailed in
277-
the paper `A disciplined approach to neural network hyper-parameters: Part1`_.
277+
the paper `A disciplined approach to neural network hyper-parameters: Part 1 <https://arxiv.org/abs/1803.09820>`_
278278
279279
LRRT policy is used for finding maximum LR that trains a model without divergence, and can be used to
280280
configure the LR boundaries for Cyclic LR schedules.
@@ -379,7 +379,7 @@ class OneCycle(object):
379379
1CLR policy changes the learning rate after every batch.
380380
`step` should be called after a batch has been used for training.
381381
382-
This implementation was adapted from the github repo: `pytorch/pytorch`_
382+
This implementation was adapted from the github repo: `PyTorch <https://github.com/pytorch/pytorch>`_.
383383
384384
Args:
385385
optimizer (Optimizer): Wrapped optimizer.

docs/code-docs/source/monitor.rst

Lines changed: 9 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -9,15 +9,15 @@ overview of what DeepSpeed will log automatically.
99
:header: "Field", "Description", "Condition"
1010
:widths: 20, 20, 10
1111

12-
`Train/Samples/train_loss`,The training loss.,None
13-
`Train/Samples/lr`,The learning rate during training.,None
14-
`Train/Samples/loss_scale`,The loss scale when training using `fp16`.,`fp16` must be enabled.
15-
`Train/Eigenvalues/ModelBlockParam_{i}`,Eigen values per param block.,`eigenvalue` must be enabled.
16-
`Train/Samples/elapsed_time_ms_forward`,The global duration of the forward pass.,`flops_profiler.enabled` or `wall_clock_breakdown`.
17-
`Train/Samples/elapsed_time_ms_backward`,The global duration of the forward pass.,`flops_profiler.enabled` or `wall_clock_breakdown`.
18-
`Train/Samples/elapsed_time_ms_backward_inner`,The backward time that does not include the gradient reduction time. Only in cases where the gradient reduction is not overlapped, if it is overlapped then the inner time should be about the same as the entire backward time.,`flops_profiler.enabled` or `wall_clock_breakdown`.
19-
`Train/Samples/elapsed_time_ms_backward_allreduce`,The global duration of the allreduce operation.,`flops_profiler.enabled` or `wall_clock_breakdown`.
20-
`Train/Samples/elapsed_time_ms_step`,The optimizer step time,`flops_profiler.enabled` or `wall_clock_breakdown`.
12+
`Train/Samples/train_loss`,"The training loss.",None
13+
`Train/Samples/lr`,"The learning rate during training.",None
14+
`Train/Samples/loss_scale`,"The loss scale when training using `fp16`.",`fp16` must be enabled.
15+
`Train/Eigenvalues/ModelBlockParam_{i}`,"Eigen values per param block.",`eigenvalue` must be enabled.
16+
`Train/Samples/elapsed_time_ms_forward`,"The global duration of the forward pass.",`flops_profiler.enabled` or `wall_clock_breakdown`.
17+
`Train/Samples/elapsed_time_ms_backward`,"The global duration of the forward pass.",`flops_profiler.enabled` or `wall_clock_breakdown`.
18+
`Train/Samples/elapsed_time_ms_backward_inner`,"The backward time that does not include the gradient reduction time. Only in cases where the gradient reduction is not overlapped, if it is overlapped then the inner time should be about the same as the entire backward time.",`flops_profiler.enabled` or `wall_clock_breakdown`.
19+
`Train/Samples/elapsed_time_ms_backward_allreduce`,"The global duration of the allreduce operation.",`flops_profiler.enabled` or `wall_clock_breakdown`.
20+
`Train/Samples/elapsed_time_ms_step`,"The optimizer step time.",`flops_profiler.enabled` or `wall_clock_breakdown`.
2121

2222
TensorBoard
2323
-----------

0 commit comments

Comments
 (0)