Skip to content

Commit b601d83

Browse files
pre-commit-ci[bot]jaimec00
authored andcommitted
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci Signed-off-by: Jaime Cardenas <jaime@evolutionaryscale.ai>
1 parent 7c1683a commit b601d83

File tree

2 files changed

+6
-2
lines changed

2 files changed

+6
-2
lines changed

tests/pytorch/selective_layernorm_mlp/test_cuda_graphs.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -168,6 +168,7 @@ def forward(self, input_: torch.Tensor, **kwargs) -> torch.Tensor:
168168
# Supported modules
169169
_test_cuda_graphs_modules: List[str] = ["selective_layernorm_mlp"]
170170

171+
171172
def _test_cuda_graphs(
172173
*,
173174
graph_mode: str,
@@ -200,7 +201,7 @@ def _test_cuda_graphs(
200201
)
201202
for _ in range(num_layers)
202203
]
203-
204+
204205
else:
205206
raise ValueError(f"Unknown module type ({module})")
206207

tests/pytorch/selective_layernorm_mlp/test_deferred_init.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,9 @@
77

88
import transformer_engine.pytorch as te
99

10-
_core_modules = [te.SelectiveLayerNormMLP,]
10+
_core_modules = [
11+
te.SelectiveLayerNormMLP,
12+
]
1113
_composed_modules = []
1214

1315
batch_size = 32
@@ -16,6 +18,7 @@
1618
head_dim = 64
1719
dtype = torch.bfloat16
1820

21+
1922
class TestDeferredInit:
2023

2124
@staticmethod

0 commit comments

Comments
 (0)