Skip to content

Commit 7e2ac7b

Browse files
Michael Shifacebook-github-bot
authored andcommitted
Correct typo in README wrt AdamW
Summary: See title. Thanks to Mike Rabbat for catching this! Reviewed By: minddrummer, tsunghsienlee Differential Revision: D63045054 fbshipit-source-id: 4bfade21c1fe46458a5f396734537e9abfc79d0c
1 parent 1685444 commit 7e2ac7b

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

distributed_shampoo/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -232,7 +232,7 @@ optimizer = DistributedShampoo(
232232
use_decoupled_weight_decay=True,
233233
grafting_config=AdamGraftingConfig(
234234
beta2=0.999,
235-
epsilon=1e-12,
235+
epsilon=1e-08,
236236
),
237237
)
238238
```

0 commit comments

Comments
 (0)