Skip to content

Commit

Permalink
Merge pull request #22091 from abhinavgoel95:patch-2
Browse files Browse the repository at this point in the history
PiperOrigin-RevId: 646924044
  • Loading branch information
jax authors committed Jun 26, 2024
2 parents 6175e49 + 7b9636f commit b8aa4c5
Showing 1 changed file with 0 additions and 4 deletions.
4 changes: 0 additions & 4 deletions docs/gpu_performance_tips.md
Original file line number Diff line number Diff line change
Expand Up @@ -66,10 +66,6 @@ training on Nvidia GPUs](https://github.com/NVIDIA/JAX-Toolbox/blob/main/rosetta

### Communication flags

* **--xla_gpu_enable_async_collectives** This flag enables the collective ops
such as `AllReduce`, `AllGather`, `ReduceScatter` and `CollectivePermute` to
be asynchronous. Asynchronous communication can overlap cross-core
communication with computation. The default value is False.
* **--xla_gpu_enable_latency_hiding_scheduler** This flag enables latency hiding
schedulers to overlap asynchronous communication with computation efficiently.
The default value is False.
Expand Down

0 comments on commit b8aa4c5

Please sign in to comment.