Distributed training (multi-node) of a Transformer model
Messaging and state layer for distributed serverless applications
Summary of call graphs and data structures of NVIDIA Collective Communication Library (NCCL)
Blink+: Increase GPU group bandwidth by utilizing across tenant NVLink.
collectives library for upc++
HPC course practice assignments for parallel-programming
MPI laboratory project demonstrating collective communication primitives to perform distributed numerical computations on a vector. Implements broadcast, scatter, gather, reduce, and scan operations while managing vector segments across multiple processes (Introduction to Parallel Computing, UNIWA).
This repository contains simple programs of MPI_Bcast, MPI_Reduce, MPI_Scatter and MPI_Gather. Download the repository and test your self.
A reduction algorithm for MPI using only peer to peer communication
Summary of call graphs and data structures of collective communication plugin in NVIDIA TensorRT-LLM
Modelling of MPI collective operations latencies: Broadcast and Reduce operations. UniTS, SDIC, 2023-2024
Add a description, image, and links to the collective-communication topic page so that developers can more easily learn about it.
To associate your repository with the collective-communication topic, visit your repo's landing page and select "manage topics."