Fix RDMA MPI #1323

Job	Run time
Detect File Changes	13s
Self Hosted (cpu, gt)	41m 43s
Self Hosted (gpu, gt)	1h 53m 45s
Github (ubuntu, mpi, debug, true)	35m 1s
Self Hosted (gpu, frontier)	13m 17s
Github (ubuntu, mpi, debug, false)	1h 8m 1s
Github (ubuntu, mpi, no-debug, true)	1h 7m 54s
Github (ubuntu, mpi, no-debug, false)	1h 30m 49s
Github (macos, mpi, debug, false)	35m 25s
Github (macos, mpi, no-debug, false)	33m 58s
Github (ubuntu, no-mpi, no-debug, false)	28m 16s
	8h 48m 22s

Provide feedback