Skip to content

Conversation

@ah-gus
Copy link

@ah-gus ah-gus commented Apr 1, 2025

this patch, adds the ability to retrieve the PCIE space physical Address of a GPU allocated memory region.
it turns gdrcopy into the De-Facto standard way to implement GPUDirect RDMA to 3rd party PCIE cards in userspace, leveraging the good work done elsewhere in this project, the excellent bookkeeping and the NVIDIA sponsorship

@drossetti
Copy link
Member

@ah-gus thanks for providing this PR.

it turns gdrcopy into the De-Facto standard way to implement GPUDirect RDMA to 3rd party PCIE cards in userspace,

Although this approach may be deployed in specific environment, like embedded systems, it is not widely useful.

Exposing CPU physical addresses for the PCIe BAR of a device to user space a) has security implications and b) does not work on many platforms or in certain environments, for example in a VM or when the IOMMU is enabled.

Besides, the upstream Linux kernel solution for direct I/O on device memory is dma-buf. 3rd party devices should rather use those APIs.

As such I don't think it is wise to accept this change. It still makes sense to host that code on your repo and write a nice post somewhere.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants