undefined | Better HN

0 pointswmf3mo ago0 comments

Within a single node it's just called DMA. RDMA is DMA over a network and RoCE is RDMA over Ethernet.

0 comments

Sorry, but it certainly isn't--

https://docs.nvidia.com/cuda/gpudirect-rdma/index.html

The "R" in RDMA means there are multiple DMA controllers who can "transparently" share address spaces. You can certainly share address spaces across nodes with RoCE or Infiniband, but thats a layer on top

wtallis3mo ago

I don't know why that NVIDIA document is wrong, but the established term for doing DMA from eg. an NVMe SSD to a GPU within a single system without the CPU initiating the transfer is peer to peer DMA. RDMA is when your data leaves the local machine's PCIe fabric.

wmfOP3mo ago

I'm going to agree to disagree with Nvidia here.

j / k navigate · click thread line to collapse