There is also NVLink c2c support between Nvidia's CPUs and GPUs that doesn't req... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		fenced_load 6 months ago \| parent \| context \| favorite \| on: Apple's MLX adding CUDA support There is also NVLink c2c support between Nvidia's CPUs and GPUs that doesn't require any copy, CPUs and GPUs directly access each other's memory over a coherent bus. IIRC, they have 4 CPU + 4 GPU servers already available.

benreesman 6 months ago [–]

Yeah NCCL is a whole world and it's not even the only thing involved, but IIRC that's the difference between 8xH100 PCI and 8xH100 SXM2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact