Networking NVIDIA HPC-X Software Toolkit

HPC-X General Support

HPC-X Requirements

The platform and requirements for HPC-X are detailed in the following table:

Platform

Versions

CUDA

12.3+

GDRCopy 

2.3+

DOCA-Host

3.6.0

NCCL

2.22+

ConnectX-9

82.50.1002

BlueField-3

32.51.1002

ConnectX-8

40.51.1002

ConnectX-7

28.51.1002

ConnectX-6 Dx

22.51.1002

ConnectX-6 Lx

26.51.1002

ConnectX-6

20.43.8016

ConnectX-5/ConnectX-5 Ex

16.35.8008

XPMEM 

2.7

Grace-Hopper - GH200

N/A

HPC-X Content

The following communications libraries and acceleration packages are part of this NVIDIA HPC-X® package:

Library/Acceleration Package

Version Number

Open MPI1

4.1

Open MPI1

5.0

NVIDIA Scalable Hierarchical Aggregation and Reduction Protocol (SHARP)

3.17.3

HCOLL2

4.8.3236

UCX

1.23.0

UCC

1.10.0

ClusterKit3

1.15

nccl-rdma-sharp-plugin4

2.7

nccl_spcx_plugin

1.6.0

OSU Micro-Benchmarks

7.5.2

Intel MPI Benchmarks (IMB)

2021.10

  1. Open MPI v5.0.x is now the default MPI implementation in HPC-X. Open MPI v4.1.x is included in the tarball only. The RPM and DEB packages contain Open MPI v5.0.x only.

  2. HCOLL is not supported on GB200 and GB300 systems, with no plans for future support.

  3. ClusterKit is a multifaceted node assessment tool for high performance clusters.

  4. nccl-rdma-sharp plugin enables RDMA and Switch-based collectives (SHARP) with NVIDIA's NCCL library.

Important Note 


When HPC-X is launched with Open MPI without a resource manager job environment (slurm,pbs, etc.), or when it is launched from a compute node, the default rsh/ssh-based launcher will be used. This launcher does not propagate environment variables to the compute nodes. Thus, it is important to ensure the propagation of LD_LIBRARY_PATH variable from HPC-x is done as follows.

mpirun -x LD_LIBRARY_PATH -np 2 -H host1,host2  $HPCX_MPI_TESTS_DIR/examples/hello_c




Supported Platforms and Operating Systems

The following table lists the supported operating systems and CPUs for the latest HPC-X.

Starting from HPC-X v2.9, HPC-X will no longer support PPC architecture.

Operating System

Platforms

RHEL/CentOS/Rocky 8.x

x86_64, aarch64

RHEL/CentOS/Rocky 9.x

x86_64, aarch64

RHEL/CentOS/Rocky 10.x

x86_64, aarch64

CentOS 8.x Stream

x86_64

CentOS 9.x Stream

x86_64

CentOS 10.x Stream

x86_64

Oracle Linux 8.10

x86_64

Oracle Linux 9.4

x86_64, aarch64

SLES 15 SP6

x86_64

SLES 15 SP7

x86_64, aarch64

SLES 16.0

x86_64, aarch64

Ubuntu 22.04

x86_64, aarch64

Ubuntu 24.04

x86_64, aarch64

Ubuntu 26.04

x86_64, aarch64

Debian 12.x

x86_64

Debian 13.x

x86_64

Kylin 11 SP1

x86_64, aarch64

Last updated: