Networking NVIDIA NVOS User Manual for InfiniBand Switches

Plane-Port Telemetry

NVOS enables users to monitor the telemetry for the individual plane ports that constitute an aggregate port.

How It Works

The InfiniBand plane-port telemetry feature can be enabled or disabled in NVOS using NVUE CLI commands.

Show command:

nvos@switch:~$ nv show system plane-port
          operational  applied
--------  -----------  -------
state     disabled     disabled                      

Set command:

nvos@switch:~$ nv set system plane-port state <enabled | disabled>

Unset command:

nvos@switch:~$ nv unset system plane-port state

The feature is disabled by default. The unset command restores the state to disabled if it is not already disabled.

Plane-port telemetry data can be accessed through:

  • The nv show interface CLI command hierarchy

  • gNMI

Viewing Plane-Ports

When plane-port support is enabled, plane ports appear as read-only entities alongside aggregate ports in both NVUE and gNMI output. The type field is set to ibpp, indicating an InfiniBand plane port.

For example:

admin@nvos:~$ nv show interface
Interface  State  Speed  MTU    Type      Description  IB Speed  IB Subnet           Logical State  Physical State             Summary
---------  -----  -----  -----  --------  -----------  --------  ------------------  -------------  -------------------------  ----------------------------------------------------
sw1p1      down                 ib                               infiniband-default  Down           Disabled
sw1p1pl1   down                 ibpp                             infiniband-default  Down           Disabled
sw1p1pl2   down                 ibpp                             infiniband-default  Down           Disabled
sw1p1pl3   down                 ibpp                             infiniband-default  Down           Disabled
sw1p1pl4   down                 ibpp                             infiniband-default  Down           Disabled
sw1p2      up     800G   4096   ib                     xdr       infiniband-default  Active         LinkUp
sw1p2pl1   up     200G   4096   ibpp                   xdr       infiniband-default  Active         LinkUp
sw1p2pl2   up     200G   4096   ibpp                   xdr       infiniband-default  Active         LinkUp
sw1p2pl3   up     200G   4096   ibpp                   xdr       infiniband-default  Active         LinkUp
sw1p2pl4   up     200G   4096   ibpp                   xdr       infiniband-default  Active         LinkUp
...

All existing nv show interface commands also apply to plane ports.

Viewing a Specific Plane-Port

To inspect a specific plane-port, run the following command:

admin@nvos:~$ nv show interface sw1p1pl1

To view counters, run the following command:

admin@nvos:~$ nv show interface sw1p1pl1 counters

To view link information, run the following command:

admin@nvos:~$ nv show interface sw1p1pl1 link

See the Plane-Port Telemetry Commands section below for full details and output examples.

Plane-Port Telemetry Commands

Last updated: