NVIDIA NVOS User Manual for InfiniBand Switches

IB Router Commands

nv action change system profile


nv action change system profile ib-routing {enabled|disabled} num-of-swids <1-4> [force]

Sets the profile of the system. 

Syntax Description

ib-routing

Enables/disables IB routing.

num-of-swids

Sets the number of SWIDs. Range: 1-4.
Valid values are 2-4 when IB routing is enabled, or 1 when IB routing is disabled.

force

Force the action without asking for user confirmation.

Default

ib-routing: disabled
num-of-swids: 1

History

25.02.7002


25.02.8008

Updated output of the command

Example

admin@nvos:~$ nv action change system profile ib-routing enabled num-of-swids 2
The operation will reset the system configuration and initiate a reboot.
The resulting system profile values will be:
ib-routing: enabled
num-of-swids: 2
adaptive-routing-groups: 1792
Type [y] to confirm the system profile change and reboot.
Type [N] to abort.
Do you want to continue? [y/N] y
Action executing ...
System will be rebooted, configurations and system files might be deleted
Action executing ...

admin@nvos:~$ nv action change system profile ib-routing disabled num-of-swids 1
The operation will reset the system configuration and initiate a reboot.
The resulting system profile values will be:
ib-routing: disabled
num-of-swids: 1
adaptive-routing-groups: 1792
Type [y] to confirm the system profile change and reboot.
Type [N] to abort.
Do you want to continue? [y/N] y
Action executing ...
System will be rebooted, configurations and system files might be deleted
Action executing ...


REST API

POST https://<id>/nvue_v1/system/profile

Related Commands

nv show system profile

Notes


nv set/unset interface link ib-subnet


nv set interface <interface-id> link ib-subnet <subnet-name>
nv unset interface <interface-id> link ib-subnet

Assigns an IB interface to the specified subnet (SWID).
The unset for of the command resets the interface to the default subnet (infiniband-default).

Syntax Description


interface-id

The IB interface name or range of IB interfaces

subnet-name

The target subnet name: infiniband-default, infiniband-1…infiniband-3

Default

infiniband-default

History

25.02.7002


25.02.8008

Updated output of the command

Example

admin@nvos:~$ nv set interface sw3-4p1-2 link ib-subnet infiniband-1
admin@nvos:~$ nv config apply -y
Warning: IB interface configuration is changed. In order to apply configuration the port will be restarted.

REST API

PATCH https://<ip>/nvue_v1/interface/<interface-id>/link

Related Commands

nv show interface
nv show interface link

Notes

  • Supported for IB ports only. FNM ports do not support ib-subnet configuration.

  • When changing the subnet of an interface, the other port on the same transceiver will be temporarily brought down, even if its subnet is not changing. For example, changing the subnet of sw1p1 will cause sw1p2 to be temporarily restarted.

nv show ib router routing-table


nv show ib router routing-table

Displays the IB routing table with one entry per subnet, showing the subnet name, subnet prefix, and validity status.

Syntax Description

N/A

Default

N/A

History

25.02.7002

Example

admin@nvos:~$ nv show ib router routing-table

IB Subnet           Subnet Prefix        Valid

------------------  -------------------  -------

infiniband-1        fec0:0000:0000:0002  true
infiniband-2        0000:0000:0000:0000  false
infiniband-3        0000:0000:0000:0000  false
infiniband-default  fec0:0000:0000:0001  true


REST API

GET https://<id>/nvue_v1/ib/router/routing-table

Related Commands

nv change system profile ib-routing num-of-swids
nv set interface link ib-subnet
nv show ib router ib-subnet

Notes

  • For an entry to be valid, at least one port must be assigned to the subnet and in UP state, and a correctly configured SM must be running on that subnet.

  • Valid true indicates that at least one port is assigned to the subnet and in UP state, and the entry was successfully configured by a Subnet Manager.

nv show ib router ib-subnet


nv show ib router ib-subnet

Displays detailed information for all subnets

Syntax Description

N/A

Default

N/A

History

25.02.8008

Example

admin@nvos:~$ nv show ib router ib-subnet
IB Subnet           Subnet Prefix        Logical State  Physical State  GIDs
------------------  -------------------  -------------  --------------  ---------------------------------------
infiniband-1        fec0:0000:0000:0002  Active         Up              fec0:0000:0000:0002:b8e9:2403:0000:b909
                                                                        fec0:0000:0000:0002:b8e9:2403:0000:b929
                                                                        fec0:0000:0000:0002:b8e9:2403:0000:b949
                                                                        fec0:0000:0000:0002:b8e9:2403:0000:b969
infiniband-2        0000:0000:0000:0000  Initialize     Up              0000:0000:0000:0000:b8e9:2403:0000:b90a
                                                                        0000:0000:0000:0000:b8e9:2403:0000:b92a
                                                                        0000:0000:0000:0000:b8e9:2403:0000:b94a
                                                                        0000:0000:0000:0000:b8e9:2403:0000:b96a
infiniband-3        0000:0000:0000:0000  Initialize     Up              0000:0000:0000:0000:b8e9:2403:0000:b90b
                                                                        0000:0000:0000:0000:b8e9:2403:0000:b92b
                                                                        0000:0000:0000:0000:b8e9:2403:0000:b94b
                                                                        0000:0000:0000:0000:b8e9:2403:0000:b96b
infiniband-default  fec0:0000:0000:0001  Active         Up              fe80:0000:0000:0000:b8e9:2403:0000:b908
                                                                        fe80:0000:0000:0000:b8e9:2403:0000:b928
                                                                        fe80:0000:0000:0000:b8e9:2403:0000:b948
                                                                        fe80:0000:0000:0000:b8e9:2403:0000:b968

REST API

GET https://<id>/nvue_v1/ib/router/ib-subnet

Related Commands

nv change system profile ib-routing num-of-swids
nv set interface link ib-subnet
nv show ib device
nv show ib device ib-subnet

Notes


nv show ib router ib-subnet subnet-name


nv show ib router ib-subnet <subnet-name>

Displays detailed information for a single IB subnet.

Syntax Description

subnet-name

The target subnet name: infiniband-default, infiniband-1…infiniband-3

Default

N/A

History

25.02.8008

Example

admin@nvos:~$ nv show ib router ib-subnet infiniband-1
                operational
--------------  ---------------------------------------
subnet-prefix   fec0:0000:0000:0002
logical-state   Active
physical-state  Up
[gid]           fec0:0000:0000:0002:b8e9:2403:0000:b909
[gid]           fec0:0000:0000:0002:b8e9:2403:0000:b929
[gid]           fec0:0000:0000:0002:b8e9:2403:0000:b949
[gid]           fec0:0000:0000:0002:b8e9:2403:0000:b969

REST API

GET https://<id>/nvue_v1/ib/router/ib-subnet/{ib-subnet-id}

Related Commands

nv change system profile ib-routing num-of-swids
nv set interface link ib-subnet
nv show ib router ib-subnet
nv show ib device
nv show ib device ib-subnet

Notes


nv show ib router ib-subnet subnet-name counters


nv show ib router ib-subnet <subnet-name> counters

Displays counters for a single IB subnet.

Syntax Description

subnet-name

The target subnet name: infiniband-default, infiniband-1…infiniband-3

Default

N/A

History

25.02.8008

Example

admin@nvos:~$ nv show ib router ib-subnet infiniband-1 counters
                                operational
------------------------------  -----------
in-bytes                        0 Bytes
in-pkts                         0
in-drops                        0
out-bytes                       0 Bytes
out-pkts                        0
out-drops                       0
out-errors                      0
out-unicast-pkts                0
out-multicast-pkts              0
in-unicast-pkts                 0
in-multicast-pkts               0
buffer-overrun-errors           0
out-wait                        0
link
  carrier-down-count            0
  error-recovery                0
  port-rcv-switch-relay-errors  0
  port-rcv-constraint-errors    0
  local-integrity-errors        0

REST API

GET https://<id>/nvue_v1/ib/router/ib-subnet/{ib-subnet-id}/counters

Related Commands

nv change system profile ib-routing num-of-swids
nv set interface link ib-subnet

Notes

in-errors are not supported (compared to IB port counters).


nv show ib router ib-subnet <subnet-name> counters link

Displays link counters for a single IB subnet.

Syntax Description

subnet-name

The target subnet name: infiniband-default, infiniband-1…infiniband-3

Default

N/A

History

25.02.8008

Example

admin@nvos:~$ nv show ib router ib-subnet infiniband-1 counters link
                              operational
----------------------------  -----------
carrier-down-count            0
error-recovery                0
port-rcv-switch-relay-errors  0
port-rcv-constraint-errors    0
local-integrity-errors        0

REST API

GET https://<id>/nvue_v1/ib/router/ib-subnet/{ib-subnet-id}/counters/link

Related Commands

nv change system profile ib-routing num-of-swids
nv set interface link ib-subnet
nv show ib router ib-subnet counters

Notes

port-rcv-remote-physical-errors are not supported (compared to IB port counters).

nv show ib router ib-subnet subnet-name gid


nv show ib router ib-subnet <subnet-name> gid

Displays GIDs of each ASIC for a single IB subnet.

Syntax Description

subnet-name

The target subnet name: infiniband-default, infiniband-1…infiniband-3

Default

N/A

History

25.02.8008

Example

admin@nvos:~$ nv show ib router ib-subnet infiniband-1 gid
GID                                      ASIC
---------------------------------------  -----
fec0:0000:0000:0002:b8e9:2403:0000:b909  ASIC1
fec0:0000:0000:0002:b8e9:2403:0000:b929  ASIC2
fec0:0000:0000:0002:b8e9:2403:0000:b949  ASIC3
fec0:0000:0000:0002:b8e9:2403:0000:b969  ASIC4

REST API

GET https://<id>/nvue_v1/ib/router/ib-subnet/{ib-subnet-id}/gid

Related Commands

nv change system profile ib-routing num-of-swids
nv set interface link ib-subnet
nv show ib router ib-subnet

Notes


nv show ib router counters


nv show ib router counters

Displays counters for all IB subnets.

Syntax Description

N/A

Default

N/A

History

25.02.8008

Example

admin@nvos:~$ nv show ib router --view counters
Counter                       infiniband-default  infiniband-1  infiniband-2  infiniband-3
----------------------------  ------------------  ------------  ------------  ------------
in-bytes                      0                   0             0             0
in-pkts                       0                   0             0             0
in-drops                      0                   0             0             0
out-bytes                     0                   0             0             0
out-pkts                      0                   0             0             0
out-drops                     0                   0             0             0
out-errors                    0                   0             0             0
out-unicast-pkts              0                   0             0             0
out-multicast-pkts            0                   0             0             0
in-unicast-pkts               0                   0             0             0
in-multicast-pkts             0                   0             0             0
buffer-overrun-errors         0                   0             0             0
out-wait                      0                   0             0             0
carrier-down-count            0                   0             0             0
error-recovery                0                   0             0             0
port-rcv-switch-relay-errors  0                   0             0             0
port-rcv-constraint-errors    0                   0             0             0
local-integrity-errors        0                   0             0             0

REST API

GET https://<id>/nvue_v1/ib/router

Related Commands

nv change system profile ib-routing num-of-swids
nv set interface link ib-subnet
nv show ib router ib-subnet subnet-name counters
nv show ib router ib-subnet subnet-name counters link

Notes


nv action clear ib router counters


nv action clear ib router counters

Clear counters for all IB subnets.

Syntax Description

N/A

Default

N/A

History

25.02.8008

Example

admin@nvos:~$ nv action clear ib router counters
Action executing ...
Cleared IB router counters successfully
Action succeeded

REST API

POST https://<id>/nvue_v1/ib/router

Related Commands

nv change system profile ib-routing num-of-swids
nv set interface link ib-subnet
nv show ib router ib-subnet subnet-name counters
nv show ib router ib-subnet subnet-name counters link
nv show ib router counters

Notes


Last updated: