Networking ConnectX-7 Firmware Release Notes

Bug Fixes History

This section includes history of 3 major releases back. For older releases history, please refer to the relevant firmware versions.

Internal Ref.

Issue

5085054 / 5103944

Description: Resolved an issue where resetting the ID list register released only the domain counters.

Keywords: Counters

Detected in version:

28.49.1014

Fixed in Release:

28.50.1002

5083504 / NVbug 6078783

Description: Resolved an issue where firmware internal errors could occur due to FW_INTERNAL_USAGE partition data corruption. The firmware now recovers by erasing the corrupted partition.

Keywords: Firmware internal errors

Detected in version:

28.49.1014

Fixed in Release:

28.50.1002

5177191

Description: Resolved an issue with PLDM T5 component reporting. ConnectX devices now expose NIC firmware, NVIDIA NVConfig, and OEM NVConfig as independently updatable components. Optional NVConfig components may report an empty or 0 version and are shown only with PLDM T5 versions above 1.0.0.

Keywords: PLDM

Detected in version:

28.49.1014

Fixed in Release:

28.50.1002

4851684

Description: Resolved an issue where, under high-stress LRO traffic, an internal FIFO could enter a hardware deadlock state, preventing the NIC from receiving additional traffic.
The fix detects and releases the deadlock if it occurs, restoring the NIC to a functional state.

Keywords: LRO traffic

Detected in version:

28.49.1014

Fixed in Release:

28.50.1002

5174504 / 5140787

Description: Resolved an issue where intensive parallel QP INIT2RTR / DESTROY operations could incur high operation latency and reduce connection establishment rates when PCC was enabled.

Keywords: PCC, INIT2RTR, DOCA PCC

Detected in version:

28.49.1014

Fixed in Release:

28.50.1002

4947006 / 4980956 / 4982511

Description: Resolved two rare race conditions in the PCC steering extension when the feature is enabled through path migration, empty RTT, or a custom header.
Under rare timing conditions during QP creation or destruction, these issues could cause traffic disruption or resource leaks.

Keywords: PCC steering extension

Detected in version:

28.49.1014

Fixed in Release:

28.50.1002

4948901

Description: Resolved an issue where the PLDM firmware-update flow used incorrect instance_id tracking for retries, which could allow repeated old chunk responses to be accepted as new data.
The fix stores the actual transmitted request instance_id and uses it consistently during retries, preventing unexpected stale responses from being accepted.

Keywords: PLDM firmware-update flow

Detected in version:

28.46.3048

Fixed in Release:

28.50.1002

5166648

Description: Resolved an issue involving an uninitialized stack read and an inverted EtherType check in the RX parser.

Keywords: RX parser

Detected in version:

28.47.1026

Fixed in Release:

28.50.1002

4937640

Description: Resolved an issue where a PPCC mlxreg read operation could succeed when executed on a PF that is not the port owner, which could have security implications.

Keywords: PCC, PPCC

Detected in version:

28.49.1014

Fixed in Release:

28.50.1002

4517149

Description: Improved FLR and suspend/resume handling when VQoS was never enabled. In this case, there is no need to wait for all three iterations, since the wait was originally added to allow the SQ to be flushed from the distribution list. If VQoS was never enabled, there is nothing to clean up.

Keywords: FLR

Detected in version:

28.46.1006

Fixed in Release: 

28.50.1002

5180465

Description: Resolved an issue where, after an unexpected test termination while the max-entry-count ICMD was active, basic_debug could incorrectly report PSA error -30 because the expected steering_entry_count_limit event left a non-zero diagnostic context.

Keywords: max-entry-count ICMD

Detected in version:

28.49.1014

Fixed in Release: 

28.50.1002

5154717 / 5152076 / 5154806 / NVbug 6422398

Description: Resolved an issue where, when a transceiver module held its I2C management bus line stuck (SDA or SCL), the firmware detected the stuck bus and reset the module. After the reset, the module remained in low-power mode and its datapath was not re-established, preventing the link from coming up. On a shared module, all associated ports could drop simultaneously.

Keywords: Cables

Detected in version:

28.46.3048

Fixed in Release: 

28.50.1002

4923806 / 4867111 / 4927875

Description: Resolved an issue that could cause RoCE communication failures between specific NIC pairs after repeated queue pair (QP) create/destroy cycles. In the affected cases, traffic could enter a bad state and fail with transport retry counter exceeded errors. This fix prevents the NIC from entering that condition.

Keywords: RDMA; connection failure

Detected in version:

28.46.3048

Fixed in Release: 

28.50.1002

5093695

Description: Resolved an issue where using mlxconfig to configure all modules with the 0xff module split value could reset the modules to the default configuration.

Keywords: mlxconfig

Detected in version:

28.48.1000

Fixed in Release: 

28.50.1002

5090639

Description: Resolved an issue in single-domain mode where an FLR on a GVMI did not clear the per-domain usage bits in SP_core_diag_multi_domain->pcie_link_latency_max_read and SP_core_diag_multi_domain->pcie_link_latency_min_read. As a result, when the next GVMI took ownership and attempted to configure these counters, it could receive DIAG_DATA_LIST_WRITE_STATUS_NO_RESOURCES.

Keywords: PCIe Link Latency Arch counters

Detected in version:

28.49.1014

Fixed in Release: 

28.50.1002

4704203 / 4704271 / 4986813 / NVbug 5621969

Description: Resulved a constant packet drop issue that caused DeepEP test case traffic to hang.
The fix updates the STE search flow to run under a locking mechanism, preventing access to invalid STE entries that could result in packet drops.

Keywords: DeepEP

Detected in version:

28.46.1006

Fixed in Release: 

28.50.1002

5077326 / 4902171

Description: Resolved an issue where a slow module response to the NCSI GetModuleSerialData command could incorrectly trigger a dead IRISC watchdog assert. The firmware now handles this waiting state correctly, so slow module responses no longer cause a false watchdog hang indication.

Keywords: NCSI

Detected in version:

28.43.1014

Fixed in Release:

28.50.1002

5018241

Description: Resolved an issue where firmware could raise FATAL_ERR_HW_INDICATED with ext_synd 0x0063 during boot due to a misaligned MACsec ASO ICM base address. The ASO core hardware alignment check was triggered during the FLR-cleanup ICM sweep that runs at boot under SR-IOV with DPU-style INIs. The assert occurred only under this specific configuration combination, where latent issues in the ASO ICM resource table and libfhi static configuration aligned.

Keywords: FATAL_ERR_HW_INDICATED, FLR, SR-IOV

Detected in version:

28.49.1014

Fixed in Release: 

28.50.1002

4890697

Description: Resolved an issue where setting the SRQ limit during traffic over multiple QPs on the same SRQ could lead to stuck slices and an RX hang. The SRQ limit update mechanism was changed to avoid canceling end-to-end credit requests from slices.

Keywords: SRQ

Detected in version:

28.48.1000

Fixed in Release: 

28.50.1002

Internal Ref.

Issue

4980585 / NVBug 6084453

Description: Fixed an issue where NSM Get-Port-Network-Addresses returned an invalid format on B200/B300 HMC. It now follows the documented non-compact format.

Keywords: NSM Get-Port-Network-Addresses

Detected in version:

28.48.1000

Fixed in Release: 

28.49.1014

4971034 / 4967948

Description: Fixed an issue that could prevent the adapter’s PCIe link from re-establishing after the host resumed from a deep power-down state. This fix improves the reliability of suspend/resume cycles.

Keywords: PCIe (Standby / L2-L3 link recovery)

Detected in version:

28.48.1000

Fixed in Release:

28.49.1014

4885134 / 4875169 / 4885137 / 4892844

Description: Fixed PCIe link training failures on GB200 by correcting the equalization sequence logic.

Keywords: PCIe

Detected in version:

28.48.1000

Fixed in Release:

28.49.1014

4964566 / 4957757

Description: Fixed a DEAD IRISC assert that could occur during TLV NV_DATA flash access by suspending the watchdog while waiting for flash IPC (until timeout), preventing the assert on TLV access.

Keywords: DEAD IRISC assert

Detected in version:

28.48.1000

Fixed in Release:

28.49.1014

4657767 / 4658776 / 4874764 / 4874765

Description: Fixed an issue where repeatedly writing NVCONFIG TLVs could cause excessive NV_DATA partition swaps during garbage collection. This rapid cycling could accelerate flash wear (end-of-life at 100,000 erases) and potentially render the device inoperable.

Firmware now avoids unnecessary physical writes by returning OK when the requested configuration already exists in flash, and increases the maximum supported NV_DATA partition swaps from 100,000 to 200,000.

Keywords: NVCONFIG TLVs

Detected in version:

28.48.1000

Fixed in Release: 

28.49.1014

4871267 / 4871254

Description: Fixed an issue where ICM_RES_HW_DMFS_ENCAP_H_FW was allocated per GVMI, preventing some RTTs from using it.

Keywords: GVMI, RTT

Detected in version:

28.48.1000

Fixed in Release:

28.49.1014

4774394 / 4890471 / 4890472 / 4890473

Description: Fixed an issue where vDPA doorbell resources were not released, which could cause failures when running other functionality after a vDPA FLR. Doorbell resources are now properly unlocked.

Keywords: vDPA

Detected in version:

28.48.1000

Fixed in Release:

28.49.1014

4789601 / 4850200 / NVBug 5736447

Description: Fixed an issue where RDMA traffic could stall in large-scale deployments for certain source IP and UDP source-port combinations when DOCA PCC was active and no congestion-control algorithm was configured in algorithm slot 0.

Keywords: RDMA, DOCA PCC, Congestion Control Algorithm

Detected in version:

28.48.1000

Fixed in Release:

28.49.1014

4796182

Description: Fixed an issue where the live migration target did not receive a port state change event on the resume VHCA command. The target now generates this event so software that depends on port state is notified of any changes.

Keywords: Live migration

Detected in version:

28.47.1026

Fixed in Release:

28.49.1014

4873608 / 4921307

Description: Fixed an issue where a precopy image was processed during the stop-copy phase, causing prolonged downtime due to a software limitation. The handling was slow because the handler performed a linear search for data; this was improved by replacing it with a faster search approach enabled via compile-time preprocessing.

Keywords: Live Migration Downtime

Detected in version:

28.47.1026

Fixed in Release:

28.49.1014

4683339 / 4780301 / 4895260

Description: Fixed an issue where QPs established before loading DOCA PCC could exhibit inconsistent algorithm-selected behavior between ports in LAG mode after DOCA PCC is loaded.

Keywords: Congestion Control, DOCA PCC

Detected in version:

28.47.1026

Fixed in Release: 

28.49.1014

4867969 / 4868140

Description: Fixed an issue where, on ConnectX-7 Multi-ASIC systems, initializing the maximum number of VFs concurrently with large MSI-X allocations could hit ICMC resource limits; note that the 320 KB allocation remains mandatory on affected devices.

Keywords: ICMC memory allocation

Detected in version:

28.47.1026

Fixed in Release:

28.49.1014

Internal Ref.

Issue

4578581 / 4626296

Description: Fixed an interoperability issue where, when ConnectX-7 communicates with ConnectX-8 using the probe-based algorithm, bandwidth could become extremely low due to probe packets being dropped.

Keywords: Interoperability, Congestion Control, RTT

Detected in version:

28.47.1026

Fixed in Release:

28.48.1000

4786813

Description: Fixed an issue where the DPA kernel used unsafe ICM access during process creation/modification, which could cause the DPA kernel to hang during FLR.

Keywords: DPA kernel, FLR

Detected in version:

28.47.1026

Fixed in Release: 

28.48.1000

4804664 / 4806969

Description: Fixed an issue in the User Debugger “query caps” where it returned only the number of capabilities, not the capability bitmap.

Keywords: User Debugger “query caps”

Detected in version:

28.47.1026

Fixed in Release:

28.48.1000

4859700 / NVbug 5828711

Description: Fixed an issue caused by a race condition in standby/boot power sequencing. In certain timing windows, port power-down could be delayed such that the power-up flow detected the port still transitioning to power-down, causing the sequence to fail and leaving the port stuck in a powered-down state.

Keywords: PXE boot

Detected in version:

28.47.1026

Fixed in Release: 

28.48.1000

4484662

Description: Fixed an issue where mlxlink reported 0 values for SNR (media and host) due to incorrect local port mapping in firmware and an incorrect page number used by MFT.

Keywords: mlxlink

Detected in version:

28.47.1026

Fixed in Release:

28.48.1000

4744039

Description: Fixed an issue where, due to an SMBus release race condition, the I2C bus could become stuck.

Keywords: SMBus, I2C bus

Detected in version:

28.47.1026

Fixed in Release:

28.48.1000

4773490 / 4823336

Description: Fixed an issue where fuse values were not aligned with the updated values burned across different ConnectX-7 setups.

Keywords: Fuse values

Detected in version:

28.47.1026

Fixed in Release:

28.48.1000

4532684 / 4635872 / 4794865 / 4794866 / 4794867 / NVbug 5385446

Description: Fixed an issue by improving the ADP-RETX algorithm to avoid re-arming without performing a retransmission.

Keywords: ADP-RETX algorithm

Detected in version:

28.47.1026

Fixed in Release:

28.48.1000

4727303 / 4718947

Description: Fixed an issue in the steering definers used for LAG with IPv6 traffic.

Keywords: LAG, IPv6 traffic, steering

Detected in version:

28.47.1026

Fixed in Release:

28.48.1000

4663915

Description: Fixed an issue where a spurious CNP was sent in response to an out-of-sequence packet.

Keywords: PCC, CNP, OOS, RP, NP

Detected in version:

28.47.1026

Fixed in Release:

28.48.1000

4450570 / 4780432 / 4780433

Description: Fixed an issue where the root complex sent MCTP-over-PCI messages before a BDF was assigned, causing responses to be sent with BDF 0. The fix ensures that MCTP messages routed by ID are ignored until a valid BDF is assigned.

Keywords: MCTP-over-PCI, BDF, MCTP messages

Detected in version:

28.47.1026

Fixed in Release: 

28.48.1000

4809134 / 4824635

Description: Fixed an issue where the steering tables were not updated after enabling partial Spectrum-X capabilities (BTH.AR) via LLPD.

Keywords: Steering tables, LLDP

Detected in version:

28.47.1026

Fixed in Release: 

28.48.1000

2169950

Description: When decapsulation on a packet occurs, the FCS indication is not calculated correctly.

Keywords: FCS

Discovered in Version:

28.42.1000

Fixed in Release: 

28.48.1000

3735988


Description: In IB system, RTT_response_sl feature does not work with Sniffer tools (e.g., Wireshark/Tcpdump/).

Keywords: Health buffer, sniffer, RTT

Discovered in Version: 

28.40.1000

Fixed in Release: 

28.48.1000

Internal Ref.

Issue

4608544

Description: Fixed an issue where, in rare live migration scenarios, a delayed doorbell triggered a false timeout alarm.

Keywords: Live migration, doorbell, timeout alarm

Detected in version:

28.46.1006

Fixed in Release: 

28.47.1088

4648642

Description: Fixed a rare issue in which destroying PCC NP configuration objects could result in assert 0x8175 being logged in dmesg.

Keywords: Assert 0x8175, PCC NP

Detected in version:

28.47.1026

Fixed in Release:

28.47.1088

4718947

Description: Fixed an issue in the steering definers used for LAG with IPv6 traffic.

Keywords: LAG, IPv6 traffic, steering

Detected in version:

28.47.1026

Fixed in Release:

28.47.1088

4690503

Description: Fixed an issue where creating a DPA process that uses 128 MB of data caused the dynamic library to fail with syndrome 0xdc30ac. The BSS section of the DPA application is now limited to 64 MB.

Keywords: DPA process, BSS

Detected in version:

28.47.1026

Fixed in Release:

28.47.1088

4683823

Description: Some diagnostic data counters share hardware resources and cannot be configured simultaneously since 64-bit counter formats (e.g., DIAG_DATA_PARAMS_CONTEXT.output_format set to FORMAT_0 or FORMAT_1) consume more hardware resources per counter.

Keywords: DOCA Telemetry Diagnostics

Detected in version:

28.47.1026

Fixed in Release: 

28.47.1088

Internal Ref.

Issue

4570205

Description: Fixed a firmware issue where the ZTR_RTTCC algorithm parameters AI and HAI did not support a sufficient range.

Keywords: PCC, ZTR_RTTCC

Detected in version:

28.46.1006

Fixed in Release:

28.47.1026

4629077

Description: Fixed an issue where coalescing regular SX events with SX RTT events under ZTR_RTTCC could keep improper event fields, which could impact congestion control behavior.

Keywords: PCC, ZTR_RTTCC

Detected in version:

28.46.1006

Fixed in Release: 

28.47.1026

4683328

Description: Fixed an issue in the ZTR_RTTCC algorithm where probe-abortion handling could behave improperly under high-stress network conditions, ensuring proper congestion control and stable traffic performance.

Keywords: PCC, ZTR_RTTCC

Detected in version:

28.46.1006

Fixed in Release:

28.47.1026

4501554

Description: Fixed an assertion failure that could occur with the E-Switch uplink in specific configurations where the e-switch was disabled and Path Migration was active or GVMIs were using SRQ loopback in SQs. The issue occurred because the firmware attempted to perform cleanup operations when the uplink configuration lacked sufficient capacity.
Now, when the E-Switch is disabled and no actions are available in the uplink STE, the firmware connects to the uplink STE instead of copying it.

Keywords: Path migration, steering

Detected in version:

28.46.1006

Fixed in Release:

28.47.1026

4506854

Description: Added Scaling Factor "read" field. To obtain correct values in mlxlink, MFT version 4.33.0 or later is required.

Keywords: Scaling Factor, mlxlink, MFT

Detected in version:

28.46.1006

Fixed in Release:

28.47.1026

4540897

Description: Added a recovery mechanism for I²C failures. In case of an I²C communication failure, the system now automatically attempts to recover and reinitialize the I/O expander to maintain continuous operation.

Keywords: I2C failures, recovery mechanism

Discovered in Version:

28.45.1020

Fixed in Release:

28.47.1026

4560691

Description: Fixed an issue in the MCTP SMBus configuration to ensure proper initialization and reliable communication between firmware components using the SMBus transport.

Keywords: MCTP SMBus configuration

Discovered in Version:

28.45.1020

Fixed in Release:

28.47.1026

4529293

Description: Fixed an issue where, during failover or restart, the SM sending a PortInfo MAD to the HCA firmware triggered reinitialization of port buffers, momentarily halting ingress traffic and causing packet drops.
The firmware now avoids reconfiguring port buffers when the new configuration matches the current one.

Keywords: OpenSM

Discovered in Version:

28.45.1020

Fixed in Release:

28.47.1026

4683346

Description: Fixed an issue where, under the ZTR_RTTCC algorithm, a flow that reached its minimum rate due to heavy congestion would not recover its rate once the congestion cleared.

Keywords: PCC, ZTR_RTTCC

Discovered in Version:

28.46.1006

Fixed in Release:

28.47.1026

4213025

Description: Fixed an issue where destroying or modifying a DPA partition from a non-owner VHCA was incorrectly allowed, such actions are now properly disallowed.

Keywords: VHCA

Discovered in Version:

28.46.1006

Fixed in Release:

28.47.1026

4133425

Description: Fixed an issue where PTP was not supported when the port speed was configured to 1G.

Keywords: PTP

Discovered in Version:

28.46.1006

Fixed in Release:

28.47.1026

Internal Ref.

Issue

4603774

Description: Fixed an issue where the adapter card could drop NC-SI over MCTP commands when padding bytes were present after the NC-SI checksum.

Keywords: NC-SI

Discovered in Version:

28.46.1006

Fixed in Release:

28.46.3048

Internal Ref.

Issue

4501157 / 4257750

Description: Fixed a critical issue with a live firmware patch.

Keywords: Live firmware patch

Discovered in Version:

28.45.1020

Fixed in Release:

28.46.1006

4516394

Description: Fixed an uncleared state caused performance degradation after migration when there were significant differences in resource allocation by ensuring the state is cleared beforehand.

Keywords: Performance

Discovered in Version:

28.45.1020

Fixed in Release:

28.46.1006

4286902

Description: Fixed a race condition in DPA process termination during the exception flow, where a failed process could be missed and not reported to the user.

Keywords: DPA

Discovered in Version:

28.45.1020

Fixed in Release:

28.46.1006

4420567

Description: Removed an unnecessary and partially incorrect firmware check that blocked valid action list permutations allowed by the PRM. Validation of these permutations remains the responsibility of the software.

Keywords: Header actions

Discovered in Version:

28.45.1020

Fixed in Release:

28.46.1006

4443601

Description: Fixed a firmware issue where PXE failed to boot when both LAG ports were up.

Keywords: PXE, LAG

Discovered in Version:

28.45.1020

Fixed in Release:

28.46.1006

4443601

Description: Fixed a firmware issue where PXE failed to boot when both LAG ports were up.

Keywords: PXE, LAG

Discovered in Version:

28.45.1020

Fixed in Release:

28.46.1006

4475307

Description: Fixed an issue where PCC DCQCN used incorrect parameter values when link speed was 400Gbps or higher.

Keywords: PCC DCQCN, congestion control

Discovered in Version:

28.45.1020

Fixed in Release:

28.46.1006

4480427

Description: Fixed incorrect calculation of start address and mode for the CQE buffer in DPA CQ, which could cause CQEs to be written to the wrong address when the buffer is not 4K-aligned and spans a second page boundary.

Keywords: CQ, CQE Buffer, DPA

Discovered in Version:

28.45.1020

Fixed in Release:

28.46.1006

4490103

Description: Fixed the restart timing for the OSFP connector at 400 kHz I2C frequency.

Keywords: Restart timing, OSFP, I2C frequency

Discovered in Version:

28.44.1036

Fixed in Release:

28.46.1006

4416919

Description: Updated Diagnostic Counters interface to prevent the following counters from being cleared after read: pcie_link_latency_total_read_packet and pcie_link_latency_total_read_ns.

Keywords: Diagnostic Counters interface

Discovered in Version:

28.45.1020

Fixed in Release:

28.46.1006

4520774

Description: Fixed an issue preventing adp_retx profile in the ROCE_ACCL access register from being set when there are outstanding QPs on the PF or VF.

Keywords: ROCE_ACCL access register, QPs, PF, VF

Discovered in Version:

28.45.1020

Fixed in Release:

28.46.1006

4403143

Description: Fixed an issue where CREATE_DPA_PROCESS could fail if a DESTROY_DPA_PROCESS (still running during destroy) was executed on a different VHCA. Also addressed a possible failure of CREATE_DPA_PROCESS after FLR.

Keywords: DPA_PROCESS, FLR

Discovered in Version:

28.45.1020

Fixed in Release:

28.46.1006

4388371

Description: Fixed an issue where an uninitialized pport in the SLRG command, when using the SMP interface, caused an assertion failure.

Keywords: SLRG, SMP interface, pport

Discovered in Version:

28.45.1020

Fixed in Release:

28.46.1006

4531558

Description: Fixed inconsistent LED behavior where the LED color for max speed was yellow and green otherwise, contrary to specification, due to a swapped GPIO mapping between control and PHY LEDs in the INI file.

Keywords: LED

Discovered in Version:

28.45.1020

Fixed in Release:

28.46.1006

4470053

Description: Fixed an issue with vQoS parameter configuration to improve latency handling for large messages.

Keywords: vQoS, latency

Discovered in Version:

28.45.1020

Fixed in Release:

28.46.1006

4366117

Description: Configuring a small MTU leads to fragmentation of packets critical for the PXE boot process. As a result, the PXE boot filters mistakenly discard these packets, causing the PXE boot to fail. 

Keywords: PXE boot filters

Detected in version:

28.45.1020

Fixed in Release:

28.46.1006

4475307

Description: Fixed an issue where PCC DCQCN used incorrect parameter values when link speed was 400Gbps or higher.

Keywords: PCC DCQCN, congestion control.

Detected in version:

28.45.1020

Fixed in Release:

28.46.1006

4486431

Description: Fixed an issue where issuing multiple parallel queries of DPA_THREAD objects with the same object ID could fail.

Keywords: DPA

Discovered in Version:

28.45.1020

Fixed in Release:

28.46.1006

4497103

Description: Fixed the setting of the adaptive retransmission profile.

Keywords: Adaptive retransmission profile

Discovered in Version:

28.45.1020

Fixed in Release:

28.46.1006

Last updated: