Networking ConnectX-9 Firmware Release Notes

Changes and New Feature History

Feature/Change

Description

82.49.1014

PCC/ZTR-RTT Congestion-Control Histogram Collection

Added support for Congestion-Control histogram collection in the PCC/ZTR-RTT algorithm. After enabling this capability, customers can read RATE and RTT histogram counters for PCC-managed flows.

Precoded Data Reception Configuration

Added automatic configuration for Tx precoding at 200G/lane based on the transceiver's Command Data Block (CDB). The default setting for Rx precoding remains ON.

PCC TopoAware PLB (probe_metadata Behavior)

PCC_CONFIG.probe_metadata is now supported as a global setting that applies uniformly across all probe slots. Updates made via CREATE/MODIFY (regardless of probe_type_slot) propagate to all slots.

ZTR_RTTCC Tunable Probe Timeout

Added a new parameter to the ZTR_RTTCC algorithm to define the probe-packet timeout threshold.

PTP/PPS/SyncE over I2C DC‑TCXO

Firmware now enables full timing functionality on ConnectX‑9: PTP (Precision Time Protocol, IEEE 1588) time synchronization, PPS (Pulse Per Second) input/output, and SyncE (Synchronous Ethernet) frequency synchronization on platforms that use an external DC‑TCXO. This is done by adding I2C-based control of the DC‑TCXO so the NIC can steer/discipline its reference clock for accurate and stable timing.

Link up/Down dmesg Messages

When powering down the OSFP port, the link up/down dmesg messages were previously sent only to the primary ASIC, they are now sent to the secondary ASIC as well.

PSP Transport Packet Reformat

Added support for a new packet reformat type for PSP transport packets. This reformat removes the PSP trailer and the UDP + PSP transport headers, and updates the IP Protocol field based on the PSP next_header value.

Persistent CRDT Token

CRDT token behavior has changed and is now persistent.

Previously, debug firmware was allowed only if a CRDT token was applied temporarily, meaning it was erased after reset, or if another debug firmware was already running. Once a user moved to production firmware, a new token was required to switch back to debug firmware.

With the new behavior, the token is saved to flash, meaning it remains readable via MDSR even after reset. Once installed, the token allows the user to move between debug and production firmware until it is explicitly revoked using the MDSR set command.

Extended Recovery Support for XDR Optics

Added support for extended recovery on XDR optics when the peer device also supports the capability. This enhancement improves link recovery behavior by allowing both sides of the connection to use the extended recovery mechanism, helping increase resiliency in supported XDR optic configurations.

Bug Fixes

See Bug Fixes section.

For the list of changes and bug fixes in earlier versions, see Release Notes History section.


Feature/Change

Description

82.48.1000

General

This is the initial firmware release for the NVIDIA® ConnectX®-9 SuperNIC.

ConnectX-9 provides the same feature set as the ConnectX-8 adapter card. For a complete list of ConnectX-8 firmware features, refer to the ConnectX-8 Firmware Release Notes.

The features described below are new and are provided in addition to the existing ConnectX-8 feature set.

Lane Margin Test (LMT)

Lane Margin Test (LMT) is a PCIe diagnostic tool that performs controlled per-lane margining in the voltage and timing domains to evaluate link robustness. It helps identify weak or unstable lanes and supports signal-integrity validation, platform bring-up, and long-term reliability analysis.

Notes:

  • NVIDIA recommends setting the error threshold to 2. LMT is a destructive test, link drops or performance degradation may occur; if this happens, rerun the test.

  • NVIDIA also recommends disabling drivers before starting the Lane Margin Test.

T10 Data Integrity (DIF)

This capability provides block-level data protection by appending a Data Integrity Field (DIF) to each block, including checksums and metadata. The firmware automatically verifies these fields during reads, writes, and data transfers, helping to detect and prevent data corruption, ensure end-to-end data integrity, and increase reliability for critical storage workloads. By enabling T10 DIF, systems can achieve more robust data protection, reducing the risk of silent errors and improving overall storage confidence.

Cyclic Redundancy Check (CRC)

CRC provides a fast and reliable method to detect data corruption by generating a checksum for each block of data. The firmware automatically verifies CRC values during reads, writes, and transfers, helping to detect and prevent silent data errors, ensure end-to-end data integrity, and increase overall system reliability. By leveraging CRC, storage systems can maintain high confidence in critical workloads and minimize the risk of data loss.

Transport Layer Security (TLS) Handshake

The TLS handshake establishes a secure communication session by authenticating endpoints, negotiating cryptographic algorithms, and securely exchanging encryption keys before data transfer begins. This process ensures confidentiality of data in transit, protection against tampering and man-in-the-middle attacks, and trusted identity verification, enabling secure and reliable communication for sensitive and high-value workloads.

NVMe over TCP Acceleration

This capability offloads and accelerates NVMe/TCP data path processing to hardware, reducing CPU overhead and latency while increasing throughput. By streamlining NVMe command processing and TCP handling, it enables higher IOPS, lower and more predictable latency, and improved host CPU efficiency, making it ideal for scalable, high-performance, and cloud-based storage deployments.

DPA Process Limit Update

The system-wide limit for DPA processes has been reduced to 30. This total includes both user processes across all GVMIs and internal ProgCC processes. The max_dpa_processes value reported to the user is calculated as: max_dpa_processes=30−number_of_progcc_processes

Host Rate Limiting Support Above 255 Gbps

Host rate limiting has been extended to support bandwidth values above 255 Gbps.

To remove the previous cap, a new max_bw_value_msb field was added to est_global, providing additional MSB bits to represent higher bandwidth values. With this enhancement, firmware and host tooling can correctly configure and report rate limits beyond 255 Gbps on high-speed links.

PLDM PDR Repository Change Event Support

PLDM now supports the PDR Repository Change event type, enabling notification to the BMC when PDRs change. With this flow, the BMC can detect cable insertion/removal events. Refer to DSP0248 for details.

BMC Write-Protection Check on Firmware Update Failure

Added a validation step during firmware updates to detect whether the BMC is asserting write protection, helping diagnose and prevent update failures.

CMB SysRAM Window Partitioning for PSC Isolation

CMB configuration enforces secure access to System RAM (SysRAM) by defining memory windows and partitions that isolate the Platform Security Controller (PSC) from other system components.

Physical Access Monitor and Protection

The Physical Monitor feature helps protect the platform against threats from attackers with physical access to the system. It monitors for physical-access events and enforces safeguards that prevent or restrict sensitive operations, reducing the risk of exposing secure information or compromising security-critical functionality.

Parallel Save/Load Support for VF Migration

Added support for running save and load operations in parallel, enabling multiple contexts (e.g., multiple VFs) to be checkpointed and restored concurrently instead of serially. This reduces overall migration time and improves scalability in environments that need to migrate or recover many VFs at once.

NVGRE VSID Modify-Header Support

Extended packet modify-header operations to support set and copy actions on the NVGRE VSID (Virtual Subnet Identifier). A new field, TUNNEL_HDR_DW_2 (0x84), enables dynamic VSID modification, adding header rewrite support for NVGRE tunnel traffic in addition to existing filtering capabilities.

mlxlink

mlxlink show_links now reports the full PCIe identifier (domain/segment + BDF), improving device-to-link mapping and avoiding ambiguous/duplicate BDF entries on multi-domain systems.

Last updated: