NVIDIA ConnectX-6 Dx Ethernet Adapter Cards User Manual

Note

You can download a PDF version here.

About This Manual

This User Manual describes NVIDIA® ConnectX®-6 Dx Ethernet adapter cards. It provides details as to the interfaces of the board, specifications, required software and firmware for operating the board, and relevant documentation.

Ordering Part Numbers

The table below provides the ordering part numbers (OPN) for the available ConnectX-6 Dx adapter cards designed to fit into Half-Height, Half-Length (HHHL) slots.

Configuration

NVIDIA SKU

Legacy OPN

Marketing Description

25GbE Cards

900-9X6AP-0073-ST0

MCX623102AS-ADAT

ConnectX-6 Dx EN adapter card, 25GbE, Dual-port SFP28, PCIe 4.0 x16, Secure Boot, No Crypto, Tall Bracket

25GbE with Active Cooling Cards

900-9X663-0073-SQ0

MCX621202AS-ADAT

ConnectX-6 Dx EN adapter card, 25GbE, with active cooling, Dual-port SFP28, PCIe 4.0 x8, Secure Boot, No Crypto, Tall Bracket

900-9X663-0083-SQ0

MCX621202AC-ADAT

ConnectX-6 Dx EN adapter card, 25GbE, with active cooling, Dual-port SFP28, PCIe 4.0 x8, Crypto and Secure Boot, Tall Bracket

100GbE Cards

900-9X6AG-0016-ST0

MCX623105AN-CDAT

ConnectX-6 Dx EN adapter card, 100GbE, Single-port QSFP56, PCIe 4.0 x16, No Crypto, Tall Bracket

900-9X6AG-0086-ST0(a)

MCX623106AC-CDAT

ConnectX-6 Dx EN adapter card, 100GbE, Dual-port QSFP56, PCIe 4.0 x16, Crypto and Secure Boot, Tall Bracket

900-9X6AG-0056-ST1

MCX623106AN-CDAT

ConnectX-6 Dx EN adapter card, 100GbE, Dual-port QSFP56, PCIe 4.0 x16, No Crypto, Tall Bracket

900-9X6AG-0076-ST0

MCX623106AS-CDAT

ConnectX-6 Dx EN adapter card, 100GbE, Dual-port QSFP56, PCIe 4.0 x16, Secure Boot, No Crypto, Tall Bracket

100GbE with PPS In/Out Cards

900-9X6AK-0086-SQ0(a)

MCX623106TC-CDAT

ConnectX-6 Dx EN adapter card, 100GbE, Dual-port QSFP56, Enhanced-SyncE & PTP, PPS In/Out, PCIe 4.0 x16, Crypto and Secure Boot, FHHL with Tall Bracket

900-9X6AK-0086-SQ1(a)

MCX623106GC-CDAT

ConnectX-6 Dx EN adapter card, 100GbE, Dual-port QSFP56, Enhanced-SyncE & PTP GM support and GNSS, PPS Out, PCIe 4.0 x16, Crypto and Secure Boot, FHHL with Tall Bracket

200GbE Cards

900-9X6AG-0048-ST0(a)

MCX623105AC-VDAT

ConnectX-6 Dx EN adapter card, 200GbE, Single-port QSFP56, PCIe 4.0 x16, Crypto and Secure Boot, Tall Bracket

900-9X6AG-0018-ST0

MCX623105AN-VDAT

ConnectX-6 Dx EN adapter card, 200GbE, Single-port QSFP56, PCIe 4.0 x16, No Crypto, Tall Bracket

Note:

(a) If your target application for this crypto-enabled card will utilize 100Gb/s or higher bandwidth, where a substantial part of the bandwidth will be allocated for IPsec traffic, please refer to the NVIDIA ConnectX-6 Dx Cards Product Release Notes document to learn about a potential bandwidth limitation. See Related Documents section for details on accessing the document.

Legacy (EOL) Ordering Part Numbers

Legacy OPN

Marketing Description

MCX621102AN-ADAT

ConnectX-6 Dx EN adapter card, 25GbE, Dual-port SFP28, PCIe 4.0 x8, No Crypto, Tall Bracket

MCX621102AC-ADAT

ConnectX-6 Dx EN adapter card, 25GbE, Dual-port SFP28, PCIe 4.0 x8, Crypto and Secure Boot, Tall Bracket

MCX623102AC-ADAT

ConnectX-6 Dx EN adapter card, 25GbE, Dual-port SFP28, PCIe 4.0 x16, Crypto and Secure Boot, Tall Bracket

MCX623102AN-ADAT

ConnectX-6 Dx EN adapter card, 25GbE, Dual-port SFP28, PCIe 4.0 x16, No Crypto, Tall Bracket

MCX621102AE-ADAT

ConnectX-6 Dx EN adapter card, 25GbE, Dual-port SFP28, PCIe 4.0 x8, Crypto, No Secure Boot, Tall Bracket

MCX623102AC-GDAT

ConnectX-6 Dx EN adapter card, 50GbE, Dual-port SFP56, PCIe 4.0 x16, Crypto and Secure Boot, Tall Bracket

MCX623102AN-GDAT

ConnectX-6 Dx EN adapter card, 50GbE , Dual-port SFP56, PCIe 4.0 x16, No Crypto, Tall Bracket

MCX623102AE-GDAT

ConnectX-6 Dx EN adapter card, 50GbE, Dual-port SFP56, PCIe 4.0 x16, Crypto, No Secure Boot, Tall Bracket

MCX623102AS-GDAT

ConnectX-6 Dx EN adapter card, 50GbE, Dual-port SFP56, PCIe 4.0 x16, Secure Boot, No Crypto, Tall Bracket

MCX623106PC-CDAT

ConnectX-6 Dx EN adapter card, 100GbE, Dual-port QSFP56, with PPS In/Out, PCIe 4.0 x16, Crypto and Secure Boot, Tall Bracket

MCX623105AC-CDAT

ConnectX-6 Dx EN adapter card, 100GbE, Single-port QSFP56, PCIe 4.0 x16, Crypto and Secure Boot, Tall Bracket

MCX623105AE-CDAT

ConnectX-6 Dx EN adapter card, 100GbE, Single-port QSFP56, PCIe 4.0 x16, Crypto, No Secure Boot, Tall Bracket

MCX623106AE-CDAT

ConnectX-6 Dx EN adapter card, 100GbE, Dual-port QSFP56, PCIe 4.0 x16, Crypto, No Secure Boot, Tall Bracket

MCX623109AC-CDAT

ConnectX-6 Dx EN adapter card, 100GbE, Single-port DSFP, PCIe 4.0 x16, Crypto and Secure Boot, Tall Bracket

MCX623109AN-CDAT

ConnectX-6 Dx EN adapter card, 100GbE , Single-port DSFP, PCIe 4.0 x16, No Crypto, Tall Bracket

MCX623106GN-CDAT

ConnectX-6 Dx EN adapter card, 100GbE, Dual-port QSFP56, Enhanced-SyncE & PTP GM support and GNSS, PPS Out, PCIe 4.0 x16, No Crypto, Tall Bracket

MCX623106PC-CDAT

ConnectX-6 Dx EN adapter card, 100GbE, Dual-port QSFP56, with PPS In/Out, PCIe 4.0 x16, Crypto and Secure Boot, Tall Bracket

MCX623106PE-CDAT

ConnectX-6 Dx EN adapter card, 100GbE, Dual-port QSFP56, with PPS In/Out, PCIe 4.0 x16, Crypto, No Secure Boot, Tall Bracket

MCX623106PN-CDAT

ConnectX-6 Dx EN adapter card, 100GbE, Dual-port QSFP56, with PPS In/Out, PCIe 4.0 x16, No Crypto, Tall Bracket

MCX623106TN-CDAT

ConnectX-6 Dx EN adapter card, 100GbE, Dual-port QSFP56, with PPS In/Out, PCIe 4.0 x16, No Crypto, Tall Bracket

MCX623105AE-VDAT

ConnectX-6 Dx EN adapter card, 200GbE, Single-port QSFP56, PCIe 4.0 x16, Crypto, No Secure Boot, Tall Bracket

MCX623105AS-VDAT

ConnectX-6 Dx EN adapter card, 200GbE, Single-port QSFP56, PCIe 4.0 x16, Secure Boot, No Crypto, Tall Bracket

Intended Audience

This manual is intended for the installer and user of these cards. The manual assumes basic familiarity with Ethernet network and architecture specifications.

Technical Support

Customers who purchased NVIDIA products directly from NVIDIA are invited to contact us through the following methods:

Customers who purchased NVIDIA M-1 Global Support Services, please see your contract for details regarding Technical Support.Customers who purchased NVIDIA products through an NVIDIA-approved reseller should first seek assistance through their reseller.
Related Documentation

NVIDIA MLNX_OFED for Linux User Manual and Release Notes

User Manual and Release Notes describing MLNx_OFED features, performance, band diagnostic, tools content, and configuration. See NVIDIA MLNX_OFED for Linux Documentation.

WinOF-2 for Windows User Manual and Release Notes

User Manual describing WinOF-2 features, performance, Ethernet diagnostic, tools content, and configuration. See WinOF-2 for Windows Documentation.

NVIDIA VMware for Ethernet User Manual and Release Notes

User Manual describing the various components of the NVIDIA ConnectX® NATIVE ESXi stack. See VMware® ESXi Documentation.

NVIDIA Firmware Update

NVIDIA firmware update and query utility used to update the firmware. See NVIDIA Firmware Utility (mlxup) Documentation.

NVIDIA Firmware Tools (MFT) User Manual

User Manual describing the set of MFT firmware management tools for a single node. See MFT User Manual.

IEEE Std 802.3 Specification

IEEE Ethernet Specifications

PCI Express Specifications

Industry Standard PCI Express Base and Card Electromechanical Specifications.

LinkX Interconnect Solutions

LinkX Ethernet cables and transceivers are designed to maximize the performance of High-Performance Computing networks, requiring high-bandwidth, low-latency connections between compute nodes and switch nodes. NVIDIA offers one of the industry’s broadest portfolio of 40GbE, 56GbE, 100GbE, 200GbE and 400GbE cables, including Direct Attach Copper cables (DACs), copper splitter cables, Active Optical Cables (AOCs) and transceivers in a wide range of lengths from 0.5m to 10km. In addition to meeting Ethernet standards, NVIDIA tests every product in an end-to-end environment ensuring a Bit Error Rate of less than 1E-15 . Read more at LinkX Cables and Transceivers.

ConnectX-6 Dx Adapters Product Release Notes

Describes the hardware release notes for the ConnectX-6 Dx adapters. The document is available via NVOnline, please contact your NVIDIA representative for access.

Document Conventions

When discussing memory sizes, MB and MBytes are used in this document to mean size in mega Bytes. The use of Mb or Mbits (small b) indicates size in mega bits. In this document PCIe is used to mean PCI Express.

Revision History

A list of the changes made to this document are provided in .Document Revision History.

© Copyright 2023, NVIDIA. Last updated on Jan 1, 2024.