NVIDIA ConnectX-6 InfiniBand/Ethernet Adapter Cards User Manual

PDF

You can download a PDF version of the full guide here.

About This Manual

This User Manual describes NVIDIA® ConnectX®-6 InfiniBand/Ethernet adapter cards. It provides details as to the interfaces of the board, specifications, required software and firmware for operating the board, and relevant documentation.

Ordering Part Numbers

The table below provides the ordering part numbers (OPN) for the available ConnectX-6 InfiniBand/Ethernet adapter cards.

NVIDIA SKU

Legacy OPN

Marketing Description

Lifecycle

900-9X603-0016-DT0

MCX653105A-EFAT

ConnectX®-6 InfiniBand/Ethernet adapter card, 100Gb/s (HDR100, EDR IB and 100GbE), single-port QSFP56, PCIe3.0/4.0 Socket Direct 2x8 in a row, tall bracket

Mass Production

900-9X603-0056-DT0

MCX653106A-EFAT

ConnectX®-6 InfiniBand/Ethernet adapter card, 100Gb/s (HDR100, EDR IBand100GbE), dual-port QSFP56, PCIe3.0/4.0 Socket Direct 2x8 in a row, tall bracket

Mass Production

900-9X628-0016-ST0

MCX651105A-EDAT

ConnectX®-6 InfiniBand/Ethernet adapter card, 100Gb/s (HDR100, EDR IB and 100GbE, single-port QSFP56, PCIe4.0 x8, tall bracket

Mass Production

900-9X6AF-0016-ST1

MCX653105A-ECAT

ConnectX®-6 InfiniBand/Ethernet adapter card, 100Gb/s (HDR100, EDR IB and 100GbE), single-port QSFP56, PCIe3.0/4.0 x16, tall bracket

Mass Production

900-9X6AF-0056-MT1

MCX653106A-ECAT

ConnectX®-6 InfiniBand/Ethernet adapter card, 100Gb/s (HDR100, EDR IB and 100GbE), dual-port QSFP56, PCIe3.0/4.0 x16, tall bracket

Mass Production

900-9X6AF-0018-MT2

MCX653105A-HDAT

ConnectX®-6 InfiniBand/Ethernet adapter card, HDR IB (200Gb/s) and 200GbE, single-port QSFP56, PCIe3.0/4.0 x16, tall bracket

Mass Production

900-9X6AF-0058-ST1

MCX653106A-HDAT

ConnectX®-6 InfiniBand/Ethernet adapter card, HDR IB (200Gb/s) and 200GbE, dual-port QSFP56, PCIe3.0/4.0 x16, tall bracket

Mass Production

900-9X6B4-0058-DT0

MCX654106A-HCAT

ConnectX®-6 InfiniBand/Ethernet adapter card, HDR IB (200Gb/s) and 200GbE, dual-port QSFP56, Socket Direct 2x PCIe3.0/4.0x16, tall bracket

Mass Production

900-9X6AF-0018-SS0

MCX653105A-HDAL

ConnectX®-6 InfiniBand/Ethernet adapter card, HDR IB (200Gb/s) and 200GbE, single-port QSFP56, PCIe3.0/4.0 x16, cold plate for liquid-cooled Intel® Server System D50TNP platforms, tall bracket, ROHS R6

Mass Production

900-9X6AF-0058-SS0

MCX653106A-HDAL

ConnectX®-6 InfiniBand/Ethernet adapter card, HDR IB (200Gb/s) and 200GbE, dual-port QSFP56, PCIe3.0/4.0 x16, cold plate for liquid-cooled Intel® Server System D50TNP platforms, tall bracket, ROHS R6

Mass Production

900-9X0BC-001H-ST1

MCX683105AN-HDAT

ConnectX®-6 DE adapter card, HDR IB (200Gb/s), single-port QSFP, PCIe4.0 x16, no crypto, tall bracket

Mass Production

EOL'ed (End of Life) Ordering Part Numbers

NVIDIA SKU

Legacy OPN

Marketing Description

Lifecycle

900-9X6B4-0056-DT0

MCX654106A-ECAT

ConnectX®-6 InfiniBand/Ethernet adapter card, 100Gb/s (HDR100, EDR InfiniBand and 100GbE), dual-port QSFP56, Socket Direct 2x PCIe 3.0/4.0 x16, tall bracket

End of Life

900-9X6B4-0018-DT2

MCX654105A-HCAT

ConnectX®-6 InfiniBand/Ethernet adapter card, HDR IB (200Gb/s) and 200GbE, single-port QSFP56, Socket Direct 2x PCIe3.0/4.0x16, tall bracket

End of Life

Intended Audience

This manual is intended for the installer and user of these cards.

The manual assumes basic familiarity with InfiniBand and Ethernet network and architecture specifications.

Technical Support

Customers who purchased NVIDIA products directly from NVIDIA are invited to contact us through the following methods:

Customers who purchased NVIDIA M-1 Global Support Services, please see your contract for details regarding Technical Support.Customers who purchased NVIDIA products through a NVIDIA approved reseller should first seek assistance through their reseller.
Related Documentation

MLNX_OFED for Linux User Manual and Release Notes

User Manual describing OFED features, performance, band diagnostic, tools content, and configuration. See MLNX_OFED for Linux Documentation.

WinOF-2 for Windows User Manual and Release Notes

User Manual describing WinOF-2 features, performance, Ethernet diagnostic, tools content, and configuration. See WinOF-2 for Windows Documentation.

NVIDIA VMware for Ethernet User Manual

User Manual and release notes describing the various components of the NVIDIA ConnectX® NATIVE ESXi stack. See VMware® ESXi Drivers Documentation.

NVIDIA Firmware Utility (mlxup) User Manual and Release Notes

NVIDIA firmware update and query utility used to update the firmware. Refer to Firmware Utility (mlxup) Documentation.

NVIDIA Firmware Tools (MFT) User Manual

User Manual describing the set of MFT firmware management tools for a single node. See MFT User Manual.

InfiniBand Architecture Specification Release 1.2.1, Vol 2 - Release 1.3

InfiniBand Specifications

IEEE Std 802.3 Specification

IEEE Ethernet Specifications

PCI Express Specifications

Industry Standard PCI Express Base and Card Electromechanical Specifications. Refer to PCI-SIG Specifications.

LinkX Interconnect Solutions

LinkX InfiniBand cables and transceivers are designed to maximize the performance of High-Performance Computing networks, requiring high-bandwidth, low-latency connections between compute nodes and switch nodes. NVIDIA offers one of the industry’s broadest portfolio of QDR/FDR10 (40Gb/s), FDR (56Gb/s), EDR/HDR100 (100Gb/s), HDR (200Gb/s) and NDR (400Gb/s) cables, including Direct Attach Copper cables (DACs), copper splitter cables, Active Optical Cables (AOCs) and transceivers in a wide range of lengths from 0.5m to 10km. In addition to meeting IBTA standards, NVIDIA tests every product in an end-to-end environment ensuring a Bit Error Rate of less than 1E-15 . Read more at LinkX Cables and Transceivers.

Document Conventions

When discussing memory sizes, MB and MBytes are used in this document to mean size in MegaBytes. The use of Mb or Mbits (small b) indicates the size in MegaBits. In this document, PCIe is used to mean PCI Express.

Revision History

A list of the changes made to this document are provided in Document Revision History.

© Copyright 2023, NVIDIA. Last updated on Nov 1, 2023.