ha vSphere 8 alatt nem latszik hogy a kartya tud RDMA-t

[root@c08n1:~] esxcli rdma device list
Name     Driver      State   MTU  Speed  Paired Uplink  Description
-------  ----------  -----  ----  -----  -------------  -----------
[root@c08n1:~]

akkor siman lehet h regi az fw a kartyan, frissitsuk!

ehhez mst es nmst packageket szedjuk le, majd rakjuk fel

[root@c08n1:/tmp] esxcli software vib install -d /tmp/Mellanox-MFT-Tools_4.25.0.802-1OEM.802.0.0.21974771_22223935.zip
Installation Result
   Message: The update completed successfully, but the system needs to be rebooted for the changes to be effective.
   VIBs Installed: MEL_bootbank_mft-oem_4.25.0.802-0, MEL_bootbank_mft_4.25.0.802-0
   VIBs Removed:
   VIBs Skipped:
   Reboot Required: true
   DPU Results:

[root@c08n1:~] esxcli software component apply -d /tmp/Mellanox-NATIVE-NMST_4.25.0.802-1OEM.802.0.0.21974771_22224313.zip
Installation Result
   Message: The update completed successfully, but the system needs to be rebooted for the changes to be effective.
   Components Installed: Mellanox-NATIVE-NMST_4.25.0.802-1OEM.802.0.0.21974771
   Components Removed:
   Components Skipped:
   Reboot Required: true
   DPU Results:
[root@c08n1:~]

aztan reboot, es utana mar meg tudjuk nezni:

[root@c08n1:~] /opt/mellanox/bin/mst start
Module mst is already loaded
[root@c08n1:~] /opt/mellanox/bin/mlxfwmanager
Querying Mellanox devices firmware ...

Device #1:
----------

  Device Type:      ConnectX4LX
  Part Number:      MCX4121A-ACA_Ax
  Description:      ConnectX-4 Lx EN network interface card; 25GbE dual-port SFP28; PCIe3.0 x8; ROHS R6
  PSID:             MT_2420110034
  PCI Device Name:  mt4117_pciconf0
  Base MAC:         ec0d9ad971a6
  Versions:         Current        Available
     FW             14.20.1010     N/A
     PXE            3.5.0210       N/A

  Status:           No matching image found

[root@c08n1:~]

a vmware doksija szerint a minimum fw verzio amit ker a vsphere 8u2 alatt az 14.32.1010, szoval messze vagyunk. (ennel amugy nincs ujabb, a CX4Lx egy resze EoS/EoL, amiket en hasznalok OEM kartyak azok ugy latom meg nem, de a legeslegutolso FW 2021-es... lehet mar nincs mit javitani rajta :-)):

[root@c08n1:~] /opt/mellanox/bin/mlxfwmanager -u -i /tmp/fw-ConnectX4Lx-rel-14_32_1010-MCX4121A-ACA_Ax-UEFI-14.25.17-FlexBoot-3.6.502.bin
Querying Mellanox devices firmware ...

Device #1:
----------

  Device Type:      ConnectX4LX
  Part Number:      MCX4121A-ACA_Ax
  Description:      ConnectX-4 Lx EN network interface card; 25GbE dual-port SFP28; PCIe3.0 x8; ROHS R6
  PSID:             MT_2420110034
  PCI Device Name:  mt4117_pciconf0
  Base MAC:         ec0d9ad971a6
  Versions:         Current        Available
     FW             14.20.1010     14.32.1010
     PXE            3.5.0210       3.6.0502
     UEFI           N/A            14.25.0017

  Status:           Update required

---------
Found 1 device(s) requiring firmware update...

Perform FW update? [y/N]: y
Device #1: Updating FW ...
Done

Restart needed for updates to take effect.
[root@c08n1:~]

reboot, aztan et voila, meg is jelentek:

[root@c08n1:~] esxcli rdma device list
Name     Driver      State   MTU  Speed  Paired Uplink  Description
-------  ----------  -----  ----  -----  -------------  -----------
vmrdma0  nmlx5_rdma  Down   1024  0      vmnic2         MT27710 Family  [ConnectX-4 Lx]
vmrdma1  nmlx5_rdma  Down   1024  0      vmnic3         MT27710 Family  [ConnectX-4 Lx]
[root@c08n1:~]

Hozzászólások

Nem mondom, hogy nem neztem ra hirtelen a naptarra mikor meglattam hogy cx4:)

Az RDMA olyan 2010-es évek ;)

 

Viccet félretéve nagy kár, hogy underground technológia maradt. :(