09-26-2019 07:59 AM - edited 09-26-2019 08:22 AM
Hi folks
We have a bunch of C240 M5 servers with the inbuilt Cisco 12G Modular Raid Controller with 4GB cache (max 26 drives) (MRAID, is there a download link to install and manage the raid sets within the operating system. Is it the LSI Mega Raid controller?
Thanks
Solved! Go to Solution.
10-01-2019 09:02 AM
The HUU (or C series bundle via UCSM integration) is the only current supported method of upgrading.
Table 3. Files in ucs-c240m5-huu-4.0.4h.iso
NIC Firmware version included
============= ==================
INTEL X710-DA2 0x800042E0-1.816.1
INTEL X710-DA4 0x800042E1-1.816.1
INTEL X710-T4 0x800042E2-1.816.1
INTEL XL710 0x800042E3-1.816.1
INTEL XXV710-DA2 0x800042E4-1.816.1
Not sure how those line up with the OS reported firmware versions, but I would try running the latest HUU specifically for the Intel card, and see what it reports for firmware.
Kirk...
09-26-2019 08:26 AM - edited 09-26-2019 08:41 AM
There is a storcli utility that is typically used for diagnostics as well as can configure.
https://docs.broadcom.com/docs/MR_SAS_Unified_StorCLI_007.1017.0000.0000.zip
There is also a megaraid manager (more around configuration/management), that we see used frequently on Windows servers, but not as much on Linux:
https://docs.broadcom.com/docs/17.05.00.02_Linux-64_MSM.gz
Overall software guide: https://www.cisco.com/c/dam/en/us/td/docs/unified_computing/ucs/3rd-party/lsi/mrsas/userguide_june_2017/pub-005110_DB15-001199-08_2017-06-09_MR-614-SW-UG.pdf
Redhat install instructions for MegaRaid Manager start around page 254.
Kirk...
09-30-2019 06:16 AM - edited 09-30-2019 06:17 AM
Thanks Kirk.
One last piece of assistance please - each server we have is using the Intel X710-DA2 dual port 10G SFP+ NIC card
What we have seen is the Cisco 5k switch the cards are connected to are seeing multiple lldp packets from each server causing it to suspend the ports after a fairly sort length of time. The network team have disabled the lldp on the switch side as a temporary measure - however to disable it on the server side I am advised by Red Hat to update the firmware for the Intel cards.
The issue I have had after speaking to Intel is they are 'oem' cards - the driver update does not work using Intel's utility. They have advised me to speak to Cisco. Have you heard or seen of issues updating the firmware on these cards, or do you have a procedure or download link to do this?
If I run the nvmupdate tool from Intel - I get
Intel(R) Ethernet NVM Update Tool
NVMUpdate version 1.33.15.1
Copyright (C) 2013 - 2019 Intel Corporation.
WARNING: To avoid damage to your device, do not stop the update or reboot or power off the system during this update.
Inventory in progress. Please wait [|.........]
Num Description Ver.(hex) DevId S:B Status
=== ================================== ============ ===== ====== ==============
01) Intel(R) Ethernet Controller 1.134(1.86) 1563 00:001 Update not
X550-T2 available
02) Cisco(R) Ethernet Converged NIC 5.05(5.05) 1572 00:025 Update not
X710-DA2 available
03) Cisco(R) Ethernet Converged NIC 5.05(5.05) 1572 00:216 Update not
X710-DA2 available
Tool execution completed with the following status: Device not found.
Press any key to exit.
10-01-2019 06:26 AM - edited 10-01-2019 06:33 AM
The UCS HUU firmware bootable ISO, will have firmware for any of the supported option cards (including Intel NICs) on the spec sheet.
https://software.cisco.com/download/home/286318800/type/283850974/release/4.0(4e)
Might also be able to turn it off with OS level command.
ethtool --set-priv-flags eth0 disable-fw-lldp on
ethtool --set-priv-flags eth0 disable-fw-lldp off
ethtool --show-priv-flags eth0
:disable-fw-lldp: off
Replace eth0 with your actual network device name.
Kirk...
10-01-2019 07:44 AM
Thanks Kirk, interestingly the batch of servers we have been given from Cisco have different BIOS on them -
# dmidecode 3.2
Getting SMBIOS data from sysfs.
SMBIOS 3.0.0 present.
Handle 0x0001, DMI type 1, 27 bytes
System Information
Manufacturer: Cisco Systems Inc
Product Name: UCSC-C240-M5SX
This does not work when you issue
ethtool --set-priv-flags eth0 disable-fw-lldp on
Cannot set private flags: Operation not supported
The following does work
ethtool --set-priv-flags eth0 disable-fw-lldp on
ethtool --set-priv-flags eth0 disable-fw-lldp off
dmidecode -t system
# dmidecode 3.2
Getting SMBIOS data from sysfs.
SMBIOS 3.2.1 present.
10-01-2019 07:47 AM
What OS version (RHEL 7.7) ?
Also what driver for the intel NIC is running?
Kirk...
10-01-2019 07:49 AM
Hi, yes all on 7.7. I was hoping for a simple NIC firmware update if possible at the OS level rather than a bootable ISO as we have 40 of these servers
Older FW
ethtool -i eth0
driver: i40e
version: 2.8.10-k
firmware-version: 5.05 0x80002a3c 0.385.33
expansion-rom-version:
bus-info: 0000:19:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes
Newer
driver: i40e
version: 2.8.10-k
firmware-version: 6.01 0x800036bd 0.385.33
expansion-rom-version:
bus-info: 0000:19:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes
10-01-2019 09:02 AM
The HUU (or C series bundle via UCSM integration) is the only current supported method of upgrading.
Table 3. Files in ucs-c240m5-huu-4.0.4h.iso
NIC Firmware version included
============= ==================
INTEL X710-DA2 0x800042E0-1.816.1
INTEL X710-DA4 0x800042E1-1.816.1
INTEL X710-T4 0x800042E2-1.816.1
INTEL XL710 0x800042E3-1.816.1
INTEL XXV710-DA2 0x800042E4-1.816.1
Not sure how those line up with the OS reported firmware versions, but I would try running the latest HUU specifically for the Intel card, and see what it reports for firmware.
Kirk...
10-01-2019 09:38 AM - edited 10-01-2019 12:31 PM
As most of the drivers are 'inbox' on those releases,,,,if you upgraded to 7.7 from previous RHEL release, you may need to manually upgrade to the driver RPM that was included on the 7.7 release.
I haven't had a chance to trace down what RHEL shows for 7.7 drivers for I40e
Kirk...
10-02-2019 01:14 AM - edited 10-02-2019 01:15 AM
Hi Kirk
They were installed with red hat 7.4 initially then updated to 7.7 - the drivers do seem the same (driver: i40e
version: 2.8.10-k) but the firmware is different on the 2 cards. This seems to match with the older bios revision shipped with the servers. I will have a go with the ISO, it would have been very useful though to do a one liner firmware update now we have fully configured the servers and OS.
10-02-2019 03:54 AM
There are no published details on how to swiss knife the firmware from a Linux level, because in general, we don't want customers getting mismatched firmware (i.e. customer decides to do BIOS, but not CIMC), but want the HUU applied as a whole.
I sent you a PM with some suggestions.
Kirk...
10-07-2019 02:55 AM
Hi Kirk
Thank you for your help and suggestions.
I used the HUU tool as the servers are not live yet to update the NIC firmware. The LLDP option can now be turned on and off correctly.
Thanks
Andrew
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide