Cisco 12G SAS Modular Raid Controller (MRAID) error in UCSC-C220-M5L

swilsons · ‎11-25-2020

Both disk1 and disk2 are degraded with this error message. Please suggest, is there any workaround or fix for this?

Storage Local disk 2 is degraded: please take appropriate action by checking the detailed drive status

Storage Local disk 1 is degraded: please take appropriate action by checking the detailed drive status

Kirk J · ‎11-25-2020

Is it the disks or the Virtual drive that is degraded?

The VD will go into degraded mode when the BBU/Super cap is undergoing learning cycle, or has had a problem.

Suggest you check the Cache/BBU health.

Is this a raid 1 comprised of those two drives, or part of larger group?

Did you post this on techzone first?

Thanks,

Kirk...

swilsons · ‎11-25-2020

Thanks for the response Kirk

This is the physical drive and there are only 2, both are not in good state after a reboot. There are no VD right now and BBU is also empty.

I've to post it in techzone.

Following are few CLI O/Ps

C220-WZP23201GND /chassis/storageadapter # show physical-drive

Physical Drive Number Controller Device ID Health Status Boot Drive Manufacturer Model Predictive Failure Count Drive Firmware Type Block Size Physical Block Size Negotiated Link Speed Locator LED FDE Capable FDE Enabled FDE Secured FDE Locked State Coerced Size

--------------------- ---------- -------------- -------------- ---------------------- ---------- -------------- -------------- ------------------------ -------------- ----- ---------- ------------------- ---------- ----------- ----------- ----------- ----------- ---------- ---------------------- --------------

1 MRAID 8 Moderate Fault Foreign Configuration false TOSHIBA AL15SEB120N 0 5701 HDD 512 512 12.0 Gb/s false 0 0 0 0 unconfigured good 1143455 MB

2 MRAID 9 Moderate Fault Foreign Configuration false TOSHIBA AL15SEB120N 0 5701 HDD 512 512 12.0 Gb/s false 0 0 0 0 unconfigured good 1143455 MB

C220-WZP23201GND /chassis/storageadapter # show error-counters

PCI Slot MRAID:

Info Valid: Yes

Info Invalid Cause:

Memory Correctable Errors: 0

Memory Uncorrectable Errors: 0

C220-WZP23201GND /chassis/storageadapter # show virtual-drive

C220-WZP23201GND /chassis/storageadapter #

C220-WZP23201GND /chassis/storageadapter # show bbu

No BBU available

Kirk J · ‎11-26-2020

So that output shows the drives as 'unconfigured good' which means they are not in raid config.

If they were previously, then the raid controller and metadata for the VD is no longer present.

You will need to trigger the raid controller TTY firmware logs, and the generate tech support, to look at the raid controller logs to see what is actually the real error.

Kirk...

swilsons · ‎11-26-2020

I couldn't collect the logs, getting the error as "storage subsystem not ready yet".

Collected the show tech logs yesterday, attached the same in techzone (https://techzone.cisco.com/t5/C-Series/Cisco-12G-SAS-Modular-Raid-Controller-MRAID-gone-faulty-in-UCSC/td-p/1628702)

Regards,

Stella

>>>

C220-WZP23201GND /chassis # scope storageadapter MRAID

C220-WZP23201GND /chassis/storageadapter # get-storage-fw-log

You are initiating the retrieval of the storage firmware log to Cisco IMC.
This task will take a few minutes to complete. You may monitor the status
of the retrieval by running the 'get-storage-fw-log-download-progress' command.
When the download is finished, the 'Storage Firmware Log Status' value will be
'Complete', along with the size of the logfile.
You may then download the log file using the Technical Support facility,
accessible from /cimc/tech-support scope, or the WebUI's Utilities page.

Do you want to proceed?
Enter 'yes' to confirm -> yes
get-storage-fw-log operation failed.
Error: storage subsystem not ready yet

C220-WZP23201GND /chassis/storageadapter # get-tty-log

You are initiating the retrieval of the storage firmware log to Cisco IMC.
This task will take a few minutes to complete. You may monitor the status
of the retrieval by running the 'get-ttylog-download-progress' command.
When the download is finished, the 'Storage Firmware Log Status' value will be
'Complete', along with the size of the logfile.
You may then download the log file using the Technical Support facility,
accessible from /cimc/tech-support scope, or the WebUI's Utilities page.

Do you want to proceed?
Enter 'yes' to confirm -> yes
get-tty-log operation failed.
Error: storage subsystem not ready yet

C220-WZP23201GND /chassis/storageadapter # show detail
PCI Slot MRAID:
Health: Moderate Fault
Controller Status: Optimal
ROC Temperature: 47 degrees C
Product Name: Cisco 12G SAS Modular Raid Controller
Serial Number: SK91971322
Firmware Package Build: 24.12.1-0451
Product ID: LSI Logic
Battery Status: BBU Not Supported
NVRAM Size: 32 KB
Memory Size: 0 MB
Flash Memory Size: 32 MB
Cache Memory Size: 0 MB
Boot Drive: none
Boot Drive is PD: false
Product PID: UCSCMRAID12G
Storage Firmware Log Status: Complete (total size 394566 bytes)
Controller is Secured: 0
Controller cache pinned status: false

>>

Kirk J · ‎11-26-2020

There are entries like:

severity: Critical
date-time: 35 seconds from boot
source-controller: MRAID
description: Controller booted to safe mode due to critical errors
index: 2

severity: Critical
date-time: 34 seconds from boot
source-controller: MRAID
description: Critical Error during boot - Bad, missing or unsupported RAID controller memory module detected.
index: 5

Looks like the cache module went bad, and dropped the raid config in the process.

If you are able to replace the cache module, sometime you can recreate the same virtual drive/raid with the same drives, choosing NOT to initialize, and you may still have the data.

Looks like some hardware replacement is next step.

Kirk...