Cannot see flash on Cisco 3850 after power outage

[smoothsailing]

Syst light flashing rapidly and cannot see flash:  Stuck in ROMMON mode.

switch: dir

List of filesystems currently registered:

xmodem[0]: (read-only)
null[1]: (read-write)
bs[3]: (read-only)
usbflash0[10]: (read-write)
tftp[11]: (read-write)
ftp[12]: (read-only)
http[13]: (read-only)

switch: flash_init
Initializing Flash...

flashfs[7]: 0 files, 1 directories
flashfs[7]: 0 orphaned files, 0 orphaned directories
flashfs[7]: Total bytes: 6784000
flashfs[7]: Bytes used: 1024
flashfs[7]: Bytes available: 6782976
flashfs[7]: flashfs fsck took 2 seconds....done Initializing Flash.

switch:

switch: dir

List of filesystems currently registered:

xmodem[0]: (read-only)
null[1]: (read-write)
bs[3]: (read-only)
usbflash0[10]: (read-write)
tftp[11]: (read-write)
ftp[12]: (read-only)
http[13]: (read-only)

[smoothsailing]

USB boot attempt resulting in:

switch: boot usbflash0:cat3k_caa-universalk9.16.12.07.SPA.bin
Reading full image into memory.............................................................................................................................................................................................................................................................................................................................................................................................................................................................................done
Bundle Image
--------------------------------------
Kernel Address : 0x537956e8
Kernel Size : 0x4381df/4424159
Initramfs Address : 0x53bcd8c7
Initramfs Size : 0x1ab5e09/28007945
Compression Format: mzip

Bootable image at @ ram:0x537956e8
Bootable image segment 0 address range [0x81100000, 0x81da5280] is in range [0x80180000, 0x90000000].
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
File "usbflash0:cat3k_caa-universalk9.16.12.07.SPA.bin" uncompressed and installed, entry point: 0x81895bf0
Loading Linux kernel with entry point 0x81895bf0 ...
Bootloader: Done loading app on core_mask: 0x3f

### Launching Linux Kernel (flags = 0x5)

Linux version 4.9.187 (sumikum7@sjc-ads-5670) (gcc version 5.3.0 (GCC) ) #1 SMP Fri Nov 19 03:09:46 PST 2021
CVMSEG size: 2 cache lines (256 bytes)
Cavium Inc. SDK-5.1.0
bootconsole [early0] enabled
CPU0 revision is: 000d900a (Cavium Octeon II)
Checking for the multiply/shift bug... no.
Checking for the daddiu bug... no.
ata1.00: cmd c8/00:08:00:00:00/00:00:00:00:00/e0 tag 0 dma 4096 in
res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
ata1.00: status: { DRDY }
ata1.00: cmd c8/00:08:00:00:00/00:00:00:00:00/e0 tag 0 dma 4096 in
res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
ata1.00: status: { DRDY }
ata1.00: cmd c8/00:08:00:00:00/00:00:00:00:00/e0 tag 0 dma 4096 in
res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
ata1.00: status: { DRDY }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:20:00:00:00/00:00:00:00:00/e0 tag 0 pio 16384 in
res 51/14:20:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:20:00:00:00/00:00:00:00:00/e0 tag 0 pio 16384 in
res 51/14:20:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:20:00:00:00/00:00:00:00:00/e0 tag 0 pio 16384 in
res 51/14:20:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:20:00:00:00/00:00:00:00:00/e0 tag 0 pio 16384 in
res 51/14:20:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:20:00:00:00/00:00:00:00:00/e0 tag 0 pio 16384 in
res 51/14:20:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:20:00:00:00/00:00:00:00:00/e0 tag 0 pio 16384 in
res 51/14:20:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
ata1.00: cmd c4/00:08:00:00:00/00:00:00:00:00/e0 tag 0 pio 4096 in
res 51/14:08:00:00:00/00:00:00:00:00/e0 Emask 0x81 (invalid argument)
ata1.00: status: { DRDY ERR }
ata1.00: error: { IDNF ABRT }
● check_partitions@dev-bootflash.service - Check partition tables
Loaded: loaded (/lib/systemd/system/check_partitions@.service; static; vendor preset: enabled)
Active: failed (Result: exit-code) since Fri 2025-06-06 15:26:03 Universal; 45ms ago
Process: 294 ExecStart=/bin/check_partitions.sh %f (code=exited, status=1/FAILURE)
Main PID: 294 (code=exited, status=1/FAILURE)

[ 98.384127] localhost systemd[1]: Starting Check partition tables...
[ 98.395751] localhost check_partitions.sh[294]: Verifying partition table for device /dev/bootflash...
[ 101.335816] localhost check_partitions.sh[294]: sfdisk: read error on /dev/bootflash - cannot read sector 0: Input/output error
[ 101.340372] localhost check_partitions.sh[294]: The partition table for device /dev/bootflash appears to be incorrect
[ 101.340993] localhost check_partitions.sh[294]: The number of partitions should be 9, but was found to be 0
[ 101.341502] localhost check_partitions.sh[294]: Rewriting the partition table...
[ 101.343399] localhost check_partitions.sh[294]: sfdisk: Checking that no-one is using this disk right now ...
[ 102.803941] localhost check_partitions.sh[294]: sfdisk: BLKRRPART: Input/output error
[ 102.804449] localhost check_partitions.sh[294]: sfdisk: OK
[ 104.264699] localhost check_partitions.sh[294]: sfdisk: read error on /dev/bootflash - cannot read sector 0: Input/output error
[ 104.265313] localhost check_partitions.sh[294]: sfdisk: /dev/bootflash: unrecognized partition table type
[ 104.265804] localhost check_partitions.sh[294]: sfdisk: No partitions found
[ 104.266313] localhost check_partitions.sh[294]: sfdisk: Warning: partition 1 does not end at a cylinder boundary
[ 104.266803] localhost check_partitions.sh[294]: sfdisk: Warning: partition 2 does not start at a cylinder boundary
[ 104.267306] localhost check_partitions.sh[294]: sfdisk: Warning: partition 2 does not end at a cylinder boundary
[ 104.267823] localhost check_partitions.sh[294]: sfdisk: Warning: partition 3 does not start at a cylinder boundary
[ 104.268329] localhost check_partitions.sh[294]: sfdisk: Warning: partition 3 does not end at a cylinder boundary
[ 104.268820] localhost check_partitions.sh[294]: sfdisk: Warning: partition 5 does not end at a cylinder boundary
[ 104.269345] localhost check_partitions.sh[294]: sfdisk: Warning: partition [6] does not end at a cylinder boundary
[ 104.269837] localhost check_partitions.sh[294]: sfdisk: Warning: partition 6 does not end at a cylinder boundary
[ 104.270360] localhost check_partitions.sh[294]: sfdisk: Warning: partition [7] does not start at a cylinder boundary
[ 104.270853] localhost check_partitions.sh[294]: sfdisk: Warning: partition [7] does not end at a cylinder boundary
[ 104.271375] localhost check_partitions.sh[294]: sfdisk: Warning: partition 7 does not end at a cylinder boundary
[ 104.271868] localhost check_partitions.sh[294]: sfdisk: Warning: partition [8] does not start at a cylinder boundary
[ 104.272400] localhost check_partitions.sh[294]: sfdisk: Warning: partition [8] does not end at a cylinder boundary
[ 104.272893] localhost check_partitions.sh[294]: sfdisk: Warning: partition 8 does not end at a cylinder boundary
[ 104.273401] localhost check_partitions.sh[294]: sfdisk: Warning: partition [9] does not start at a cylinder boundary
[ 104.273894] localhost check_partitions.sh[294]: sfdisk: Warning: partition [9] does not end at a cylinder boundary
[ 104.274416] localhost check_partitions.sh[294]: sfdisk: Warning: partition 9 does not end at a cylinder boundary
[ 104.274917] localhost check_partitions.sh[294]: sfdisk: Warning: no primary partition is marked bootable (active)
[ 104.275438] localhost check_partitions.sh[294]: This does not matter for LILO, but the DOS MBR will not boot this disk.
[ 104.275933] localhost check_partitions.sh[294]: sfdisk: end of partition 3 has impossible value for cylinders: 249 (should be in 0-248)
[ 105.724744] localhost check_partitions.sh[294]: sfdisk: read error on /dev/bootflash - cannot read sector 0: Input/output error
[ 105.725263] localhost check_partitions.sh[294]: Disk /dev/bootflash: 249 cylinders, 255 heads, 63 sectors/track
[ 105.725755] localhost check_partitions.sh[294]: Old situation:
[ 105.726262] localhost check_partitions.sh[294]: New situation:
[ 105.726754] localhost check_partitions.sh[294]: Units: blocks of 1024 bytes, counting from 0
[ 105.727277] localhost check_partitions.sh[294]: Device Boot Start End #blocks Id System
[ 105.727773] localhost check_partitions.sh[294]: /dev/bootflash1 0+ 262143 262143+ 83 Linux
[ 105.728290] localhost check_partitions.sh[294]: /dev/bootflash2 262144 414760 152617 5 Extended
[ 105.728792] localhost check_partitions.sh[294]: /dev/bootflash3 414761 2007431 1592671 83 Linux
[ 105.729327] localhost check_partitions.sh[294]: /dev/bootflash4 0 - 0 0 Empty
[ 105.729820] localhost check_partitions.sh[294]: /dev/bootflash5 262144+ 270144 8000+ 83 Linux
[ 105.730349] localhost check_partitions.sh[294]: /dev/bootflash6 270145+ 278145 8000+ 83 Linux
[ 105.730856] localhost check_partitions.sh[294]: /dev/bootflash7 278146+ 326309 48163+ 83 Linux
[ 105.731379] localhost check_partitions.sh[294]: /dev/bootflash8 326310+ 374473 48163+ 83 Linux
[ 105.731873] localhost check_partitions.sh[294]: /dev/bootflash9 374474+ 414760 40286+ 83 Linux
[ 107.185709] localhost check_partitions.sh[294]: sfdisk: BLKRRPART: Input/output error
[ 107.186178] localhost check_partitions.sh[294]: sfdisk: If you created or changed a DOS partition, /dev/foo7, say, then use dd(1)
[ 107.186617] localhost check_partitions.sh[294]: to zero the first 512 bytes: dd if=/dev/zero of=/dev/foo7 bs=512 count=1
[ 107.187037] localhost check_partitions.sh[294]: (See fdisk(8).)
[ 107.187442] localhost check_partitions.sh[294]: Re-reading the partition table ...
[ 107.189939] localhost systemd[1]: check_partitions@dev-bootflash.service: Main process exited, code=exited, status=1/FAILURE
[ 107.190541] localhost systemd[1]: Failed to start Check partition tables.
[ 107.245901] localhost systemd[1]: check_partitions@dev-bootflash.service: Unit entered failed state.
[ 107.246409] localhost systemd[1]: check_partitions@dev-bootflash.service: Failed with result 'exit-code'.
>>> Rebooting
Failed to connect to bus: No such file or directory
Failed to connect to bus: No such file or directory
watchdog: watchdog0: watchdog did not stop!
reboot: Restarting system


Booting...cf_read_multiple: cf_waitfor(!(BUSY | ERROR)): I/O error.
Boot bus: Failed to detect any IDE storage!

Interface GE 0 link down***ERROR: PHY link is down
The "IP_ADDR" environment variable is not set.
flash:packages.conf: no such device
Cannot open file flash:packages.conf
flash:packages.conf: no such device
flash:packages.conf: no such device

Error loading "flash:packages.conf"

Interrupt within 5 seconds to abort boot process.
Boot process failed...

The system is unable to boot automatically. The
BOOT environment variable needs to be set to a
bootable image.

[Leo Laohoo · Accepted solution]

The flash is fried.  

There is still time to RMA the switch under Cisco Enhanced Limited Lifetime Hardware Warranty.

[marce1000]

   - FYI : https://www.cisco.com/c/en/us/support/docs/ip/syslog/221138-troubleshoot-disk-errors.html

  M.

[Leo Laohoo]

Console into the switch and reboot.

Post the entire boot-up process.