Cisco C3560-CX-8PC-S stuck in boot loop

[matthew_fritch@nps.gov]

I have a C3560-CX that I just upgraded to c3560cx-universalk9-mz.152-7.E3.bin. Every time I try to boot it up now it reads the file, verifies the image is good, starts to boot, goes all the way through to where it would just about let you login and then loops back to the beginning.

I have gone into ROMMON and the only thing in the directory is the image file (config and everything else is gone).

Any suggestions?

[balaji.bandi]

Connect the console, Turn off the device and Turn on the device, and post the complete output of the boot process.

have you just uploaded the .bin file and changed the boot variable to a new boot image (what steps you followed?)

[matthew_fritch@nps.gov]

Thanks for the quick reply,

Here is the output. complete with where it starts to loop again and the dir flash:

CPU rev: B
Image passed digital signature verification
Board rev: 9
Testing DataBus...
Testing AddressBus...
Testing Memory from 0x00000000 to 0x1fffffff.../
Using driver version 4 for media type 1
Xmodem file system is available.
Invalid parameter block -- no mac address available.
The password-recovery mechanism is enabled.
APM USBUSB EHCI 1.00
USB EHCI 1.00
USB Console INIT
Initializing Flash...
mifs[5]: 12 files, 1 directories
mifs[5]: Total bytes : 1806336
mifs[5]: Bytes used : 826368
mifs[5]: Bytes available : 979968
mifs[5]: mifs fsck took 0 seconds.
mifs[6]: 2 files, 1 directories
mifs[6]: Total bytes : 3870720
mifs[6]: Bytes used : 1516544
mifs[6]: Bytes available : 2354176
mifs[6]: mifs fsck took 1 seconds.
mifs[7]: 5 files, 1 directories
mifs[7]: Total bytes : 258048
mifs[7]: Bytes used : 8192
mifs[7]: Bytes available : 249856
mifs[7]: mifs fsck took 0 seconds.
mifs[8]: 5 files, 1 directories
mifs[8]: Total bytes : 258048
mifs[8]: Bytes used : 8192
mifs[8]: Bytes available : 249856
mifs[8]: mifs fsck took 0 seconds.
mifs[9]: 1 files, 1 directories
mifs[9]: Total bytes : 122185728
mifs[9]: Bytes used : 23104000
mifs[9]: Bytes available : 99081728
mifs[9]: mifs fsck took 28 seconds.
...done Initializing Flash.
Loading "flash:c3560cx-universalk9-mz.152-7.E3.bin"...Verifying image flash:c3560cx-universalk9-mz.152-7.E3.bin..............................................................................................................................................................................................................................................................................................................................................................Image passed digital signature verification
$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$
File "flash:c3560cx-universalk9-mz.152-7.E3.bin" uncompressed and installed, entry point: 0x3000
executing...

Restricted Rights Legend

Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.

cisco Systems, Inc.
170 West Tasman Drive
San Jose, California 95134-1706

Cisco IOS Software, C3560CX Software (C3560CX-UNIVERSALK9-M), Version 15.2(7)E3, RELEASE SOFTWARE (fc3)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2020 by Cisco Systems, Inc.
Compiled Sun 06-Sep-20 15:15 by prod_rel_team
Initializing flashfs...
Using driver version 4 for media type 1
mifs[7]: 12 files, 1 directories
mifs[7]: Total bytes : 1806336
mifs[7]: Bytes used : 826368
mifs[7]: Bytes available : 979968
mifs[7]: mifs fsck took 0 seconds.
mifs[7]: Initialization complete.

mifs[8]: 2 files, 1 directories
mifs[8]: Total bytes : 3870720
mifs[8]: Bytes used : 1516544
mifs[8]: Bytes available : 2354176
mifs[8]: mifs fsck took 0 seconds.
mifs[8]: Initialization complete.

mifs[9]: 5 files, 1 directories
mifs[9]: Total bytes : 258048
mifs[9]: Bytes used : 8192
mifs[9]: Bytes available : 249856
mifs[9]: mifs fsck took 0 seconds.
mifs[9]: Initialization complete.

mifs[10]: 5 files, 1 directories
mifs[10]: Total bytes : 258048
mifs[10]: Bytes used : 8192
mifs[10]: Bytes available : 249856
mifs[10]: mifs fsck took 0 seconds.
mifs[10]: Initialization complete.

mifs[11]: 1 files, 1 directories
mifs[11]: Total bytes : 122185728
mifs[11]: Bytes used : 23104000
mifs[11]: Bytes available : 99081728
mifs[11]: mifs fsck took 0 seconds.
mifs[11]: Initialization complete.

...done Initializing flashfs.
Checking for Bootloader upgrade..
Boot Loader upgrade not needed(v)

FIPS: Fatal failure: sp800108 failed

%Software-forced reload

00:00:02 UTC Mon Jan 2 2006: Unexpected exception to CPUvector 2000, PC = 4399428
-Traceback= 0x4399428z 0x3C60B54z 0x3C6028Cz 0x34E01D4z 0x34E03B0z 0x34E0528z 0x9129F4z 0x912C8Cz 0x439AA14z 0x4396704z

=== Flushing messages (00:00:02 UTC Mon Jan 2 2006) ===

Buffered messages:
Queued messages:
*Jan 2 00:00:02.558: %SYS-3-LOGGER_FLUSHING: System pausing to ensure console debugging output.

*Mar 1 00:00:15.833: Read env variable - LICENSE_BOOT_LEVEL = ipservices
*Jan 2 00:00:00.513: %IOS_LICENSE_IMAGE_APPLICATION-6-LICENSE_LEVEL: Module name = c3560cx Next reboot level = ipbase and License = No valid license found
Cisco IOS Software, C3560CX Software (C3560CX-UNIVERSALK9-M), Version 15.2(7)E3, RELEASE SOFTWARE (fc3)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2020 by Cisco Systems, Inc.
Compiled Sun 06-Sep-20 15:15 by prod_rel_team

Debug Exception (Could be NULL pointer dereference) Exception (0x2000)!
SRR0 = 0x0352FA90 SRR1 = 0x00029200 SRR2 = 0x04399428 SRR3 = 0x00029200
ESR = 0x00000000 DEAR = 0x294B63D7 TSR = 0x84000000 DBSR = 0x01000000

CPU Register Context:
Vector = 0x00002000 PC = 0x04399428 MSR = 0x00029200 CR = 0x35000033
LR = 0x043993C0 CTR = 0x008E8898 XER = 0x80000045
R0 = 0x043993C0 R1 = 0x0929A998 R2 = 0x00000000 R3 = 0x05CFD2D8
R4 = 0x00000000 R5 = 0x00000000 R6 = 0x00000000 R7 = 0x00000025
R8 = 0x00000000 R9 = 0x06670000 R10 = 0x09274E8C R11 = 0x00000000
R12 = 0x35000039 R13 = 0x1F183AF4 R14 = 0x00912C30 R15 = 0x00000000
R16 = 0x00000000 R17 = 0x00000000 R18 = 0x00000000 R19 = 0x00000000
R20 = 0x00000000 R21 = 0x00000000 R22 = 0x00000000 R23 = 0x00000000
R24 = 0x00000000 R25 = 0x00000000 R26 = 0x00000000 R27 = 0x06370000
R28 = 0x00000009 R29 = 0x04394358 R30 = 0x0928EAEC R31 = 0x00000000

Stack trace:
PC = 0x04399428, SP = 0x0929A998
Frame 00: SP = 0x0929A9A8 PC = 0x043993C0
Frame 01: SP = 0x0929A9B0 PC = 0x03C60B54
Frame 02: SP = 0x0929A9B8 PC = 0x03C6028C
Frame 03: SP = 0x0929A9C8 PC = 0x034E01D4
Frame 04: SP = 0x0929A9E8 PC = 0x034E03B0
Frame 05: SP = 0x0929AA00 PC = 0x034E0528
Frame 06: SP = 0x0929AA30 PC = 0x009129F4
Frame 07: SP = 0x0929AB30 PC = 0x00912C8C
Frame 08: SP = 0x0929AB38 PC = 0x0439AA14
Frame 09: SP = 0x00000000 PC = 0x04396704

Switch uptime is 18 seconds

cisco WS-C3560CX-8PC-S (APM86XXX) processor with 524288K bytes of memory.
þ
CPU rev: B
Image passed digital signature verification
Board rev: 9
Testing DataBus...
Testing AddressBus...
Testing Memory from 0x00000000 to 0x1fffffff.../
Using driver version 4 for media type 1
Xmodem file system is available.
Invalid parameter block -- no mac address available.
The password-recovery mechanism is enabled.
APM USBUSB EHCI 1.00
USB EHCI 1.00
USB Console INIT
Initializing Flash...
mifs[5]: 12 files, 1 directories
mifs[5]: Total bytes : 1806336
mifs[5]: Bytes used : 826368
mifs[5]: Bytes available : 979968
mifs[5]: mifs fsck took 0 seconds.
mifs[6]: 2 files, 1 directories
mifs[6]: Total bytes : 3870720
mifs[6]: Bytes used : 1516544
mifs[6]: Bytes available : 2354176
mifs[6]: mifs fsck took 1 seconds.
mifs[7]: 5 files, 1 directories
mifs[7]: Total bytes : 258048
mifs[7]: Bytes used : 8192
mifs[7]: Bytes available : 249856
mifs[7]: mifs fsck took 0 seconds.
mifs[8]: 5 files, 1 directories
mifs[8]: Total bytes : 258048
mifs[8]: Bytes used : 8192
mifs[8]: Bytes available : 249856
mifs[8]: mifs fsck took 0 seconds.
mifs[9]: 1 files, 1 directories
mifs[9]: Total bytes : 122185728
mifs[9]: Bytes used : 23104000
mifs[9]: Bytes available : 99081728
mifs[9]: mifs fsck took 28 seconds.
...done Initializing Flash.
Loading "flash:c3560cx-universalk9-mz.152-7.E3.bin"...Verifying image flash:c3560cx-universalk9-mz.152-7.E3.bin...................................................................................................Err: bytes_copied: 0x630000, file size: 0x15db400

Error loading "flash:c3560cx-universalk9-mz.152-7.E3.bin"

Interrupt within 5 seconds to abort boot process.
Boot process terminated.

The system is unable to boot automatically. The BOOT
environment variable needs to be set to a bootable
image.

switch: dir flash:
Directory of flash:/

2 -rwx 22918144 <date> c3560cx-universalk9-mz.152-7.E3.bin

96759K bytes available (22562K bytes used)

As for what I have tried. I have deleted the image, downloaded it again from Cisco, uploaded it back to the switch and still get the loop. Tried both 152-7.E3 and 152-7.E4. Reformatted the flash and uploaded the image again and still get the boot loop. Any thoughts?

[Reza Sharifi]

environment variable needs to be set to a bootable
image.

switch: dir flash:
Directory of flash:/

2 -rwx 22918144 <date> c3560cx-universalk9-mz.152-7.E3.bin

96759K bytes available (22562K bytes used)

Try to set up the boot variable for the image you have on the switch

example:

boot system flash:c3560cx-universalk9-mz.152-7.E3.bin

if not load this image:

c3560cx-universalk9-mz.152-4.E7.bin

and test again.

HTH

[matthew_fritch@nps.gov]

When I try to set the boot variable all I get is:

switch: boot system flash:c3560cx-universalk9-mz.152-7.E3.bin
usage: boot [-n|-j] [-p] [-c] [-f] [-i] [-m] [-notnd] [-notni] [-post] [-skip_post] [-reserve_mem <1-15>] [-no_esp_keepalive] [<filename>]

Or 

switch: boot system flash:c3560cx-universalk9-mz.152-7.E4.bin
usage: boot [-n|-j] [-p] [-c] [-f] [-i] [-m] [-notnd] [-notni] [-post] [-skip_post] [-reserve_mem <1-15>] [-no_esp_keepalive] [<filename>]

[Reza Sharifi]

Ok, if the one you loaded it does not work, try this

c3560cx-universalk9-mz.152-4.E7.bin

HTH

[matthew_fritch@nps.gov]

Still no luck.

Though I was looking at the boot process and noticed this line:

Invalid parameter block -- no mac address available.

Something tells me I have a hardware failure so I am going to open a TAC case and see about a replacement as I just purchased the switch a couple of weeks ago.

[Reza Sharifi · Accepted solution]

Should be very easy to RMA it for a new one since you just got it and have support on it.

Good Luck!

[Leo Laohoo]

---

matthew_fritch@nps.gov wrote:

FIPS: Fatal failure: sp800108 failed

%Software-forced reload

---

Try a different IOS version.

Flip the switch and take a photo of the SKU/Model number.  I want to verify this is a 3560CX and not a 3560CG.

[balaji.bandi]

As others suggested, make sure you are using right IOS image with Right device. is this old 3506 (orginal Cisco Color) or new 3560 with while color ?