2960x switch stuck in provisioned status

[davinci]

i've tried rebooting switch 6 and reconnecting stack cables without success.  Switch 6 SYST light is blinking green.  What could be the problem?

ALDLEG-X70#sho platform stack manager all
Switch/Stack Mac Address : 084f.f973.6000
H/W Current
Switch# Role Mac Address Priority Version State
----------------------------------------------------------
*1 Master 084f.f973.6000 15 4 Ready
2 Member 00a5.bf33.6900 1 4 Ready
3 Member 00a5.bf4a.a300 1 4 Ready
4 Member 00a5.bf4a.9a00 1 4 Ready
5 Member dcf7.19a1.3780 1 4 Ready
6 Member 0000.0000.0000 0 0 Provisioned

Stack Port Status Neighbors
Switch# Port 1 Port 2 Port 1 Port 2
--------------------------------------------------------
1 Ok Down 2 None
2 Ok Ok 3 1
3 Ok Ok 4 2
4 Ok Ok 5 3
5 Down Ok None 4

Stack Discovery Protocol View
==============================================================

Switch Active Role Current Sequence Dirty
Number State Number Bit
--------------------------------------------------------------------
1 TRUE Master Ready 119 FALSE
2 TRUE Member Ready 097 FALSE
3 TRUE Member Ready 108 FALSE
4 TRUE Member Ready 116 FALSE
5 TRUE Member Ready 079 FALSE

Stack State Machine View
==============================================================

Switch Master/ Mac Address Version Current
Number Member (maj.min) State
-----------------------------------------------------------
1 Master 084f.f973.6000 1.56 Ready
2 Member 00a5.bf33.6900 1.56 Ready
3 Member 00a5.bf4a.a300 1.56 Ready
4 Member 00a5.bf4a.9a00 1.56 Ready
5 Member dcf7.19a1.3780 1.56 Ready

Last Conflict Parameters

Switch Master/ Cfgd Default Image H/W # of Mac Address
Number Member Prio Config Type Prio Members
-----------------------------------------------------------------------
1 Member 15 Yes 4 5 0 084f.f973.6000
2 Member 1 Yes 4 5 0 00a5.bf33.6900
3 Member 1 Yes 4 5 0 00a5.bf4a.a300
4 Member 1 Yes 4 5 0 00a5.bf4a.9a00
5 Member 1 Yes 4 5 0 dcf7.19a1.3780

Stack Discovery Protocol Counters
Messages Sent Messages Recvd
UP DOWN UP DOWN
--------------------------------------------------------
*1: 0000017270 0000000000 0000000000 0000000000
2: 0000000000 0000000000 0000016989 0000000000
3: 0000000000 0000000000 0000016978 0000000000
4: 0000000000 0000000000 0000016952 0000000000
5: 0000000000 0000000000 0000016928 0000000000
6: 0000000000 0000000000 0000000000 0000000000
7: 0000000000 0000000000 0000000000 0000000000
8: 0000000000 0000000000 0000000000 0000000000

Misc Counters
Counter Up Down
---------------------------------------------------

Wrong Ver Number: Send: 0000000000 0000000000
Wrong Ver Number: Recv: 0000000000 0000000000
Missed Messages: 0000000000 0000000000
Orphaned Messages 0000000000 0000000000
Suppressed Messages 0000000000 0000000000
No Available Messages 0000000000 0000000000
Link Present 0000000000 0000000000
Link Not Present 0000000000 0000000000
Link RxReset 0000000000 0000000000
Link Sync Stuck Resets 0000000000 0000000000
Duplicates 0000000000 0000000000
RAC Not OK Resets 0000000000
Switch# of last duplicate 0000000256
Sequence Number Failures 0000000000
RAC Not OK Resets 0000000000
Sync Not OK Resets 0000000000 0000000000
Switch# of last Failure: 256 Last Difference 0
Switch Number Conflicts 0
Stack Changes 6
Int Stack Link changes 0
Int Stack Link state 0x0
Reciprocal Efficiency Changes: Upgrade 0, Downgrade 0
Resource Counters
-------------------------------------------
Chunk Alloc's 0000000043
Chunk Free's 0000000039
Enqueue Failures: 0000000000
Null Queue Failures: 0000000000
Chunk Alloc Errors: 0000000000

Stack State Machine Counters
Messages Sent Messages Recvd
-------------------------------------------------
*1: 0000000000 0000000000
2: 0000000011 0000000011
3: 0000000011 0000000011
4: 0000000011 0000000011
5: 0000000010 0000000010
6: 0000000000 0000000000
7: 0000000000 0000000000
8: 0000000000 0000000000

[Meheretab Mengistu]

Hi,

Make sure the new switch has the same IOS with the rest of the switches. If not, you will need to match the IOS before adding it to the stack. 

HTH,

Meheretab

[balaji.bandi]

make sure you follow the steps as mentioned in the document :

https://www.cisco.com/c/en/us/support/docs/switches/catalyst-3750-series-switches/71925-cat3750-create-switch-stks.html#anc16

[Leo Laohoo]

Console into switch #6 and reboot. Post the entire boot-up process.

[davinci]

I disconnected switch 6 stack cables and rebooted the switch.  here are console messages.

switch:
CPU rev: B
Image passed digital signature verification
Board rev: 25
Testing DataBus...
Testing AddressBus...
Testing Memory from 0x00000000 to 0x1fffffff.../
Using driver version 4 for media type 1
Xmodem file system is available.
Base ethernet MAC Address: 4c:71:0c:00:e8:00
The password-recovery mechanism is enabled.
USB EHCI 1.00
USB EHCI 1.00
USB Console INIT
Initializing Flash...
mifs[5]: 12 files, 1 directories
mifs[5]: Total bytes : 1806336
mifs[5]: Bytes used : 833536
mifs[5]: Bytes available : 972800
mifs[5]: mifs fsck took 0 seconds.
mifs[6]: 2 files, 1 directories
mifs[6]: Total bytes : 3870720
mifs[6]: Bytes used : 1213440
mifs[6]: Bytes available : 2657280
mifs[6]: mifs fsck took 1 seconds.
mifs[7]: 5 files, 1 directories
mifs[7]: Total bytes : 258048
mifs[7]: Bytes used : 8192
mifs[7]: Bytes available : 249856
mifs[7]: mifs fsck took 0 seconds.
mifs[8]: 5 files, 1 directories
mifs[8]: Total bytes : 258048
mifs[8]: Bytes used : 8192
mifs[8]: Bytes available : 249856
mifs[8]: mifs fsck took 0 seconds.
mifs[9]: 4 files, 4 directories
mifs[9]: Total bytes : 122185728
mifs[9]: Bytes used : 7496192
mifs[9]: Bytes available : 114689536
mifs[9]: mifs fsck took 9 seconds.
...done Initializing Flash.
Loading "flash:/c2960x-universalk9-mz.152-4.E8/c2960x-universalk9-mz.152-4.E8.bin"...flash:/c2960x-universalk9-mz.152-4.E8/c2960x-universalk9-mz.152-4.E8.bin: no such file or directory

Error loading "flash:/c2960x-universalk9-mz.152-4.E8/c2960x-universalk9-mz.152-4.E8.bin"

Interrupt within 5 seconds to abort boot process.
Loading "flash:/update/c2960x-universalk9-mz.152-2.E7/c2960x-universalk9-mz.152-2.E7.bin"...Verifying image flash:/update/c2960x-universalk9-mz.152-2.E7/c2960x-universalk9-mz.152-2.E7.bin...............................................................................................................Image failed digital signature verification

Error loading "flash:/update/c2960x-universalk9-mz.152-2.E7/c2960x-universalk9-mz.152-2.E7.bin"

Interrupt within 5 seconds to abort boot process.
Boot process failed...

The system is unable to boot automatically. The BOOT
environment variable needs to be set to a bootable
image.

switch:

[balaji.bandi · Accepted solution]

Looks like no image on the device so booting failed :

Error loading "flash:/update/c2960x-universalk9-mz.152-2.E7/c2960x-universalk9-mz.152-2.E7.bin"

Interrupt within 5 seconds to abort boot process.
Boot process failed...

The system is unable to boot automatically. The BOOT
environment variable needs to be set to a bootable
image.

switch:

you need install the image and set the boot image and join back to stack :

here is a guide to install the image on to the failed switch.

https://medium.com/network-girl/cisco-catalyst-ios-image-recovery-e22985eb2e86

[julian.bendix]

Hi!

The switch isn't coming up because it is unable of booting the given image.

Can you take switch 6 out of the stack and try booting it standalone?

I am pretty sure it won't work because of the same reason,
try getting the image onto flash again from scratch and be sure the switch is coming up properly,
then readd it to the stack.

Best regards
Julian

[Leo Laohoo]

Ok, the switch is in ROMMON because there is no valid IOS to boot.
Notice that the switch have a USB port? Copy the IOS (from the other working switches) using a USB thumb drive and force switch #6 to boot the IOS (from ROMMON) using the command "boot usbflash0:IOS_filename.bin".

[davinci]

yes, thanks. I will try it and get back to you guys.

[balaji.bandi]

Sure let us know how it goes, once you fix the switch image you should be good, if still issue post the complete logs.

[davinci]

im still having trouble copying from flash>usb so that i can then do usb>flash

ALDLEG-X70#dir
Directory of flash:/c2960x-universalk9-mz.152-2.E7/

5 -rwx 788 Dec 4 2019 21:53:01 +00:00 info
6 -rwx 21284864 Dec 4 2019 21:39:04 +00:00 c2960x-universalk9-mz.152-2.E7.bin
7 drwx 6144 Dec 4 2019 21:49:44 +00:00 html

122185728 bytes total (95084032 bytes free)
ALDLEG-X70#dir us
ALDLEG-X70#dir usbflash0:
Directory of usbflash0:/

1 drw- 0 Oct 31 2016 09:10:48 +00:00 VPN Client
143 -rw- 174131122 Nov 17 2016 17:09:20 +00:00 AIR-CT5500-K9-8-0-140-0.aes
148 -rw- 410 Sep 19 2019 17:43:28 +00:00 Chrome bookmarks_9_19_19.html
149 -rw- 17970 Sep 19 2019 17:50:34 +00:00 Firefox bookmarks 09_19_19.html

1047232512 bytes total (860733440 bytes free)

ALDLEG-X70#copy flash:/c2960x-universalk9-mz.152-2.E7 usbflash0:
Destination filename [c2960x-universalk9-mz.152-2.E7]?
%Error reading flash:/c2960x-universalk9-mz.152-2.E7 (Is a directory)

[davinci]

it works now.  my syntax was off. switched joined ok