04-08-2015 08:00 PM - edited 03-05-2019 01:11 AM
Hello,
we have 2 switches in stack, last night switch 2 was removed from stack and got rebooted and again it got back in stack.
Switch -2 entered into the provisioned mode for certain span of time. snap shot is attached .
Apr 9 02:36:25.266 IST: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 1 Switch 1 has changed to state DOWN
Apr 9 02:36:25.837 IST: %STACKMGR-4-SWITCH_REMOVED: Switch 2 has been REMOVED from the stack
Apr 9 02:36:27.850 IST: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/1, changed state to down
Apr 9 02:36:27.850 IST: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/3, changed state to down
Apr 9 02:36:27.850 IST: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/4, changed state to down
Apr 9 02:36:27.850 IST: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/5, changed state to down
Apr 9 02:36:28.857 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/1, changed state to down
Apr 9 02:36:28.857 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/3, changed state to down
Apr 9 02:36:28.857 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/4, changed state to down
Apr 9 02:36:28.857 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/5, changed state to down
Apr 9 02:48:37.111 IST: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 1 Switch 1 has changed to state UP
Apr 9 02:49:08.048 IST: %STACKMGR-4-SWITCH_ADDED: Switch 2 has been ADDED to the stack
Apr 9 02:49:20.170 IST: %STACKMGR-5-SWITCH_READY: Switch 2 is READY
Apr 9 02:49:20.170 IST: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 1 Switch 2 has changed to state DOWN
Apr 9 02:49:20.170 IST: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 2 Switch 2 has changed to state UP
*Mar 1 00:01:02.738: %STACKMGR-4-SWITCH_ADDED: Switch 1 has been ADDED to the stack (Switch-2)
*Mar 1 00:01:02.738: %STACKMGR-4-SWITCH_ADDED: Switch 2 has been ADDED to the stack (Switch-2)
*Mar 1 00:01:07.024: %SPANTREE-5-EXTENDED_SYSID: Extended SysId enabled for type vlan (Switch-2)
*Apr 9 02:49:18.979 IST: %SYS-6-CLOCKUPDATE: System clock has been updated from 21:19:18 UTC Wed Apr 8 2015 to 02:49:18 IST Thu Apr 9 2015, configured from console by console. (Cochin-GMSC-SWTCH-2)
*Apr 9 02:49:19.382 IST: %SYS-5-CONFIG_I: Configured from memory by console (Cochin-GMSC-SWTCH-2)
*Apr 9 02:49:19.482 IST: %STACKMGR-5-SWITCH_READY: Switch 1 is READY (Cochin-GMSC-SWTCH-2)
*Apr 9 02:49:19.818 IST: %STACKMGR-5-MASTER_READY: Master Switch 1 is READY (Cochin-GMSC-SWTCH-2)
*Apr 9 02:49:20.053 IST: %STACKMGR-5-SWITCH_READY: Switch 2 is READY (Cochin-GMSC-SWTCH-2)
*Apr 9 02:49:20.178 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface Loopback99, changed state to up (Cochin-GMSC-SWTCH-2)
*Apr 9 02:49:20.178 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface Loopback999, changed state to up (Cochin-GMSC-SWTCH-2)
*Apr 9 02:49:20.321 IST: %SYS-5-RESTART: System restarted -- (Cochin-GMSC-SWTCH-2)
Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 12.2(44)SE2, RELEASE SOFTWARE (fc2) (Cochin-GMSC-SWTCH-2)
Copyright (c) 1986-2008 by Cisco Systems, Inc. (Cochin-GMSC-SWTCH-2)
Compiled Thu 01-May-08 15:00 by antonino (Cochin-GMSC-SWTCH-2)
Apr 9 02:49:24.222 IST: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/1, changed state to up
Apr 9 02:49:24.264 IST: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/3, changed state to up
Apr 9 02:49:24.281 IST: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/4, changed state to up
Apr 9 02:49:24.314 IST: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/5, changed state to up
Apr 9 02:49:25.228 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/1, changed state to up
Apr 9 02:49:25.270 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/3, changed state to up
Apr 9 02:49:25.287 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/4, changed state to up
Apr 9 02:49:25.321 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/5, changed state to up
Apr 9 02:49:39.959 IST: %PLATFORM-6-MODULE_INSERTED: TwinGig Converter module inserted in slot 1 in Switch 2 (Cochin-GMSC-SWTCH-2)
Apr 9 02:49:42.106 IST: %PLATFORM-6-MODULE_INSERTED: TwinGig Converter module inserted in slot 2 in Switch 2 (Cochin-GMSC-SWTCH-2)
Switch 02
---------
Switch Uptime : 5 hours, 38 minutes
Base ethernet MAC Address : 00:23:04:19:9A:00
Motherboard assembly number : 73-10313-11
Motherboard serial number : FDO12320AH4
Model revision number : A0
Motherboard revision number : A0
Model number : WS-C3750E-24TD-SD
Daughterboard assembly number : 800-28590-01
Daughterboard serial number : FDO123305QU
System serial number : FDO1234V07K
Top assembly part number : 800-28443-01
Top assembly revision number : A0
Version ID : V01
CLEI Code Number : COMVC00ARA
Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 12.2(44)SE2, RELEASE SOFTWARE (fc2)
Copyright (c) 1986-2008 by Cisco Systems, Inc.
Compiled Thu 01-May-08 15:00 by antonino
Image text-base: 0x00003000, data-base: 0x02000000
Please help to find reason behind this unexpected reboot.
Regards
Jatinder
04-08-2015 10:03 PM
Post the complete output to the command "sh version".
04-09-2015 12:43 AM
sh ver
Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 12.2(44)SE2, RELEASE SOFTWARE (fc2)
Copyright (c) 1986-2008 by Cisco Systems, Inc.
Compiled Thu 01-May-08 15:00 by antonino
Image text-base: 0x00003000, data-base: 0x02000000
ROM: Bootstrap program is C3750E boot loader
BOOTLDR: C3750E Boot Loader (C3750E-HBOOT-M) Version 12.2(35r)SE1, RELEASE SOFTWARE (fc2)
Cochin-GMSC-SWTCH uptime is 11 weeks, 1 day, 11 hours, 30 minutes
System returned to ROM by power-on
System restarted at 01:41:48 IST Wed Jan 21 2015
System image file is "flash:c3750e-universalk9-mz.122-44.SE2/c3750e-universalk9-mz.122-44.SE2.bin"
This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.
A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html
If you require further assistance please contact us by sending email to
export@cisco.com.
License Level: ipbase
License Type: Permanent
Next reload license Level: ipbase
cisco WS-C3750E-24TD (PowerPC405) processor (revision A0) with 0K/16376K bytes of memory.
Processor board ID FDO1234V07J
Last reset from power-on
3 Virtual Ethernet interfaces
1 FastEthernet interface
56 Gigabit Ethernet interfaces
4 Ten Gigabit Ethernet interfaces
The password-recovery mechanism is enabled.
512K bytes of flash-simulated non-volatile configuration memory.
Base ethernet MAC Address : 00:22:BE:95:35:80
Motherboard assembly number : 73-10313-11
Motherboard serial number : FDO12340H8F
Model revision number : A0
Motherboard revision number : A0
Model number : WS-C3750E-24TD-SD
Daughterboard assembly number : 800-28590-01
Daughterboard serial number : FDO123305LA
System serial number : FDO1234V07J
Top Assembly Part Number : 800-28443-01
Top Assembly Revision Number : A0
Version ID : V01
CLEI Code Number : COMVC00ARA
Hardware Board Revision Number : 0x01
Switch Ports Model SW Version SW Image
------ ----- ----- ---------- ----------
* 1 30 WS-C3750E-24TD 12.2(44)SE2 C3750E-UNIVERSALK9-M
2 30 WS-C3750E-24TD 12.2(44)SE2 C3750E-UNIVERSALK9-M
Switch 02
---------
Switch Uptime : 10 hours, 24 minutes
Base ethernet MAC Address : 00:23:04:19:9A:00
Motherboard assembly number : 73-10313-11
Motherboard serial number : FDO12320AH4
Model revision number : A0
Motherboard revision number : A0
Model number : WS-C3750E-24TD-SD
Daughterboard assembly number : 800-28590-01
Daughterboard serial number : FDO123305QU
System serial number : FDO1234V07K
Top assembly part number : 800-28443-01
Top assembly revision number : A0
Version ID : V01
CLEI Code Number : COMVC00ARA
License Level : ipbase
License Type : Permanent
Next reboot licensing Level : ipbase
Configuration register is 0xF
04-09-2015 04:25 AM
Ok, now post the output to the command "dir flash2:"
04-09-2015 05:23 AM
Hello LEO
#dir flash2:
Directory of flash2:/
2 -rwx 1938 Apr 7 2015 08:11:36 +05:30 private-config.text
3 -rwx 676 Mar 1 1993 05:31:03 +05:30 vlan.dat
4 -rwx 4120 Apr 7 2015 08:11:37 +05:30 multiple-fs
5 drwx 512 Mar 1 1993 05:36:07 +05:30 c3750e-universalk9-mz.122-44.SE2
394 -rwx 14007 Apr 7 2015 08:11:36 +05:30 config.text
57409536 bytes total (31059456 bytes free)
H#dir flash1:
Directory of flash:/
2 -rwx 4120 Apr 7 2015 08:11:36 +05:30 multiple-fs
3 -rwx 1938 Apr 7 2015 08:11:36 +05:30 private-config.text
395 -rwx 14007 Apr 7 2015 08:11:35 +05:30 config.text
5 drwx 512 Mar 1 1993 05:36:22 +05:30 c3750e-universalk9-mz.122-44.SE2
394 -rwx 676 Mar 1 1993 05:31:06 +05:30 vlan.dat
57409536 bytes total (31059456 bytes free)
what can be the reason for unexpected reboot , it has happened twice with this switch
04-09-2015 05:43 AM
Ok, no crash logs.
3750E/X have removable PS. Can you please check the power cable connected to switch #2 is secure and the PS is secure in it's slot.
3750E/X PS has two PS slots. You can try moving the PS from one slot to another.
04-09-2015 06:05 AM
Hi Leo,
we are going to check same , is there any issue in power cable and power source ? it is has single PS.
can we also suspect any issue in hardware of switch ? is there any mechanism to verify hardware of switch ?
Regards
04-09-2015 04:47 PM
There's another thing you could try:
session 2
sh version
Post the output to the output to the command "sh version".
04-09-2015 09:54 PM
what is use of session 2 command ,is this service impacting command
sh ver
Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 12.2(44)SE2, RELEASE SOFTWARE (fc2)
Copyright (c) 1986-2008 by Cisco Systems, Inc.
Compiled Thu 01-May-08 15:00 by antonino
Image text-base: 0x00003000, data-base: 0x02000000
ROM: Bootstrap program is C3750E boot loader
BOOTLDR: C3750E Boot Loader (C3750E-HBOOT-M) Version 12.2(35r)SE1, RELEASE SOFTWARE (fc2)
******* uptime is 11 weeks, 2 days, 8 hours, 40 minutes
System returned to ROM by power-on
System restarted at 01:41:48 IST Wed Jan 21 2015
System image file is "flash:c3750e-universalk9-mz.122-44.SE2/c3750e-universalk9-mz.122-44.SE2.bin"
This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.
A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html
If you require further assistance please contact us by sending email to
export@cisco.com.
License Level: ipbase
License Type: Permanent
Next reload license Level: ipbase
cisco WS-C3750E-24TD (PowerPC405) processor (revision A0) with 0K/16376K bytes of memory.
Processor board ID FDO1234V07J
Last reset from power-on
3 Virtual Ethernet interfaces
1 FastEthernet interface
56 Gigabit Ethernet interfaces
4 Ten Gigabit Ethernet interfaces
The password-recovery mechanism is enabled.
512K bytes of flash-simulated non-volatile configuration memory.
Base ethernet MAC Address : 00:22:BE:95:35:80
Motherboard assembly number : 73-10313-11
Motherboard serial number : FDO12340H8F
Model revision number : A0
Motherboard revision number : A0
Model number : WS-C3750E-24TD-SD
Daughterboard assembly number : 800-28590-01
Daughterboard serial number : FDO123305LA
System serial number : FDO1234V07J
Top Assembly Part Number : 800-28443-01
Top Assembly Revision Number : A0
Version ID : V01
CLEI Code Number : COMVC00ARA
Hardware Board Revision Number : 0x01
Switch Ports Model SW Version SW Image
------ ----- ----- ---------- ----------
* 1 30 WS-C3750E-24TD 12.2(44)SE2 C3750E-UNIVERSALK9-M
2 30 WS-C3750E-24TD 12.2(44)SE2 C3750E-UNIVERSALK9-M
Switch 02
---------
Switch Uptime : 1 day, 7 hours, 35 minutes
Base ethernet MAC Address : 00:23:04:19:9A:00
Motherboard assembly number : 73-10313-11
Motherboard serial number : FDO12320AH4
Model revision number : A0
Motherboard revision number : A0
Model number : WS-C3750E-24TD-SD
Daughterboard assembly number : 800-28590-01
Daughterboard serial number : FDO123305QU
System serial number : FDO1234V07K
Top assembly part number : 800-28443-01
Top assembly revision number : A0
Version ID : V01
CLEI Code Number : COMVC00ARA
License Level : ipbase
License Type : Permanent
Next reboot licensing Level : ipbase
Configuration register is 0xF
04-09-2015 10:09 PM
what is use of session 2 command ,is this service impacting command
No it's not a service impacting command as long as you do the commands stated. The command "session 2" is like physically consoling into the 2nd switch.
04-09-2015 10:42 PM
Hello Leo,
find below output of Switch 2
sh version
Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 12.2(44)SE2, RELEASE SOFTWARE (fc2)
Copyright (c) 1986-2008 by Cisco Systems, Inc.
Compiled Thu 01-May-08 15:00 by antonino
Image text-base: 0x00003000, data-base: 0x02000000
ROM: Bootstrap program is C3750E boot loader
BOOTLDR: C3750E Boot Loader (C3750E-HBOOT-M) Version 12.2(35r)SE1, RELEASE SOFTWARE (fc2)
Cochin-GMSC-SWTCH-2 uptime is 1 day, 8 hours, 23 minutes
System returned to ROM by power-on
System restarted at 02:48:06 IST Thu Apr 9 2015
System image file is "flash:c3750e-universalk9-mz.122-44.SE2/c3750e-universalk9-mz.122-44.SE2.bin"
This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.
A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html
If you require further assistance please contact us by sending email to
export@cisco.com.
License Level: ipbase
License Type: Permanent
Next reload license Level: ipbase
cisco WS-C3750E-24TD (PowerPC405) processor (revision A0) with 0K/16376K bytes of memory.
Processor board ID FDO1234V07K
Last reset from power-on
3 Virtual Ethernet interfaces
1 FastEthernet interface
56 Gigabit Ethernet interfaces
4 Ten Gigabit Ethernet interfaces
The password-recovery mechanism is enabled.
512K bytes of flash-simulated non-volatile configuration memory.
Base ethernet MAC Address : 00:23:04:19:9A:00
Motherboard assembly number : 73-10313-11
Motherboard serial number : FDO12320AH4
Model revision number : A0
Motherboard revision number : A0
Model number : WS-C3750E-24TD-SD
Daughterboard assembly number : 800-28590-01
Daughterboard serial number : FDO123305QU
System serial number : FDO1234V07K
Top Assembly Part Number : 800-28443-01
Top Assembly Revision Number : A0
Version ID : V01
CLEI Code Number : COMVC00ARA
Hardware Board Revision Number : 0x01
Configuration register is 0xF
04-09-2015 11:00 PM
Cochin-GMSC-SWTCH-2 uptime is 1 day, 8 hours, 23 minutes System returned to ROM by power-on System restarted at 02:48:06 IST Thu Apr 9 2015
As confirmed by the output, Switch 2 had a power restart.
04-09-2015 11:24 PM
we have checked and verified and there was no issue related to power because some more devices are connected on same power source those were not affected.. so we are suspecting is there any issue in hardware of switch...
04-12-2015 09:41 AM
Hi could please share the output of
sh stacks
Thanks,
Madhu.
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide