6513Crash : SP is being reset by the RP

cy_yeh · ‎12-11-2014

Hi

Yesterday our core 6513(Version 12.2(17b)SXA) crashed

Dec 10 16:11:52.696: %C6K_PLATFORM-SP-2-PEER_RESET: SP is being reset by the RP

%Software-forced reload

Crashinfo is attached. Hope to get you expert opinion on this.

InayathUlla Sharieff · ‎12-11-2014

Hi Cy,

Could you please attach the crash info from RP ?

Also loooking at the crash info I see the following mac address notification:

Dec 10 15:57:38.468: %MAC_MOVE-SP-4-NOTIF: Host ec55.f921.4652 in vlan 36 is flapping between port Po5 and port Po4
Dec 10 16:10:08.473: %MAC_MOVE-SP-4-NOTIF: Host 7c7a.919d.2d99 in vlan 36 is flapping between port Po4 and port Po5
Dec 10 16:10:43.474: %MAC_MOVE-SP-4-NOTIF: Host 446d.5798.e66a in vlan 36 is flapping between port Po4 and port Po5
Dec 10 16:11:52.696: %C6K_PLATFORM-SP-2-PEER_RESET: SP is being reset by the RP

Could you please check why there is so much of flap occuring? The same mac addresses are been seen from two different ports(Port-Channel Po4 &Po5 ) This is kind of loop in your network.

Regarding crash send me the show ver , show redundancy and crash info file outputs.

HTH

cy_yeh · ‎12-11-2014

Hi

There only has a crash file.

And the Mac flapping situation is caused by Ap roaming

SHOW VER

HQMOABSW01#show ver
Cisco Internetwork Operating System Software
IOS (tm) s72033_rp Software (s72033_rp-JK9SV-M), Version 12.2(17b)SXA, RELEASE SOFTWARE (fc1)
TAC Support: http://www.cisco.com/tac
Copyright (c) 1986-2003 by cisco Systems, Inc.
Compiled Tue 30-Dec-03 21:40 by ccai
Image text-base: 0x40008FBC, data-base: 0x42258000

ROM: System Bootstrap, Version 12.2(14r)S9, RELEASE SOFTWARE (fc1)
BOOTLDR: s72033_rp Software (s72033_rp-JK9SV-M), Version 12.2(17b)SXA, RELEASE SOFTWARE (fc1)

HQMOABSW01 uptime is 13 weeks, 3 days, 1 hour, 34 minutes
Time since HQMOABSW01 switched to active is 13 weeks, 3 days, 1 hour, 34 minutes
System returned to ROM by power-on (SP by power-on)
System restarted at 09:00:13 UTC Sat Dec 14 2013
System image file is "sup-bootflash:s72033-jk9sv-mz.122-17b.SXA.bin"

This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to
export@cisco.com.

cisco WS-C6513 (R7000) processor (revision 1.0) with 458752K/65536K bytes of memory.
Processor board ID SAL0802SB21
SR71000 CPU at 600Mhz, Implementation 0x504, Rev 1.2, 512KB L2 Cache
Last reset from power-on
Bridging software.
X.25 software, Version 3.0.0.
SuperLAT software (copyright 1990 by Meridian Technology Corp).
TN3270 Emulation software.
24 Virtual Ethernet/IEEE 802.3 interface(s)
48 FastEthernet/IEEE 802.3 interface(s)
132 Gigabit Ethernet/IEEE 802.3 interface(s)
1917K bytes of non-volatile configuration memory.
8192K bytes of packet buffer memory.

65536K bytes of Flash internal SIMM (Sector size 512K).
Standby is up
Standby has 458752K/65536K bytes of memory.

Configuration register is 0x2102

InayathUlla Sharieff · ‎12-12-2014

Can you send me the show tech via PM?

cy_yeh · ‎12-14-2014

Dear Sir,

Sorry for been so late

show tech as attachment.

And there is another question, during that situation it seems like the only my slot 6 has been affected.

I have a server to monitor all service, when it happened the service of slot 6 are all disconnect but other slots have not been affected.

My slot 6 is WS-X6548-RJ-45.

Is it hardware limitation?

Thanks

InayathUlla Sharieff · ‎12-14-2014

Hi,

No thats not the hardware limitation issue.

Secondly

Time since HQMOABSW01 switched to active is 4 days, 17 hours, 46 minutes
System returned to ROM by Stateful Switchover (SP by power-on)
System restarted at 03:20:59 UTC Tue Apr 8 2014
System image file is "sup-bootflash:s72033-jk9sv-mz.122-17b.SXA.bin"

cisco WS-C6513 (R7000) processor (revision 1.0) with 458752K/65536K bytes of memory.

------------------ show module ------------------

Mod Ports Card Type Model Serial No.
--- ----- -------------------------------------- ------------------ -----------
6 48 SFM-capable 48-port 10/100 Mbps RJ45 WS-X6548-RJ-45 SAL09497F4D
7 2 Supervisor Engine 720 (Active) WS-SUP720-BASE SAD080106LE
8 2 Supervisor Engine 720 (Hot) WS-SUP720-BASE SAD08270EBK
9 16 Pure SFM-mode 16 port 1000mb GBIC WS-X6816-GBIC SAL0741MZTH
10 16 Pure SFM-mode 16 port 1000mb GBIC WS-X6816-GBIC SAL1209HEP1
11 48 CEF720 48 port 10/100/1000mb Ethernet WS-X6748-GE-TX SAD073801WD
12 48 CEF720 48 port 10/100/1000mb Ethernet WS-X6748-GE-TX SAD082304X3

Logs:
=======
Dec 15 09:22:00.080: %MAC_MOVE-SP-4-NOTIF: Host 7c7a.919d.2443 in vlan 36 is flapping between port Po5 and port Po4
Dec 15 09:26:40.088: %MAC_MOVE-SP-4-NOTIF: Host 18f4.6a24.1808 in vlan 36 is flapping between port Po4 and port Po5
Dec 15 09:26:44.240: %MAC_MOVE-SP-4-NOTIF: Host e82a.ea13.cfd1 in vlan 36 is flapping between port Po4 and port Po5
Dec 15 09:27:15.092: %MAC_MOVE-SP-4-NOTIF: Host 18f4.6a24.1808 in vlan 36 is flapping between port Po5 and port Po4
Dec 15 09:27:44.237: %MAC_MOVE-SP-4-NOTIF: Host e82a.ea13.cfd1 in vlan 36 is flapping between port Po5 and port Po4
Dec 15 09:48:45.152: %MAC_MOVE-SP-4-NOTIF: Host 74e5.4338.0307 in vlan 36 is flapping between port Po4 and port Po5

------------------ show slavebootflash: all ------------------
3 .. crashinfo 8049559C 3A18278 25 328728 Dec 10 2014 16:11:52 +08:00 crashinfo_20141210-081152

------------------ show slavesup-bootflash: all ------------------

3 .. crashinfo E385886F 29F4F50 25 318995 Dec 10 2014 16:11:52 +08:00 crashinfo_20141210-081152

Dec 10 16:11:52.696: %C6K_PLATFORM-SP-2-PEER_RESET: SP is being reset by the RP
%Software-forced reload
Unexpected exception, CPU signal 23, PC = 0x4013E95C
-Traceback= 4013E95C 4013C824 4025BE10 4025CF14 402536F8 40253870 40143228

I would reuqest you to kindly check why you have loop in your network. Please check why you are seeing the flap between P4 &PO5 for vlan 36?

regards

Inayath

cy_yeh · ‎12-14-2014

Hi

That's cause by Ap roaming

But this situation has been 7 years, for this 7 years, it hasn't any problem.