Suddenly Reboot of the WS-X4516-10GE(Supervisor V-10GE with 2 10GE X2 ports, and 4 1000BaseX SFP ports) without any reason

[apollosu]

Hello,

We have a chassis WS-C4506 rurning with  version : cat4000-i9s-mz.122-25.EWA4.bin", the problème is that the switch reboot without reason.

I want know H/W error or S/W error?

I have seen this message :

Last powerfail: 08/27/2010 17:33:04

Current time: 03/07/2011 13:34:49

Last crash: 03/04/2011 14:36:55

Build: 12.2(25)EWA4
buildversion addr: 11DFBDB4

pc=10F760F4 lr=10F760F4 msr=02029200 vector=00000600
cr=82002024 ctr=11439ADC xer=00000000
r0=10F760F4 r1=1230B660 r2=00000000 r3=00000047
r4=0000000A r5=00000000 r6=1230B628 r7=00000001
r8=FFFFFFFF r9=1230B6E7 r10=1230B5C0 r11=00000300
r12=82002029 r13=00000000 r14=11E00000 r15=11620000
r16=12362528 r17=11620000 r18=11620000 r19=11E00000
r20=11F90000 r21=11D0586C r22=11E4A808 r23=11E4A408
r24=11D05860 r25=1230B7CC r26=1230B788 r27=11DFBC28
r28=1230B680 r29=1230B66C r30=15B39408 r31=1230B668
dec=002140AD tbu=0001EEAC tbl=8B2C4AF2
dar=80200020 dsisr=80200020 hid0=80004000

Machine Check Summary=00000000
Critical Summary0=00000000 Summary1=00000000
PCI ErrAddr=00000000 ErrExtAddr=00000000 ErrDl=00000000 ErrDh=00000000
PCI ErrDr=00000000 ErrAttrib=00000000
DDR ErrDetect=00000000 ErrSbe=00FF00D2

Traceback: 10F760F4 114B3B4C 10F815B4 1144A2DC 1144A15C 10361E34 103603F8 10007174 1029AA00 10295828

Stack frames:
Frame 1: pc=114B3B4C stack=1230B758
Frame 2: pc=10F815B4 stack=1230B760
Frame 3: pc=1144A2DC stack=1230B7F0
Frame 4: pc=1144A15C stack=1230B800
Frame 5: pc=10361E34 stack=1230B808
Frame 6: pc=103603F8 stack=11E4C848
Frame 7: pc=10007174 stack=11E4C888
Frame 8: pc=1029AA00 stack=12362520
Frame 9: pc=10295828 stack=123626A0

Pushed stack:
1230B660: 1230B758 10F760F4 11DF8840 11DFBAD8
1230B670: 00000003 00000000 1230B680 00000000
1230B680: 11DFBAB8 1230B6A0 00000000 00000001
1230B690: 00000047 00000052 00000000 00000000
1230B6A0: 0A466174 616C204E 464C2045 72726F72
1230B6B0: 204E464C 20303030 31303630 32204644
1230B6C0: 54312030 30303039 36453220 46445432
1230B6D0: 20303030 30303030 3020464C 44203030
1230B6E0: 30303030 30300A00 FFFFFFFF 11DFBC28
1230B6F0: 11DFBAD8 00000003 00000000 1230B704
1230B700: 00000000 11DF7298 1230B66C 00000000
1230B710: 00000000 00000022 00000080 00000000
1230B720: 00000000 00000003 00010602 00010602
1230B730: 000096E2 00000000 00000000 00000000
1230B740: 00000000 1230B768 15B39578 00000003
1230B750: 1230B7A8 15B3959C 1230B760 114B3B4C
1230B760: 1230B7F0 10F815B4 55555555 55555555
1230B770: 00000001 55555502 CF409210 55055555
1230B780: FF7EFFF6 FFFFFFEB 00000000 00000000
1230B790: 00000002 00000200 00000000 00000000
1230B7A0: 00000000 00000000 00000000 00000000
1230B7B0: 00000002 00000200 00000000 00000000
1230B7C0: 00000000 00000000 00010602 FF7FF8FF
1230B7D0: FFFFFFFF 8B069D03 11E07738 00000000
1230B7E0: 11D1F458 00000000 11E00000 17C62EE8
1230B7F0: 1230B800 1144A2DC FFFFFFFF 11E07738
1230B800: 1230B808 1144A15C 11E4C848 10361E34
1230B810: FFFFFFFF FFFFFFFF                 

Popped stack:
1230B460: 1230B468 12CA6B80 1230B488 1025B07C
1230B470: 1230B488 00000004 1230B480 12CBBD88
1230B480: 1230B498 110C2840 1230B490 1230B66C
1230B490: 1230B498 110C2810 1230B4A8 10365348
1230B4A0: 10329BC0 10258FD0 1230B4C0 1032C1C0
1230B4B0: 11B3FDCC 1230B66C 11E10000 11E00000
1230B4C0: 1230B4D0 103299F4 1230B540 0000000A
1230B4D0: 1230B4E0 1040FF84 15B39408 0000000A
1230B4E0: 1230B4E8 10364414 1230B4F0 1032C8E4
1230B4F0: 1230B500 1032C9A8 1230B508 0000000A
1230B500: 1230B510 101D10F0 1230B540 FFFFFFFE
1230B510: 1230B5B8 101CE8C4 00000000 15F20D58
1230B520: 00000ED7 14051304 11F80000 15F20D48
1230B530: 1230B5A0 1230B598 11E00000 11620000
1230B540: 12362528 11620000 11620000 11E00000
1230B550: 00000000 11D0586C 1230B6E8 00000000
1230B560: FFFFFFFF 00000001 1230B788 82002029
1230B570: 11E00000 11620000 12362528 11620000
1230B580: 11620000 11E00000 11F90000 11D0586C
1230B590: 11E4A808 11E4A408 11D05860 1230B7CC
1230B5A0: 1230B788 11DFBC28 1230B680 1230B66C
1230B5B0: 15B39408 FFFFFFFE 1230B650 101D1424
1230B5C0: 1230B660 1144CC48 00000000 00000000
1230B5D0: 1230B368 00000000 10EF8B08 1230B6E7
1230B5E0: 122DEE70 00000001 00000000 00000000
1230B5F0: 1230B608 1142FC00 00002A2C 00000ED7
1230B600: 140512FE 14E95D10 1230B610 114DE4AC
1230B610: 1230B658 11441368 00000000 00002A2C
1230B620: 00000003 000E05E8 02000000 1230B658
1230B630: 1230B5C0 1230B668 02000000 1230B658
1230B640: 1230B5C0 1230B668 1230B5C8 1230B668
1230B650: 1230B658 10336584 1230B660 10EF8B1C

Log buffer:

23 2011
CMD: 'sh int' 08:32:51 gmt Wed Feb 23 2011
CMD: 'sh int | inc up' 08:36:17 gmt Wed Feb 23 2011
CMD: 'sh module' 08:49:32 gmt Wed Feb 23 2011
CMD: 'sh power' 08:50:03 gmt Wed Feb 23 2011
CMD: 'sh processes cpu' 08:50:54 gmt Wed Feb 23 2011
CMD: 'sh processes cpu| inc utilization' 08:51:07 gmt Wed Feb 23 2011
CMD: 'sh processes cpu | inc utilization' 08:51:19 gmt Wed Feb 23 2011
CMD: 'sh processes memory | inc Total' 08:51:49 gmt Wed Feb 23 2011
CMD: 'sh int | inc up' 08:54:15 gmt Wed Feb 23 2011
CMD: 'tail' 08:55:12 gmt Wed Feb 23 2011
CMD: 'connect tail' 08:55:12 gmt Wed Feb 23 2011
CMD: '' 08:55:20 gmt Wed Feb 23 2011
CMD: 'dir' 08:55:41 gmt Wed Feb 23 2011
CMD: 'ls' 08:55:48 gmt Wed Feb 23 2011
CMD: 'connect ls' 08:55:48 gmt Wed Feb 23 2011
CMD: 'help' 08:56:23 gmt Wed Feb 23 2011

*Feb 23 11:15:08: %C4K_L2MAN-6-INVALIDSOURCEADDRESSPACKET: Packet received with invalid source MAC address (00:00:00:00:00:00) on port Po11 in vlan 2CMD: 'en' 13:25:46 gmt Wed Feb 23 2011
CMD: 'sh int trunk' 13:28:47 gmt Wed Feb 23 2011
CMD: 'sh arp | inc vlan 2' 13:34:32 gmt Wed Feb 23 2011
CMD: 'sh arp | inc Po11' 13:34:48 gmt Wed Feb 23 2011
CMD: 'sh arp | inc vlan 2' 13:34:59 gmt Wed Feb 23 2011
CMD: 'sh mac-address-table | inc 00:00:00:00:00:00' 13:35:23 gmt Wed Feb 23 2011
CMD: 'sh arp | inc Vlan2' 13:37:02 gmt Wed Feb 23 2011
CMD: 'sh arp | inc 00:00:00:00:00:00' 13:37:47 gmt Wed Feb 23 2011
CMD: 'sh arp | inc Vlan2' 13:38:03 gmt Wed Feb 23 2011
CMD: 'sh ver' 14:00:44 gmt Wed Feb 23 2011
CMD: 'sh mac-address-table | inc 00:03:2E:08:03:83' 14:10:36 gmt Wed Feb 23 2011
CMD: 'sh Vlan status' 14:20:24 gmt Wed Feb 23 2011
CMD: 'sh int status | inc connected' 14:22:07 gmt Wed Feb 23 2011
CMD: 'enable' 06:00:08 gmt Thu Feb 24 2011
CMD: 'exit' 07:57:36 gmt Thu Feb 24 2011
CMD: 'sh arp | inc 10.247.135.41' 08:37:24 gmt Thu Feb 24 2011
CMD: 'sh arp | inc Vlan6' 08:38:06 gmt Thu Feb 24 2011

*Feb 24 11:12:04: %C4K_L2MAN-6-INVALIDSOURCEADDRESSPACKET: Packet received with invalid source MAC address (00:00:00:00:00:00) on port Po11 in vlan 3
*Feb 25 11:05:18: %C4K_L2MAN-6-INVALIDSOURCEADDRESSPACKET: (Suppressed 1 times)Packet received with invalid source MAC address (00:00:00:00:00:00) on port Po11 in vlan 3
*Feb 26 13:12:03: %C4K_EBM-4-HOSTFLAPPING: Host 00:03:2E:08:03:83 in vlan 7 is flapping between port Po11 and port Gi6/47
*Feb 26 13:15:30: %C4K_L2MAN-6-INVALIDSOURCEADDRESSPACKET: Packet received with invalid source MAC address (00:00:00:00:00:00) on port Po11 in vlan 3
*Feb 27 09:31:35: %C4K_L2MAN-6-INVALIDSOURCEADDRESSPACKET: Packet received with invalid source MAC address (00:00:00:00:00:00) on port Po11 in vlan 3
*Feb 28 00:05:59: %C4K_L2MAN-6-INVALIDSOURCEADDRESSPACKET: Packet received with invalid source MAC address (00:00:00:00:00:00) on port Po11 in vlan 2
*Feb 28 07:51:10: %C4K_EBM-4-HOSTFLAPPING: Host 00:03:2E:08:03:83 in vlan 7 is flapping between port Po11 and port Gi6/47
*Feb 28 07:55:41: %C4K_EBM-4-HOSTFLAPPING: Host 00:03:2E:08:03:83 in vlan 7 is flapping between port Po11 and port Gi6/47
*Feb 28 07:55:51: %C4K_EBM-4-HOSTFLAPPING: Host 00:03:2E:08:03:83 in vlan 7 is flapping between port Po11 and port Gi6/47
*Feb 28 08:09:50: %C4K_EBM-4-HOSTFLAPPING: Host 00:03:2E:08:03:83 in vlan 7 is flapping between port Po11 and port Gi6/47
*Mar  2 00:00:57: %C4K_L2MAN-6-INVALIDSOURCEADDRESSPACKET: (Suppressed 1 times)Packet received with invalid source MAC address (00:00:00:00:00:00) on port Po11 in vlan 7
*Mar  3 13:13:31: %C4K_EBM-4-HOSTFLAPPING: Host 00:03:2E:08:03:83 in vlan 7 is flapping between port Po11 and port Gi6/47
*Mar  4 14:36:55: %C4K_HWNETFLOWMAN-4-FATALERRORINTERRUPTSEEN: Netflow Fatal Error interrupt see

Malloc / Free trace:
1 . pc=6000002C addr=199C0D38
2 . pc=10AFEB70 addr=199C0CD8
3 . pc=10AF6F10 addr=199C0CD8
4 . pc=2000005C addr=199C0CD8
5 . pc=6000002C addr=199C0D38
6 . pc=10AFEB70 addr=199C0CD8
7 . pc=10AF6F10 addr=199C0CD8
8 . pc=2000005C addr=199C0CD8
9 . pc=6000002C addr=199C0D38
10. pc=10AFEB70 addr=199C0CD8
11. pc=10AF6F10 addr=199C0CD8
12. pc=2000005C addr=199C0CD8
13. pc=1030425C addr=186C3550
14. pc=1086511C addr=18542C40
15. pc=20000038 addr=18542C40
16. pc=10864324 addr=18542C40
17. pc=108640A8 addr=186A12E8
18. pc=20000038 addr=186A12E8
19. pc=108651AC addr=186A12E8
20. pc=108639C8 addr=199CF9F8
21. pc=6000002C addr=199C0D38
22. pc=10AFEB70 addr=199C0CD8
23. pc=10AF6F10 addr=199C0CD8
24. pc=2000005C addr=199C0CD8
25. pc=6000002C addr=199C0D38
26. pc=10AFEB70 addr=199C0CD8
27. pc=10AF6F10 addr=199C0CD8
28. pc=2000005C addr=199C0CD8
29. pc=6000002C addr=199C0D38
30. pc=10AFEB70 addr=199C0CD8
31. pc=10AF6F10 addr=199C0CD8
32. pc=2000005C addr=199C0CD8
33. pc=1028D538 addr=199C0CD8
34. pc=1028D00C addr=199C0CD8
35. pc=2000005C addr=199C0CD8
36. pc=1028D538 addr=199C0CD8
37. pc=60000038 addr=17DA4630
38. pc=10AFEB70 addr=17DA45D0
39. pc=10AF6F10 addr=17DA45D0
40. pc=20000068 addr=17DA45D0
41. pc=1028D00C addr=199C0CD8
42. pc=2000005C addr=199C0CD8
43. pc=1030425C addr=186C3550
44. pc=6000002C addr=199C0D38
45. pc=10AFEB70 addr=199C0CD8
46. pc=10AF6F10 addr=199C0CD8
47. pc=2000005C addr=199C0CD8
48. pc=6000002C addr=199C0D38
49. pc=10AFEB70 addr=199C0CD8
50. pc=10AF6F10 addr=199C0CD8
51. pc=2000005C addr=199C0CD8
52. pc=1028D538 addr=199C0CD8
53. pc=60000038 addr=17DA4630
54. pc=10AFEB70 addr=17DA45D0
55. pc=10AF6F10 addr=17DA45D0
56. pc=20000068 addr=17DA45D0
57. pc=1028D00C addr=199C0CD8
58. pc=2000005C addr=199C0CD8
59. pc=1086511C addr=17FC30C8
60. pc=20000038 addr=17FC30C8
61. pc=10864324 addr=17FC30C8
62. pc=108640A8 addr=199C0138
63. pc=20000038 addr=199C0138
64. pc=108651AC addr=199C0138

[Leo Laohoo]

This is a duplicate post.  Please see your previous post dated 18 October 2010.

1.  You are running an OLD IOS;

2.  You are hitting a bug because you are using an OLD IOS.

Check FN-62479 and ensure you are not being hit
http://www.cisco.com/en/US/ts/fn/620/fn62479.html

If you are not hitting the field notice, it is likely that you are hitting IOS bug CSCsh99171

http://tools.cisco.com/Support/BugToolKit/search/getBugDetails.do?method=fetchBugDetails&bugId=CSCsh99171

Fix integrated in 12.2(40)SG and later.