cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
980
Views
0
Helpful
6
Replies

16.6.3, crashing in the 'IPv6 ND' process.

Rudy R.
Level 1
Level 1

 

Crashes 8 days apart on the same switch are never fun.  Anyone seen the IPv6 ND crash?

Model: 3650-8X24UQ-S
OS: 16.6.3

I opened a TAC case as well.

Rudy

 

Apr 13 18:56:10.447: %SISF-3-INTERNAL: Internal error, Packet enqueue failed -Process= "IPv6 ND", ipl= 0, pid= 507
-Traceback= 1#fa1ad56d9020b68f492e11094ffe9cc0  :AAB267B000+4A30FF0 :AAB267B000+4A3015C :AAB267B000+4A3050C :AAB267B000+3A7AC30 :AAB267B000+3A7EFAC :AAB267B000+3A4F88C :AAB267B000+3A77334 :AAB267B000+5821EC8 :AAB267B000+5824844 :AAB267B000+5824938 :AAB267B000+58148A0

Exception to IOS Thread:
Frame pointer 0xFF99D93420, PC = 0xAAB7E9C758

UNIX-EXT-SIGNAL: Segmentation fault(11), Process = IPv6 ND
-Traceback= 1#fa1ad56d9020b68f492e11094ffe9cc0  iosd_ngwc_unix:FFE700B000+39D60  :AAB267B000+582175A :AAB267B000+5821E30 :AAB267B000+5824844 :AAB267B000+5824938 :AAB267B000+58148A0 :AAB267B000+5827B58 :AAB267B000+58332F0 :AAB267B000+583680C

Fastpath Thread backtrace:
-Traceback= 1#fa1ad56d9020b68f492e11094ffe9cc0  c:FFE6E2B000+10B40A iosd_ngwc_unix:FFE700B000+2B48C prelib:FFEEF2A000+31D0 pthread:FFE69D9000+A540

Auxiliary Thread backtrace:
-Traceback= 1#fa1ad56d9020b68f492e11094ffe9cc0  pthread:FFE69D9000+1280A iosd_ngwc_unix:FFE700B000+3F4F4 prelib:FFEEF2A000+31D0 pthread:FFE69D9000+A540

$0 : 0x00000000, AT : 0x00000001, v0 : 0x00000000, v1 : 0x00000000
a0 : 0x00000000, a1 : 0x0000000B, a2 : 0x00000068, a3 : 0x0029B4A9
t0 : 0xFF90214D18, t1 : 0x00000000, t2 : 0x00000333, t3 : 0x00000010
t4 : 0x00000010, t5 : 0x000002CC, t6 : 0x00000000, t7 : 0x00000020
s0 : 0xFF96415410, s1 : 0xFF96415FB0, s2 : 0x00000001, s3 : 0x00000068
s4 : 0x00000001, s5 : 0xAAB7EAB000, s6 : 0xFF96415FC0, s7 : 0xFF96415F98
t8 : 0x00000030, t9 : 0xAAB64F7198, k0 : 0x00000F1A, k1 : 0x00000000
gp : 0xAABE9E05A8, sp : 0xFF99D93420, s8 : 0xFF99D93420, ra : 0xAAB7E9C74C
EPC : 0xAAB7E9C758,  SREG : 0x00000000 Cause : 0xFFFFFFFF
Error EPC : 0x00000000, BADVADDR = 0x00000000
^M
^M
========= Start of Crashinfo Collection (11:56:10 PDT Fri Apr 13 2018) =========^M
^M
For image:^M
Cisco IOS Software [Everest], Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M), Version 16.6.3, RELEASE SOFTWARE (fc8)^M
6 Replies 6

Reza Sharifi
Hall of Fame
Hall of Fame

It seems like a known bug with an associated bug id.

https://bst.cloudapps.cisco.com/bugsearch/bug/CSCux92470/?rfs=iqvred

HTH

Two crashes today, different machines.

*CRASH 1 - WS-C3650-8X24UQ-S*
May 14 22:08:31.075: %SISF-3-INTERNAL: Internal error, Packet enqueue failed -Process= "IPv6 ND", ipl= 0, pid= 508
-Traceback= 1#fa1ad56d9020b68f492e11094ffe9cc0 :AAB0936000+4A30FF0 :AAB0936000+4A3015C :AAB0936000+4A3050C :AAB0936000+3A7AC30 :AAB0936000+3A7EFAC :AAB0936000+3A4F88C :AAB0936000+3A77334 :AAB0936000+5821EC8 :AAB0936000+5824844 :AAB0936000+5824938 :AAB0936000+58148A0

Exception to IOS Thread:
Frame pointer 0xFF9CB4E420, PC = 0xAAB6157758

UNIX-EXT-SIGNAL: Segmentation fault(11), Process = IPv6 ND
-Traceback= 1#fa1ad56d9020b68f492e11094ffe9cc0 iosd_ngwc_unix:FFE99F7000+39D60 :AAB0936000+582175A :AAB0936000+5821E30 :AAB0936000+5824844 :AAB0936000+5824938 :AAB0936000+58148A0 :AAB0936000+5827B58 :AAB0936000+58332F0 :AAB0936000+583680C

Fastpath Thread backtrace:
-Traceback= 1#fa1ad56d9020b68f492e11094ffe9cc0 c:FFE9817000+10B40A iosd_ngwc_unix:FFE99F7000+2B48C prelib:FFF1916000+31D0 pthread:FFE93C5000+A540

Auxiliary Thread backtrace:
-Traceback= 1#fa1ad56d9020b68f492e11094ffe9cc0 pthread:FFE93C5000+1280A iosd_ngwc_unix:FFE99F7000+3F4F4 prelib:FFF1916000+31D0 pthread:FFE93C5000+A540

$0 : 0x00000000, AT : 0x00000001, v0 : 0x00000000, v1 : 0x00000000
a0 : 0x00000000, a1 : 0x0000000B, a2 : 0x00000068, a3 : 0x00C53E97
t0 : 0xFF92C00E00, t1 : 0x00000000, t2 : 0x00000333, t3 : 0x00000010
t4 : 0x00000010, t5 : 0x000002CC, t6 : 0x00000000, t7 : 0x00000020
s0 : 0xFF98EB6D10, s1 : 0xFF98EB78B0, s2 : 0x00000001, s3 : 0x00000068
s4 : 0x00000001, s5 : 0xAAB6166000, s6 : 0xFF98EB78C0, s7 : 0xFF98EB7898
t8 : 0x00000030, t9 : 0xAAB47B2198, k0 : 0x00000000, k1 : 0x00000000
gp : 0xAABCC9B5A8, sp : 0xFF9CB4E420, s8 : 0xFF9CB4E420, ra : 0xAAB615774C
EPC : 0xAAB6157758, SREG : 0x00000000 Cause : 0xFFFFFFFF
Error EPC : 0x00000000, BADVADDR = 0x00000000


========= Start of Crashinfo Collection (15:08:31 PDT Mon May 14 2018) =========

For image:
Cisco IOS Software [Everest], Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M), Version 16.6.3, RELEASE SOFTWARE (fc8)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2018 by Cisco Systems, Inc.
Compiled Wed 28-Feb-18 21:49 by mcpre


Uptime = 4w3d



========= Exception Tracebacks =================================================

Exception to IOS:
Frame pointer 0xFF9CB4E420, PC = 0xAAB6157758
IOS Thread backtrace:
UNIX-EXT-SIGNAL: Segmentation fault(11), Process = IPv6 ND
-Traceback= 1#fa1ad56d9020b68f492e11094ffe9cc0 iosd_ngwc_unix:FFE99F7000+39D60 :AAB0936000+582175A :AAB0936000+5821E30 :AAB0936000+5824844 :AAB0936000+5824938 :AAB0936000+58148A0 :AAB0936000+5827B58 :AAB0936000+58332F0 :AAB0936000+583680C
Fastpath Thread backtrace:
-Traceback= 1#fa1ad56d9020b68f492e11094ffe9cc0 c:FFE9817000+10B40A iosd_ngwc_unix:FFE99F7000+2B48C prelib:FFF1916000+31D0 pthread:FFE93C5000+A540
Auxiliary Thread backtrace:
-Traceback= 1#fa1ad56d9020b68f492e11094ffe9cc0 pthread:FFE93C5000+1280A iosd_ngwc_unix:FFE99F7000+3F4F4 prelib:FFF1916000+31D0 pthread:FFE93C5000+A540




*CRASH 2 -WS-C3650-8X24UQ-S *
May 14 21:59:17.712: %SISF-3-INTERNAL: Internal error, Packet enqueue failed -Process= "IPv6 ND", ipl= 0, pid= 508
-Traceback= 1#fa1ad56d9020b68f492e11094ffe9cc0 :AAB5CD1000+4A30FF0 :AAB5CD1000+4A3015C :AAB5CD1000+4A3050C :AAB5CD1000+3A7AC30 :AAB5CD1000+3A7EFAC :AAB5CD1000+3A4F88C :AAB5CD1000+3A77334 :AAB5CD1000+5821EC8 :AAB5CD1000+5824844 :AAB5CD1000+5824938 :AAB5CD1000+58148A0

Exception to IOS Thread:
Frame pointer 0xFF9483E420, PC = 0xAABB4F2758

UNIX-EXT-SIGNAL: Segmentation fault(11), Process = IPv6 ND
-Traceback= 1#fa1ad56d9020b68f492e11094ffe9cc0 iosd_ngwc_unix:FFE1AA6000+39D60 :AAB5CD1000+582175A :AAB5CD1000+5821E30 :AAB5CD1000+5824844 :AAB5CD1000+5824938 :AAB5CD1000+58148A0 :AAB5CD1000+5827B58 :AAB5CD1000+58332F0 :AAB5CD1000+583680C

Fastpath Thread backtrace:
-Traceback= 1#fa1ad56d9020b68f492e11094ffe9cc0 c:FFE18C6000+10B40A iosd_ngwc_unix:FFE1AA6000+2B48C prelib:FFE99C5000+31D0 pthread:FFE1474000+A540

Auxiliary Thread backtrace:
-Traceback= 1#fa1ad56d9020b68f492e11094ffe9cc0 pthread:FFE1474000+1280A iosd_ngwc_unix:FFE1AA6000+3F4F4 prelib:FFE99C5000+31D0 pthread:FFE1474000+A540

$0 : 0x00000000, AT : 0x00000001, v0 : 0x00000000, v1 : 0x00000000
a0 : 0x00000000, a1 : 0x0000000B, a2 : 0x00000068, a3 : 0x07A61BBD
t0 : 0xFF8ACAFCC0, t1 : 0x00000000, t2 : 0x00000333, t3 : 0x00000010
t4 : 0x00000010, t5 : 0x000002CC, t6 : 0x00000000, t7 : 0x00000020
s0 : 0xFF90F93520, s1 : 0xFF90F940C0, s2 : 0x00000001, s3 : 0x00000068
s4 : 0x00000001, s5 : 0xAABB501000, s6 : 0xFF90F940D0, s7 : 0xFF90F940A8
t8 : 0x00000030, t9 : 0xAAB9B4D198, k0 : 0x00000EF4, k1 : 0x00000000
gp : 0xAAC20365A8, sp : 0xFF9483E420, s8 : 0xFF9483E420, ra : 0xAABB4F274C
EPC : 0xAABB4F2758, SREG : 0x00000000 Cause : 0xFFFFFFFF
Error EPC : 0x00000000, BADVADDR = 0x00000000


========= Start of Crashinfo Collection (14:59:17 PDT Mon May 14 2018) =========

For image:
Cisco IOS Software [Everest], Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M), Version 16.6.3, RELEASE SOFTWARE (fc8)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2018 by Cisco Systems, Inc.
Compiled Wed 28-Feb-18 21:49 by mcpre


Uptime = 4w3d



========= Exception Tracebacks =================================================

Exception to IOS:
Frame pointer 0xFF9483E420, PC = 0xAABB4F2758
IOS Thread backtrace:
UNIX-EXT-SIGNAL: Segmentation fault(11), Process = IPv6 ND
-Traceback= 1#fa1ad56d9020b68f492e11094ffe9cc0 iosd_ngwc_unix:FFE1AA6000+39D60 :AAB5CD1000+582175A :AAB5CD1000+5821E30 :AAB5CD1000+5824844 :AAB5CD1000+5824938 :AAB5CD1000+58148A0 :AAB5CD1000+5827B58 :AAB5CD1000+58332F0 :AAB5CD1000+583680C
Fastpath Thread backtrace:
-Traceback= 1#fa1ad56d9020b68f492e11094ffe9cc0 c:FFE18C6000+10B40A iosd_ngwc_unix:FFE1AA6000+2B48C prelib:FFE99C5000+31D0 pthread:FFE1474000+A540
Auxiliary Thread backtrace:
-Traceback= 1#fa1ad56d9020b68f492e11094ffe9cc0 pthread:FFE1474000+1280A iosd_ngwc_unix:FFE1AA6000+3F4F4 prelib:FFE99C5000+31D0 pthread:FFE1474000+A540




That bug is for the IOS XR and not the IOS XE platform -- would it still be applicable?

Rudy R.
Level 1
Level 1

Same bug exists in FUJI.  :(  had two switches crash today.

Looks like it is fixed in 16.6.4 which came out a few days ago.  Maybe give that a try?

Getting Started

Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community:

Innovations in Cisco Full Stack Observability - A new webinar from Cisco