cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
858
Views
0
Helpful
4
Replies

Ask for help CRASH_INFO : Crashed pid = 561476 (pkg/bin/icpe_satmgr)

Yang Li
Level 1
Level 1

below log was generate in every 5 min.

sh logging last 500
Tue Dec 6 03:09:05.268 
Syslog logging: enabled (0 messages dropped, 0 flushes, 0 overruns)
Console logging: level warnings, 398038 messages logged
Monitor logging: level debugging, 0 messages logged
Trap logging: level informational, 638893 messages logged
Logging to 172.29.8.6, 638893 message lines logged
Buffer logging: level debugging, 643707 messages logged

Log Buffer (2097152 bytes):

RP/0/RSP0/CPU0:Dec 6 01:38:56.558 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /disk0/iosxr-infra-5.3.4/0x100305/lib/libbag.dll 0x0cbf1000 0x0000c000 0x0cbfd000 0x00001000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.559 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /asr9k-os-5.3.4.CSCvf24118-1.0.0/0x100305/lib/libcshm.dll 0x0cc00000 0x00004000 0x0cc04000 0x00001000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.559 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /disk0/iosxr-infra-5.3.4/0x100305/lib/liblrdinv.dll 0x0cd5b000 0x00008000 0x0cd63000 0x00001000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.560 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /disk0/iosxr-infra-5.3.4/0x100305/lib/libnrsutils.dll 0x0cde7000 0x00005000 0x0cdec000 0x00001000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.560 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /disk0/asr9k-base-5.3.4/0x100305/lib/liblrdplatinv.dll 0x0cdf8000 0x00007000 0x0cdff000 0x00001000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.560 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /disk0/iosxr-infra-5.3.4/0x100305/lib/libnrs.dll 0x0ce6d000 0x00009000 0x0ce76000 0x00001000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.561 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /asr9k-os-5.3.4.CSCvf24118-1.0.0/0x100305/lib/lib_rrwlock.dll 0x0ce77000 0x00004000 0x0ce7b000 0x00001000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.561 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /disk0/iosxr-fwding-5.3.4/0x100305/lib/libifmgr.dll 0x0d211000 0x0004c000 0x0d25d000 0x00003000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.562 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /disk0/iosxr-fwding-5.3.4/0x100305/lib/libim_util.dll 0x0d288000 0x0002c000 0x0d2b4000 0x00008000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.562 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /disk0/iosxr-infra-5.3.4/0x100305/lib/libasync.dll 0x0d2f2000 0x0000d000 0x0d2ff000 0x00001000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.563 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /disk0/iosxr-infra-5.3.4/0x100305/lib/libcbp.dll 0x0d31a000 0x00008000 0x0d322000 0x00001000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.563 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /asr9k-os-5.3.4.CSCvf24118-1.0.0/0x100305/lib/libprotect_server.dll 0x0d364000 0x0000a000 0x0d36e000 0x00001000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.563 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /disk0/iosxr-infra-5.3.4/0x100305/lib/librpc.dll 0x0d36f000 0x00008000 0x0d377000 0x00001000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.564 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /disk0/iosxr-infra-5.3.4/0x100305/lib/libgsched_v2.dll 0x0d378000 0x00008000 0x0d380000 0x00001000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.564 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /disk0/iosxr-infra-5.3.4/0x100305/lib/libsysdbbackend.dll 0x0d5a8000 0x00005000 0x0d5ad000 0x00001000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.565 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /disk0/iosxr-infra-5.3.4/0x100305/lib/libbackend_sysdb.dll 0x0e49c000 0x00006000 0x0e4a2000 0x00001000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.565 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /disk0/iosxr-infra-5.3.4/0x100305/lib/libbackend_parser.dll 0x0e4a3000 0x00004000 0x0e4a7000 0x00001000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.566 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /disk0/iosxr-fwding-5.3.4/0x100305/lib/libim_svr.dll 0x0e4e8000 0x00095000 0x0e57d000 0x00017000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.566 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /asr9k-os-5.3.4.CSCvf24118-1.0.0/0x100305/lib/libplatform_pfi_im.dll 0x0e5b2000 0x00001000 0x0e5b3000 0x00001000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.567 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /disk0/iosxr-infra-5.3.4/0x100305/lib/libimdr.dll 0x0e638000 0x00009000 0x0e641000 0x00001000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.567 : dumper[60]: %OS-DUMPER-6-REMOVE_OLDEST : Removing dump dumper_harddisk:/dumper/mibd_entity_332.20220918-124605.node0_RSP0_CPU0.x86.Z as we can have only limited number of cores in fallback path
RP/0/RSP0/CPU0:Dec 6 01:38:56.567 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /disk0/iosxr-fwding-5.3.4/0x100305/lib/libpfi_util.dll 0x0e6b2000 0x00003000 0x0e6b5000 0x00001000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.568 : dumper[60]: %OS-DUMPER-7-DLL_INFO : /disk0/iosxr-infra-5.3.4/0x100305/lib/libdcl.dll 0x0e9a4000 0x0000b000 0x0e9af000 0x00001000 0
RP/0/RSP0/CPU0:Dec 6 01:38:56.574 : dumper[60]: %OS-DUMPER-6-FALLBACK_CHOICE : Fall back choice: 4(dumper_harddisk:/dumper) in use
RP/0/RSP0/CPU0:Dec 6 01:38:56.575 : dumper[60]: %OS-DUMPER-5-CORE_FILE_NAME : Core for process pkg/bin/ifmgr at harddisk:/dumper/ifmgr_249.20221206-013856.node0_RSP0_CPU0.x86.Z on local_node
RP/0/RSP0/CPU0:Dec 6 01:39:07.607 : dumper[60]: %OS-DUMPER-7-XFER_CORE : Tranferring core to configured location
RP/0/RSP0/CPU0:Dec 6 01:39:07.607 : dumper[60]: %OS-DUMPER-7-SIGNAL_OS : All files copied. Now signalling the OS (line 4072)
RP/0/RSP0/CPU0:Dec 6 01:39:07.607 : dumper[60]: %OS-DUMPER-5-DUMP_SUCCESS : Core dump success
RP/0/RSP0/CPU0:Dec 6 01:39:07.627 : BM-DISTRIB[1182]: %L2-BM-6-REPL_RETRY : Replication failed for member Te0/0/0/16 (0x000004c0) of bundle Bundle-Ether3. Operation will be retried. Check "show bundle status" for more details.
RP/0/RSP0/CPU0:Dec 6 01:39:07.627 : BM-DISTRIB[1182]: %L2-BM-6-REPL_RETRY : Replication failed for member Te0/0/0/15 (0x00000480) of bundle Bundle-Ether3. Operation will be retried. Check "show bundle status" for more details.
RP/0/RSP0/CPU0:Dec 6 01:39:07.627 : BM-DISTRIB[1182]: %L2-BM-6-REPL_RETRY : Replication failed for member Te0/0/0/14 (0x00000440) of bundle Bundle-Ether3. Operation will be retried. Check "show bundle status" for more details.
RP/0/RSP0/CPU0:Dec 6 01:39:07.627 : BM-DISTRIB[1182]: %L2-BM-6-REPL_RETRY : Replication failed for member Te0/0/0/2 (0x00000140) of bundle Bundle-Ether3. Operation will be retried. Check "show bundle status" for more details.
RP/0/RSP0/CPU0:Dec 6 01:39:07.637 : aib[112]: vkg_pmlib_aib_pfi_ifh_connect imc server bind failed reason 'ifmgr' detected the 'warning' condition 'Failed to contact the server'
RP/0/RSP0/CPU0:Dec 6 01:39:07.637 : dumper[60]: %OS-DUMPER-7-DUMP_REQUEST : Dump request for process pkg/bin/icpe_satmgr
RP/0/RSP0/CPU0:Dec 6 01:39:07.643 : dumper[60]: %OS-DUMPER-7-DUMP_ATTRIBUTE : Dump request with attribute 7 for process pkg/bin/icpe_satmgr
RP/0/RSP0/CPU0:Dec 6 01:39:07.644 : dumper[60]: %OS-DUMPER-4-SIGSEGV : Thread 1 received SIGSEGV - Segmentation Fault
RP/0/RSP0/CPU0:Dec 6 01:39:07.644 : dumper[60]: %OS-DUMPER-4-SIGSEGV_INFO : Accessed BadAddr 0x1 at PC 0x107a16d2. Signal code 1 - SEGV_MAPPER. Address not mapped.
RP/0/RSP0/CPU0:Dec 6 01:39:07.644 : dumper[60]: %OS-DUMPER-4-CRASH_INFO : Crashed pid = 561476 (pkg/bin/icpe_satmgr)
RP/0/RSP0/CPU0:Dec 6 01:39:07.645 : dumper[60]: %OS-DUMPER-7-PROC_PAGES : Process memory pages 1208
RP/0/RSP0/CPU0:Dec 6 01:39:07.648 : dumper[60]: %OS-DUMPER-6-FALLBACK_CHOICE : Fall back choice: 0(harddisk:/dumper) in use
RP/0/RSP0/CPU0:Dec 6 01:39:07.648 : dumper[60]: %OS-DUMPER-6-REGISTERS_INFO : EDI ESI EBP(fp) EXX
RP/0/RSP0/CPU0:Dec 6 01:39:07.648 : dumper[60]: %OS-DUMPER-6-REGISTERS_INFO : R0 00000000 107d2874 041fb808 fca7ccd0
RP/0/RSP0/CPU0:Dec 6 01:39:07.648 : dumper[60]: %OS-DUMPER-6-REGISTERS_INFO : EBX EDX ECX EAX
RP/0/RSP0/CPU0:Dec 6 01:39:07.648 : dumper[60]: %OS-DUMPER-6-REGISTERS_INFO : R4 107d2a00 1124cd58 00000000 00000001
RP/0/RSP0/CPU0:Dec 6 01:39:07.648 : dumper[60]: %OS-DUMPER-6-REGISTERS_INFO : EIP(pc) CS EFL ESP
RP/0/RSP0/CPU0:Dec 6 01:39:07.648 : dumper[60]: %OS-DUMPER-6-REGISTERS_INFO : R8 107a16d2 000000f3 00001246 041fb808
RP/0/RSP0/CPU0:Dec 6 01:39:07.648 : dumper[60]: %OS-DUMPER-6-REGISTERS_INFO : SS
RP/0/RSP0/CPU0:Dec 6 01:39:07.648 : dumper[60]: %OS-DUMPER-6-REGISTERS_INFO : R12 000000fb
RP/0/RSP0/CPU0:Dec 6 01:39:07.649 : dumper[60]: %OS-DUMPER-6-TRACE_BACK : #0 0x107a16d2
RP/0/RSP0/CPU0:Dec 6 01:39:07.716 : dumper[60]: %OS-DUMPER-6-TRACE_BACK : #1 0x1079ef98
RP/0/RSP0/CPU0:Dec 6 01:39:07.716 : dumper[60]: %OS-DUMPER-6-TRACE_BACK : #2 0xd22a7e2
RP/0/RSP0/CPU0:Dec 6 01:39:07.716 : dumper[60]: %OS-DUMPER-6-TRACE_BACK : #3 0xd22a8d2
RP/0/RSP0/CPU0:Dec 6 01:39:07.716 : dumper[60]: %OS-DUMPER-6-TRACE_BACK : #4 0xd21caa7
RP/0/RSP0/CPU0:Dec 6 01:39:07.716 : dumper[60]: %OS-DUMPER-6-TRACE_BACK : #5 0xd21cb18
RP/0/RSP0/CPU0:Dec 6 01:39:07.716 : dumper[60]: %OS-DUMPER-6-TRACE_BACK : #6 0xd21e25a
RP/0/RSP0/CPU0:Dec 6 01:39:07.716 : dumper[60]: %OS-DUMPER-6-TRACE_BACK : #7 0x1079b55e
RP/0/RSP0/CPU0:Dec 6 01:39:07.716 : dumper[60]: %OS-DUMPER-6-TRACE_BACK : #8 0xba93a60
RP/0/RSP0/CPU0:Dec 6 01:39:07.716 : dumper[60]: %OS-DUMPER-6-TRACE_BACK : #9 0xba94204
RP/0/RSP0/CPU0:Dec 6 01:39:07.716 : dumper[60]: %OS-DUMPER-6-TRACE_BACK : #10 0xba947a3
RP/0/RSP0/CPU0:Dec 6 01:39:07.716 : dumper[60]: %OS-DUMPER-6-TRACE_BACK : #11 0xba8ee7c
RP/0/RSP0/CPU0:Dec 6 01:39:07.716 : dumper[60]: %OS-DUMPER-6-TRACE_BACK : #12 0xba906d5
RP/0/RSP0/CPU0:Dec 6 01:39:07.716 : dumper[60]: %OS-DUMPER-6-TRACE_BACK : #13 0xba8e7a8
RP/0/RSP0/CPU0:Dec 6 01:39:07.718 : dumper[60]: %OS-DUMPER-6-INSTALL_PKG : iosxr-gcp-fwding-5.3.4.CSCvd76488 V 1.0.0[SMU] Cisco Systems By iox-lnx-007 in /san1/EFR/smu_r53x_5_3_4/workspace for pie at /install/iosxr-gcp-fwding-5.3.4.CSCvd76488-1.0.0 Built on Thu Mar 30 04:54:08 YGN 2017
RP/0/RSP0/CPU0:Dec 6 01:39:07.718 : dumper[60]: %OS-DUMPER-6-INSTALL_PKG : iosxr-gcp-fwding-5.3.4.CSCvb62919 V 1.0.0[SMU] Cisco Systems By iox-lnx-007 in /san1/EFR/smu_r53x_5_3_4/workspace for pie at /install/iosxr-gcp-fwding-5.3.4.CSCvb62919-1.0.0 Built on Sat Dec 17 18:07:37 YGN 2016
RP/0/RSP0/CPU0:Dec 6 01:39:07.718 : dumper[60]: %OS-DUMPER-6-INSTALL_PKG : iosxr-gcp-fwding-5.3.4.CSCvb72705 V 1.0.0[SMU] Cisco Systems By iox-lnx-007 in /san1/EFR/smu_r53x_5_3_4/workspace for pie at /install/iosxr-gcp-fwding-5.3.4.CSCvb72705-1.0.0 Built on Thu Dec 1 05:54:24 YGN 2016
RP/0/RSP0/CPU0:Dec 6 01:39:07.718 : dumper[60]: %OS-DUMPER-6-INSTALL_PKG : iosxr-gcp-fwding V 5.3.4[Default] Cisco Systems By iox-lnx-005 in /auto/srcarchive15/production/5.3.4/asr9k-px/workspace for pie at /install/iosxr-gcp-fwding-5.3.4 Built on Tue Oct 4 16:37:38 YGN 2016
RP/0/RSP0/CPU0:Dec 6 01:39:07.718 : dumper[60]: %OS-DUMPER-6-INSTALL_PKG : iosxr-common-pd-fib-5.3.4.CSCvb57301 V 1.0.0[SMU] Cisco Systems By iox-lnx-007 in /san1/EFR/smu_r53x_5_3_4/workspace for pie at /install/iosxr-common-pd-fib-5.3.4.CSCvb57301-1.0.0 Built on Wed Jul 12 18:15:58 YGN 2017
RP/0/RSP0/CPU0:Dec 6 01:39:07.718 : dumper[60]: %OS-DUMPER-6-INSTALL_PKG : iosxr-common-pd-fib-5.3.4.CSCvd76488 V 1.0.0[SMU] Cisco Systems By iox-lnx-007 in

.ılı..ılı.
Cisco System
Pyhton
U got a dream, U gotta protect it
4 Replies 4

Yang Li
Level 1
Level 1

it is ASR 9010 RP440SE

.ılı..ılı.
Cisco System
Pyhton
U got a dream, U gotta protect it

I would need to know more data like the show installed active summary to decode the crash, and also a complete crash log, it looks like in the above I have parts of 2 different crashes. I would suggest opening a TAC case if possible.

As an aside 5.3.4 is rather old and no longer supported, the last release for RSP440 is 6.4.2.

 

Sam

 

thank you info but   this device our BNG device, which cannot be upgraded at present. I will grab more logs to let you know 

.ılı..ılı.
Cisco System
Pyhton
U got a dream, U gotta protect it

Yang Li
Level 1
Level 1

thank you info but   this device our BNG device, which cannot be upgraded at present. I will grab more logs to let you know

.ılı..ılı.
Cisco System
Pyhton
U got a dream, U gotta protect it