ASR 9k module crash

[Vivek]

Hi Experts.

I have faced issue with module 3 before some days, below logs is generated on device and its looks like software but unable to isolate issue because kernal dump file is corrupt.. Need your help to find  RCA.

LC/0/1/CPU0:Apr 7 23:20:54.827 JST: ifmgr[200]: %PKT_INFRA-LINK-3-UPDOWN : Interface TenGigE0/1/0/2, changed state to Down
LC/0/1/CPU0:Apr 7 23:20:54.828 JST: ifmgr[200]: %PKT_INFRA-LINEPROTO-5-UPDOWN : Line protocol on Interface TenGigE0/1/0/2, changed state to Down
RP/1/RSP0/CPU0:Apr 7 23:20:54.925 JST: shelfmgr[387]: %PLATFORM-SHELFMGR-6-NODE_KERNEL_DUMP_EVENT : Node 1/1/CPU0 indicates it is doing a kernel dump.
RP/1/RSP0/CPU0:Apr 7 23:20:54.925 JST: shelfmgr[387]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 1/1/CPU0 A9K-MOD80-TR state:IOS XR FAILURE
RP/1/RSP0/CPU0:Apr 7 23:20:54.935 JST: shelfmgr[387]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 1/1/CPU0 A9K-MOD80-TR state:BRINGDOWN
RP/0/RSP0/CPU0:Apr 7 23:20:54.948 JST: BM-DISTRIB[1136]: %L2-BM-6-ACTIVE : UNKNOWN intf 0x46000280 is no longer Active as part of Bundle-Ether2 (Link is being removed from the bundle)
RP/0/RSP0/CPU0:Apr 7 23:20:54.948 JST: BM-DISTRIB[1136]: %L2-BM-6-ACTIVE : UNKNOWN intf 0x460001c0 is no longer Active as part of Bundle-Ether11 (Link is being removed from the bundle)
RP/0/RSP0/CPU0:Apr 7 23:20:54.948 JST: BM-DISTRIB[1136]: %L2-BM-6-ACTIVE : UNKNOWN intf 0x46000180 is no longer Active as part of Bundle-Ether4 (Link is being removed from the bundle)
RP/0/RSP0/CPU0:Apr 7 23:20:54.948 JST: BM-DISTRIB[1136]: %L2-BM-6-ACTIVE : UNKNOWN intf 0x460000c0 is no longer Active as part of Bundle-Ether12 (Link is being removed from the bundle)
RP/0/RSP0/CPU0:Apr 7 23:20:54.950 JST: mibd_entity[324]: %HA-HA_EM-7-FMFD_CONNECTION_FAIL : Could not connect to /dev/fm/fd_wdsysmon.d/node1_1_CPU0 : No such file or directory
RP/0/RSP0/CPU0:Apr 7 23:20:55.952 JST: mibd_entity[324]: %HA-HA_EM-7-FMFD_CONNECTION_FAIL : Could not connect to /dev/fm/fd_wdsysmon.d/node1_1_CPU0 : No such file or directory
RP/1/RSP0/CPU0:Apr 7 23:20:57.947 JST: invmgr[257]: %PLATFORM-INV-6-OIROUT : OIR: Node 1/1/0 removed
RP/0/RSP0/CPU0:Apr 7 23:20:57.953 JST: mibd_entity[324]: %HA-HA_EM-7-FMFD_CONNECTION_FAIL : Could not connect to /dev/fm/fd_wdsysmon.d/node1_1_CPU0 : No such file or directory
RP/1/RSP0/CPU0:Apr 7 23:20:57.953 JST: invmgr[257]: %PLATFORM-INV-6-OIROUT : OIR: Node 1/1/1 removed
RP/1/RSP0/CPU0:Apr 7 23:20:57.962 JST: invmgr[257]: %PLATFORM-INV-6-NODE_STATE_CHANGE : Node: 1/1/CPU0, state: BRINGDOWN
RP/0/RSP0/CPU0:Apr 7 23:20:59.944 JST: tftp_server[422]: %IP-CE_TFTP-6-KERNEL_DUMP_MSG : Started writing to filename: /harddisk:/dumper/LC1.190407-142053.kernel_core.by.kernel.Z
RP/0/RSP0/CPU0:Apr 7 23:21:01.955 JST: mibd_entity[324]: %HA-HA_EM-7-FMFD_CONNECTION_FAIL : Could not connect to /dev/fm/fd_wdsysmon.d/node1_1_CPU0 : No such file or directory
LC/0/1/CPU0:Apr 7 23:21:07.718 JST: pfm_node_lc[285]: %PLATFORM-XFP-2-LOW_RX_POWER_ALARM : Set|envmon_lc[168024]|XFP(0x102a002)|Port_0/02
RP/0/RSP0/CPU0:Apr 7 23:21:48.285 JST: tftp_server[422]: %IP-CE_TFTP-6-KERNEL_DUMP_MSG : Finished writing to filename: /harddisk:/dumper/LC1.190407-142053.kernel_core.by.kernel.Z
RP/1/RSP1/CPU0:Apr 7 23:21:52.497 JST: canb-server[149]: %PLATFORM-CANB_SERVER-7-CBC_PRE_RESET_NOTIFICATION : Node 1/1/CPU0 , Power Cycle (0x05000000)
RP/1/RSP0/CPU0:Apr 7 23:21:52.500 JST: canb-server[149]: %PLATFORM-CANB_SERVER-7-CBC_PRE_RESET_NOTIFICATION : Node 1/1/CPU0 , Power Cycle (0x05000000)
RP/1/RSP0/CPU0:Apr 7 23:21:52.592 JST: ce_switch_srv[53]: %PLATFORM-CE_SWITCH-6-UPDN : Interface 5 (LC_Slot_1) is down
RP/1/RSP1/CPU0:Apr 7 23:21:52.736 JST: ce_switch_srv[53]: %PLATFORM-CE_SWITCH-6-UPDN : Interface 5 (LC_Slot_1) is down
RP/1/RSP1/CPU0:Apr 7 23:21:59.072 JST: canb-server[149]: %PLATFORM-CANB_SERVER-7-CBC_POST_RESET_NOTIFICATION : Node 1/1/CPU0 , Power Cycle (0x05000000)
RP/1/RSP0/CPU0:Apr 7 23:21:59.075 JST: canb-server[149]: %PLATFORM-CANB_SERVER-7-CBC_POST_RESET_NOTIFICATION : Node 1/1/CPU0 , Power Cycle (0x05000000)
RP/1/RSP0/CPU0:Apr 7 23:21:59.076 JST: shelfmgr[387]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 1/1/CPU0 A9K-MOD80-TR state:ROMMON
RP/1/RSP0/CPU0:Apr 7 23:22:35.356 JST: ce_switch_srv[53]: %PLATFORM-CE_SWITCH-6-UPDN : Interface 5 (LC_Slot_1) is up
RP/1/RSP0/CPU0:Apr 7 23:22:36.051 JST: shelfmgr[387]: %PLATFORM-SHELFMGR_HAL-6-BOOT_REQ_RECEIVED : Boot Request from 0/1/CPU0, RomMon Version: 2.0
RP/1/RSP0/CPU0:Apr 7 23:22:36.051 JST: shelfmgr[387]: %PLATFORM-MBIMGR-7-IMAGE_VALIDATED : Remote location 1/1/CPU0: : MBI tftp:/disk0/asr9k-os-mbi-4.3.4/lc/mbiasr9k-lc.vm validated
RP/1/RSP0/CPU0:Apr 7 23:22:36.053 JST: shelfmgr[387]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 1/1/CPU0 A9K-MOD80-TR state:MBI-BOOTING
RP/1/RSP0/CPU0:Apr 7 23:24:07.695 JST: ce_switch_srv[53]: %PLATFORM-CE_SWITCH-6-UPDN : Interface 5 (LC_Slot_1) is down
RP/1/RSP0/CPU0:Apr 7 23:24:10.564 JST: ce_switch_srv[53]: %PLATFORM-CE_SWITCH-6-UPDN : Interface 5 (LC_Slot_1) is up
RP/1/RSP1/CPU0:Apr 7 23:24:10.670 JST: ce_switch_srv[53]: %PLATFORM-CE_SWITCH-6-UPDN : Interface 5 (LC_Slot_1) is up
RP/1/RSP0/CPU0:Apr 7 23:24:11.223 JST: shelfmgr[387]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 1/1/CPU0 A9K-MOD80-TR state:MBI-RUNNING
LC/1/1/CPU0:9: init[65540]: %OS-INIT-7-MBI_STARTED : total time 4.900 seconds
LC/1/1/CPU0:Apr 7 23:24:27.879 JST: kdscrape-lc[63]: KERNEL-DUMP: Copied LC1.190407-142053.e500 to /net/node0_RSP0_CPU0/harddisk:/dumper
LC/1/1/CPU0:Apr 7 23:24:28.271 JST: kdscrape-lc[63]: KERNEL-DUMP: Copied LC1.190407-142053.crashinfo.by.kernel to /net/node0_RSP0_CPU0/harddisk:/dumper
LC/1/1/CPU0:Apr 7 23:24:29.332 JST: kdscrape-lc[63]: KERNEL-DUMP: Copied LC1.190407-142053.pcds to /net/node0_RSP0_CPU0/harddisk:/dumper
LC/1/1/CPU0:Apr 7 23:24:34.319 JST: sysmgr[91]: %OS-SYSMGR-5-NOTICE : Card is COLD started
LC/1/1/CPU0:Apr 7 23:24:34.619 JST: init[65540]: %OS-INIT-7-INSTALL_READY : total time 29.230 seconds
LC/1/1/CPU0:Apr 7 23:24:35.102 JST: sysmgr[341]: %OS-SYSMGR-6-INFO : Backup system manager is ready
RP/1/RSP0/CPU0:Apr 7 23:24:48.666 JST: shelfmgr[387]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 1/1/0 A9K-MPA-4X10GE state:UNPOWERED
RP/1/RSP0/CPU0:Apr 7 23:24:48.674 JST: shelfmgr[387]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 1/1/1 A9K-MPA-4X10GE state:UNPOWERED
LC/1/1/CPU0:Apr 7 23:24:51.163 JST: sysmgr[91]: %OS-SYSMGR-7-DEBUG : sysmgr_admin_plane_check:SYSMGR_PLANE_ADMIN Notification sent.
RP/1/RSP0/CPU0:Apr 7 23:24:53.164 JST: shelfmgr[387]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 1/1/1 A9K-MPA-4X10GE state:POWER UP
LC/1/1/CPU0:Apr 7 23:24:53.306 JST: syslog_dev[89]: hsbi_fpd_agent[198]: FPD ltrace_file_name => fpd-agent/hsbi_fpd_agent
LC/1/1/CPU0:Apr 7 23:24:54.631 JST: lda_server[65]: %L2-SPA-5-STATE_CHANGE : SPA in bay 0 type A9K-MPA-4x10GE Initing
LC/1/1/CPU0:Apr 7 23:24:54.632 JST: lda_server[65]: %L2-SPA-5-STATE_CHANGE : SPA in bay 1 type A9K-MPA-4x10GE Initing
RP/1/RSP0/CPU0:Apr 7 23:24:58.882 JST: shelfmgr[387]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 1/1/0 A9K-MPA-4X10GE state:INITIALIZED
RP/1/RSP0/CPU0:Apr 7 23:24:59.017 JST: invmgr[257]: %PLATFORM-INV-6-IF_OIRIN : xFP OIR: 1/1/0 port_num: 0 is inserted, state: 1
RP/1/RSP0/CPU0:Apr 7 23:24:59.059 JST: shelfmgr[387]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 1/1/1 A9K-MPA-4X10GE state:INITIALIZED
RP/1/RSP0/CPU0:Apr 7 23:25:00.160 JST: invmgr[257]: %PLATFORM-INV-6-IF_OIRIN : xFP OIR: 1/1/0 port_num: 2 is inserted, state: 1
RP/1/RSP0/CPU0:Apr 7 23:25:00.296 JST: invmgr[257]: %PLATFORM-INV-6-IF_OIRIN : xFP OIR: 1/1/1 port_num: 0 is inserted, state: 1
RP/1/RSP0/CPU0:Apr 7 23:25:01.431 JST: invmgr[257]: %PLATFORM-INV-6-IF_OIRIN : xFP OIR: 1/1/0 port_num: 3 is inserted, state: 1
RP/1/RSP0/CPU0:Apr 7 23:25:01.558 JST: invmgr[257]: %PLATFORM-INV-6-IF_OIRIN : xFP OIR: 1/1/1 port_num: 1 is inserted, state: 1
RP/1/RSP0/CPU0:Apr 7 23:25:02.689 JST: invmgr[257]: %PLATFORM-INV-6-IF_OIRIN : xFP OIR: 1/1/1 port_num: 2 is inserted, state: 1
RP/0/RSP0/CPU0:Apr 7 23:25:03.000 JST: statsd_manager_g[1124]: %MGBL-IFSTATS-4-COLLECTOR_TIMEOUT : A stats collector has timed out during a request: Node UNKNOWN, PID UNKNOWN
LC/1/1/CPU0:Apr 7 23:25:03.414 JST: prm_server_ty[295]: %PLATFORM-QOSHAL-6-QOS_MODE_CHANGE : Line-card QoS mode set to child-shaping-enabled.
LC/1/1/CPU0:Apr 7 23:25:03.426 JST: prm_server_ty[295]: %PLATFORM-QOSHAL-6-QOS_MODE_CHANGE : Line-card QoS mode set to lowburst-disabled.
LC/1/1/CPU0:Apr 7 23:25:03.544 JST: lda_server[65]: %PLATFORM-UPGRADE_FPD-3-CHAN_CREATE : Failed to create upgrade-fpd channel : File exists
RP/1/RSP0/CPU0:Apr 7 23:25:03.821 JST: invmgr[257]: %PLATFORM-INV-6-IF_OIRIN : xFP OIR: 1/1/1 port_num: 3 is inserted, state: 1
RP/1/RSP1/CPU0:Apr 7 23:25:04.260 JST: ce_switch_srv[53]: %PLATFORM-CE_SWITCH-6-UPDN : Interface 5 (LC_Slot_1) is down
RP/1/RSP1/CPU0:Apr 7 23:25:04.563 JST: ce_switch_srv[53]: %PLATFORM-CE_SWITCH-6-UPDN : Interface 5 (LC_Slot_1) is up
RP/1/RSP0/CPU0:Apr 7 23:25:15.599 JST: shelfmgr[387]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 1/1/0 A9K-MPA-4X10GE state:OK
RP/1/RSP0/CPU0:Apr 7 23:25:15.610 JST: invmgr[257]: %PLATFORM-INV-6-NODE_STATE_CHANGE : Node: 1/1/0, state: OK
RP/1/RSP0/CPU0:Apr 7 23:25:15.616 JST: invmgr[257]: %PLATFORM-INV-6-OIRIN : OIR: Node 1/1/0 inserted
RP/1/RSP0/CPU0:Apr 7 23:25:39.626 JST: shelfmgr[387]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 1/1/1 A9K-MPA-4X10GE state:OK
RP/1/RSP0/CPU0:Apr 7 23:25:39.631 JST: invmgr[257]: %PLATFORM-INV-6-NODE_STATE_CHANGE : Node: 1/1/1, state: OK
RP/1/RSP0/CPU0:Apr 7 23:25:39.637 JST: invmgr[257]: %PLATFORM-INV-6-OIRIN : OIR: Node 1/1/1 inserted
LC/1/1/CPU0:Apr 7 23:25:57.534 JST: ifmgr[200]: %PKT_INFRA-LINK-3-UPDOWN : Interface TenGigE1/1/1/3, changed state to Down
LC/1/1/CPU0:Apr 7 23:25:57.541 JST: ifmgr[200]: %PKT_INFRA-LINEPROTO-5-UPDOWN : Line protocol on Interface TenGigE1/1/1/3, changed state to Down
LC/1/1/CPU0:Apr 7 23:25:57.541 JST: ifmgr[200]: %PKT_INFRA-LINK-5-CHANGED : Interface TenGigE1/1/1/2, changed state to Administratively Down
LC/1/1/CPU0:Apr 7 23:25:57.541 JST: ifmgr[200]: %PKT_INFRA-LINK-3-UPDOWN : Interface TenGigE1/1/1/1, changed state to Down
LC/1/1/CPU0:Apr 7 23:25:57.541 JST: ifmgr[200]: %PKT_INFRA-LINEPROTO-5-UPDOWN : Line protocol on Interface TenGigE1/1/1/1, changed state to Down
LC/1/1/CPU0:Apr 7 23:25:57.541 JST: ifmgr[200]: %PKT_INFRA-LINK-3-UPDOWN : Interface TenGigE1/1/1/0, changed state to Down
LC/1/1/CPU0:Apr 7 23:25:57.541 JST: ifmgr[200]: %PKT_INFRA-LINEPROTO-5-UPDOWN : Line protocol on Interface TenGigE1/1/1/0, changed state to Down
LC/1/1/CPU0:Apr 7 23:25:57.548 JST: cfgmgr-lc[133]: %MGBL-CONFIG-6-OIR_RESTORE : Configuration for node '1/1/1' has been restored.
LC/1/1/CPU0:Apr 7 23:25:58.083 JST: ifmgr[200]: %PKT_INFRA-LINK-3-UPDOWN : Interface TenGigE1/1/0/3, changed state to Down
LC/1/1/CPU0:Apr 7 23:25:58.083 JST: ifmgr[200]: %PKT_INFRA-LINEPROTO-5-UPDOWN : Line protocol on Interface TenGigE1/1/0/3, changed state to Down
LC/1/1/CPU0:Apr 7 23:25:58.083 JST: ifmgr[200]: %PKT_INFRA-LINK-3-UPDOWN : Interface TenGigE1/1/0/2, changed state to Down
LC/1/1/CPU0:Apr 7 23:25:58.083 JST: ifmgr[200]: %PKT_INFRA-LINEPROTO-5-UPDOWN : Line protocol on Interface TenGigE1/1/0/2, changed state to Down
LC/1/1/CPU0:Apr 7 23:25:58.083 JST: ifmgr[200]: %PKT_INFRA-LINK-5-CHANGED : Interface TenGigE1/1/0/1, changed state to Administratively Down
LC/1/1/CPU0:Apr 7 23:25:58.083 JST: ifmgr[200]: %PKT_INFRA-LINK-3-UPDOWN : Interface TenGigE1/1/0/0, changed state to Down
LC/1/1/CPU0:Apr 7 23:25:58.083 JST: ifmgr[200]: %PKT_INFRA-LINEPROTO-5-UPDOWN : Line protocol on Interface TenGigE1/1/0/0, changed state to Down
LC/0/1/CPU0:Apr 7 23:25:58.142 JST: ifmgr[200]: %PKT_INFRA-LINK-3-UPDOWN : Interface TenGigE0/1/0/2, changed state to Up
LC/0/1/CPU0:Apr 7 23:25:58.143 JST: ifmgr[200]: %PKT_INFRA-LINEPROTO-5-UPDOWN : Line protocol on Interface TenGigE0/1/0/2, changed state to Up
RP/1/RSP0/CPU0:Apr 7 23:25:58.340 JST: shelfmgr[387]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 1/1/CPU0 A9K-MOD80-TR state:IOS XR RUN
RP/1/RSP0/CPU0:Apr 7 23:25:58.342 JST: invmgr[257]: %PLATFORM-INV-6-NODE_STATE_CHANGE : Node: 1/1/CPU0, state: IOS XR RUN
LC/1/1/CPU0:Apr 7 23:25:58.635 JST: ifmgr[200]: %PKT_INFRA-LINK-3-UPDOWN : Interface TenGigE1/1/1/0, changed state to Up
LC/1/1/CPU0:Apr 7 23:25:58.637 JST: ifmgr[200]: %PKT_INFRA-LINEPROTO-5-UPDOWN : Line protocol on Interface TenGigE1/1/1/0, changed state to Up
LC/1/1/CPU0:Apr 7 23:25:58.650 JST: ifmgr[200]: %PKT_INFRA-LINK-3-UPDOWN : Interface TenGigE1/1/0/0, changed state to Up
LC/1/1/CPU0:Apr 7 23:25:58.669 JST: ifmgr[200]: %PKT_INFRA-LINK-3-UPDOWN : Interface TenGigE1/1/0/2, changed state to Up
LC/1/1/CPU0:Apr 7 23:25:58.672 JST: ifmgr[200]: %PKT_INFRA-LINK-3-UPDOWN : Interface TenGigE1/1/1/3, changed state to Up
LC/1/1/CPU0:Apr 7 23:25:58.710 JST: ifmgr[200]: %PKT_INFRA-LINK-3-UPDOWN : Interface TenGigE1/1/0/3, changed state to Up
LC/1/1/CPU0:Apr 7 23:25:58.739 JST: ifmgr[200]: %PKT_INFRA-LINEPROTO-5-UPDOWN : Line protocol on Interface TenGigE1/1/0/0, changed state to Up
LC/1/1/CPU0:Apr 7 23:25:58.748 JST: ifmgr[200]: %PKT_INFRA-LINEPROTO-5-UPDOWN : Line protocol on Interface TenGigE1/1/0/2, changed state to Up
LC/1/1/CPU0:Apr 7 23:25:58.756 JST: ifmgr[200]: %PKT_INFRA-LINEPROTO-5-UPDOWN : Line protocol on Interface TenGigE1/1/1/3, changed state to Up
LC/1/1/CPU0:Apr 7 23:25:58.763 JST: ifmgr[200]: %PKT_INFRA-LINEPROTO-5-UPDOWN : Line protocol on Interface TenGigE1/1/0/3, changed state to Up
RP/0/RSP0/CPU0:Apr 7 23:26:03.183 JST: BM-DISTRIB[1136]: %L2-BM-6-ACTIVE : TenGigE1/1/1/0 is Active as part of Bundle-Ether12
LC/1/1/CPU0:Apr 7 23:26:03.496 JST: UDLD[349]: %L2-UDLD-6-PEERING : UDLD on port TenGigE1/1/0/0 is peering with neighbor(s)
LC/1/1/CPU0:Apr 7 23:26:03.497 JST: UDLD[349]: %L2-UDLD-6-PEERING : UDLD on port TenGigE1/1/0/3 is peering with neighbor(s)
LC/1/1/CPU0:Apr 7 23:26:03.497 JST: UDLD[349]: %L2-UDLD-6-PEERING : UDLD on port TenGigE1/1/1/0 is peering with neighbor(s)
LC/1/1/CPU0:Apr 7 23:26:03.497 JST: UDLD[349]: %L2-UDLD-6-PEERING : UDLD on port TenGigE1/1/1/3 is peering with neighbor(s)
RP/0/RSP0/CPU0:Apr 7 23:26:03.778 JST: BM-DISTRIB[1136]: %L2-BM-6-ACTIVE : TenGigE1/1/0/0 is Active as part of Bundle-Ether11
RP/0/RSP0/CPU0:Apr 7 23:26:04.543 JST: BM-DISTRIB[1136]: %L2-BM-6-ACTIVE : TenGigE1/1/1/3 is Active as part of Bundle-Ether4
RP/0/RSP0/CPU0:Apr 7 23:26:05.180 JST: BM-DISTRIB[1136]: %L2-BM-6-ACTIVE : TenGigE1/1/0/3 is Active as part of Bundle-Ether2
LC/1/1/CPU0:Apr 7 23:26:12.585 JST: pfm_node_lc[285]: %PLATFORM-XFP-2-LOW_RX_POWER_ALARM : Set|envmon_lc[192600]|XFP(0x102a015)|Port_1/01
LC/0/1/CPU0:Apr 7 23:26:57.216 JST: pfm_node_lc[285]: %PLATFORM-XFP-2-LOW_RX_POWER_ALARM : Clear|envmon_lc[168024]|XFP(0x102a002)|Port_0/02
RP/0/RSP0/CPU0:Apr 8 11:37:13.009 JST: SSHD_[65815]: %SECURITY-SSHD-4-INFO_FAILURE : Failed authentication attempt by user 'netxadm' from '10.0.59.223' on 'vty0'
RP/0/RSP0/CPU0:Apr 8 13:31:47.661 JST: SSHD_[65815]: %SECURITY-SSHD-4-INFO_FAILURE : Failed authentication attempt by user 'netxadm' from '10.0.59.111' on 'vty0'
RP/0/RSP0/CPU0:Apr 8 13:45:33.536 JST: SSHD_[65815]: %SECURITY-SSHD-4-INFO_FAILURE : Failed authentication attempt by user 'netxadm' from '10.0.59.111' on 'vty0'
RP/0/RSP0/CPU0:Apr 8 15:18:08.484 JST: SSHD_[65815]: %SECURITY-SSHD-4-INFO_FAILURE : Failed authentication attempt by user 'netxadm' from '10.0.59.111' on 'vty0'
RP/0/RSP0/CPU0:Apr 8 15:48:03.940 JST: SSHD_[65815]: %SECURITY-SSHD-4-INFO_FAILURE : Failed authentication attempt by user 'netxadm' from '10.0.59.111' on 'vty0'
LC/0/0/CPU0:Apr 8 15:53:48.065 JST: statsd_manager_l[332]: %MGBL-IFSTATS-3-COUNTER_OVERRUN : Counter overrun for one or more deltas for interface TenGigE0/0/0/0, stats type 2, from collector pkg/bin/vic_0, on node 0/0/CPU0. Overrun counters: OUTPUT BYTES, example overrun value: 18446744070083238079
RP/0/RSP0/CPU0:Apr 8 15:53:48.072 JST: statsd_manager_g[1124]: %MGBL-IFSTATS-3-COUNTER_OVERRUN : Counter overrun for one or more deltas for interface Bundle-Ether11, stats type 2, from collector pkg/bin/vic_0, on node 0/0/CPU0. Overrun counters: OUTPUT BYTES, example overrun value: 18446744070083238079
RP/1/RSP0/CPU0:Apr 8 15:53:48.758 JST: statsd_manager_g[1124]: %MGBL-IFSTATS-3-COUNTER_OVERRUN : Counter overrun for one or more deltas for interface Bundle-Ether11, stats type 2, from collector pkg/bin/vic_0, on node 0/0/CPU0. Overrun counters: OUTPUT BYTES, example overrun value: 18446744070083238079
RP/0/RSP0/CPU0:Apr 8 17:50:40.845 JST: SSHD_[65815]: %SECURITY-SSHD-4-INFO_FAILURE : Failed authentication attempt by user 'netxadm' from '10.0.59.111' on 'vty0'
RP/0/RSP0/CPU0:Apr 8 17:50:56.122 JST: SSHD_[65815]: %SECURITY-SSHD-6-INFO_GENERAL : Client closes socket connection
RP/0/RSP0/CPU0:Apr 8 17:50:56.122 JST: SSHD_[65815]: %SECURITY-SSHD-3-ERR_GENERAL : Failed to receive User authentication request
RP/0/RSP0/CPU0:Apr 8 19:14:12.292 JST: SSHD_[65815]: %SECURITY-SSHD-4-INFO_FAILURE : Failed authentication attempt by user 'netxadm' from '10.0.59.111' on 'vty0'
RP/0/RSP0/CPU0:Apr 8 19:16:08.461 JST: SSHD_[65819]: %SECURITY-SSHD-4-INFO_FAILURE : Failed authentication attempt by user 'netxadm' from '10.0.59.111' on 'vty1'

[Georg Pauwen]

Hello,

I looked around but couldn't really find anything useful on that log message...:(

What if you try to manually reinsert the module ? Also, what XR version are you running (release 6.5.3 MD being the recommended one) ?

[Vivek]

Module recovered automatically it self, even dump is also generated but unable to decode that file due to corrupt. 

i am also suspecting some issue software only but i don't have document to prove that. 

Thanks