cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
3351
Views
0
Helpful
1
Replies

ASR 9904 Errors - IOS XR 5.1.3

Martin Mazzoni
Level 1
Level 1

Has anyone gone knows what this error means? and how can we address it?

RP/0/RSP1/CPU0:Aug 16 08:33:07.815 : canb-server[152]: %PLATFORM-CANB_SERVER-7-CBC_PRE_RESET_NOTIFICATION : Node 0/1/CPU0 , Power Sequencer Failure (0x090000100)
RP/0/RSP0/CPU0:Aug 16 08:33:07.823 : canb-server[152]: %PLATFORM-CANB_SERVER-7-CBC_PRE_RESET_NOTIFICATION : Node 0/1/CPU0 , Power Sequencer Failure (0x090000100)
RP/0/RSP0/CPU0:Aug 16 08:33:07.823 : shelfmgr[394]: %PLATFORM-SHELFMGR-6-NODE_CPU_RESET : Node 0/1/CPU0 CPU reset detected.
RP/0/RSP0/CPU0:Aug 16 08:33:07.824 : shelfmgr[394]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 0/1/CPU0 A9K-MOD80-TR state:BRINGDOWN
RP/0/RSP0/CPU0:Aug 16 08:33:07.833 : mibd_entity[328]: %HA-HA_EM-7-FMFD_CONNECTION_FAIL : Could not connect to /dev/fm/fd_wdsysmon.d/node0_1_CPU0 : No such file or directory
RP/0/RSP0/CPU0:Aug 16 08:33:07.835 : BM-DISTRIB[1149]: %L2-BM-6-ACTIVE : UNKNOWN intf 0x060001c0 is no longer Active as part of Bundle-Ether2 (Link is being removed from the bundle)
RP/0/RSP0/CPU0:Aug 16 08:33:07.835 : BM-DISTRIB[1149]: %L2-BM-6-ACTIVE : UNKNOWN intf 0x06000180 is no longer Active as part of Bundle-Ether4 (Link is being removed from the bundle)
RP/0/RSP0/CPU0:Aug 16 08:33:07.835 : BM-DISTRIB[1149]: %L2-BM-6-ACTIVE : UNKNOWN intf 0x06000140 is no longer Active as part of Bundle-Ether3 (Link is being removed from the bundle)
RP/0/RSP0/CPU0:Aug 16 08:33:07.835 : BM-DISTRIB[1149]: %L2-BM-6-ACTIVE : UNKNOWN intf 0x06000100 is no longer Active as part of Bundle-Ether1 (Link is being removed from the bundle)
RP/0/RSP0/CPU0:Aug 16 08:33:07.848 : invmgr[262]: %PLATFORM-INV-6-OIROUT : OIR: Node 0/1/0 removed
RP/0/RSP0/CPU0:Aug 16 08:33:07.856 : invmgr[262]: %PLATFORM-INV-6-OIROUT : OIR: Node 0/1/1 removed
RP/0/RSP0/CPU0:Aug 16 08:33:07.856 : invmgr[262]: %PLATFORM-INV-6-NODE_STATE_CHANGE : Node: 0/1/CPU0, state: BRINGDOWN
RP/0/RSP1/CPU0:Aug 16 08:33:07.909 : ce_switch_srv[54]: %PLATFORM-CE_SWITCH-6-UPDN : Interface 4 (NC_4) is down
RP/0/RSP0/CPU0:Aug 16 08:33:08.037 : ce_switch_srv[54]: %PLATFORM-CE_SWITCH-6-UPDN : Interface 4 (NC_4) is down
RP/0/RSP0/CPU0:Aug 16 08:33:08.375 : envmon[210]: %PLATFORM-ENVMON-3-ALARM_RAISED : Raise alarm from CBC in slot 0/1/CPU0, alarm code CBC_ALRM_PWR_SEQ_FAILED Reason: OUTPUT VOLTAGE FAULT Bus:
0x2 Addresss:0xc4 Chan:0x6 STATUS_VOUT 0x10
RP/0/RSP0/CPU0:Aug 16 08:33:08.835 : mibd_entity[328]: %HA-HA_EM-7-FMFD_CONNECTION_FAIL : Could not connect to /dev/fm/fd_wdsysmon.d/node0_1_CPU0 : No such file or directory
/:last message repeated 2 times
RP/0/RSP1/CPU0:Aug 16 08:33:14.894 : canb-server[152]: %PLATFORM-CANB_SERVER-7-CBC_POST_RESET_NOTIFICATION : Node 0/1/CPU0 , Power Sequencer Failure (0x09000001)
RP/0/RSP0/CPU0:Aug 16 08:33:14.902 : canb-server[152]: %PLATFORM-CANB_SERVER-7-CBC_POST_RESET_NOTIFICATION : Node 0/1/CPU0 , Power Sequencer Failure (0x09000001)
RP/0/RSP0/CPU0:Aug 16 08:33:14.903 : shelfmgr[394]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 0/1/CPU0 A9K-MOD80-TR state:ROMMON
RP/0/RSP0/CPU0:Aug 16 08:33:20.147 : mpls_ldp[1044]: %ROUTING-LDP-5-SESSION_PROTECTION : VRF 'default' (0x60000000), Session hold up initiated for peer 10.1.200.1:0
RP/0/RSP0/CPU0:Aug 16 08:33:22.725 : envmon[210]: %PLATFORM-ENVMON-3-ALARM_CLEARED : Clear alarm from CBC in slot 0/1/CPU0, alarm code CBC_ALRM_PWR_SEQ_FAILED
RP/0/RSP0/CPU0:Aug 16 08:33:44.847 : ospf[1014]: %ROUTING-OSPF-5-ADJCHG : Process 100, Nbr 10.1.200.1 on Bundle-Ether2 in area 0 from FULL to DOWN, Neighbor Down: dead timer expired, vrf defa
ult vrfid 0x60000000
RP/0/RSP0/CPU0:Aug 16 08:33:51.371 : ce_switch_srv[54]: %PLATFORM-CE_SWITCH-6-UPDN : Interface 4 (NC_4) is up
RP/0/RSP0/CPU0:Aug 16 08:33:51.845 : shelfmgr[394]: %PLATFORM-SHELFMGR_HAL-6-BOOT_REQ_RECEIVED : Boot Request from 0/1/CPU0, RomMon Version: 2.0
RP/0/RSP0/CPU0:Aug 16 08:33:51.846 : shelfmgr[394]: %PLATFORM-MBIMGR-7-IMAGE_VALIDATED : Remote location 0/1/CPU0: : MBI tftp:/disk0/asr9k-os-mbi-5.1.3.sp10-1.0.0/lc/mbiasr9k-lc.vm validated
RP/0/RSP0/CPU0:Aug 16 08:33:51.847 : shelfmgr[394]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 0/1/CPU0 A9K-MOD80-TR state:MBI-BOOTING
RP/0/RSP0/CPU0:Aug 16 08:34:46.716 : tcp[427]: %IP-TCP_NSR-5-DISABLED : 10.2.200.1:29339 <-> 10.1.200.1:646:: NSR disabled for TCP connection because Retransmission threshold exceeded
RP/0/RSP0/CPU0:Aug 16 08:34:46.717 : mpls_ldp[1044]: %ROUTING-LDP-5-NSR_PEER_SYNC_LOST : VRF 'default' (0x60000000), Peer 10.1.200.1:0 synchronization lost
RP/0/RSP0/CPU0:Aug 16 08:35:03.819 : mpls_ldp[1044]: %ROUTING-LDP-5-NSR_SYNC_START : Initial synchronization started for 1 peers
RP/0/RSP0/CPU0:Aug 16 08:35:06.049 : mpls_ldp[1044]: %ROUTING-LDP-5-GR_NBR_CHANGE : VRF 'default' (0x60000000), GR session 10.1.200.1:0 (instance 1) disconnected
RP/0/RSP0/CPU0:Aug 16 08:35:06.049 : mpls_ldp[1044]: %ROUTING-LDP-5-NBR_CHANGE : VRF 'default' (0x60000000), neighbor 10.1.200.1:0, DOWN (Discovery Hello Hold Timer expired)
RP/0/RSP0/CPU0:Aug 16 08:35:22.287 : ce_switch_srv[54]: %PLATFORM-CE_SWITCH-6-UPDN : Interface 4 (NC_4) is down
RP/0/RSP0/CPU0:Aug 16 08:35:25.155 : ce_switch_srv[54]: %PLATFORM-CE_SWITCH-6-UPDN : Interface 4 (NC_4) is up
RP/0/RSP1/CPU0:Aug 16 08:35:25.279 : ce_switch_srv[54]: %PLATFORM-CE_SWITCH-6-UPDN : Interface 4 (NC_4) is up
RP/0/RSP0/CPU0:Aug 16 08:35:25.835 : shelfmgr[394]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 0/1/CPU0 A9K-MOD80-TR state:MBI-RUNNING
LC/0/1/CPU0:10: init[65540]: %OS-INIT-7-MBI_STARTED : total time 4.909 seconds
LC/0/1/CPU0:Aug 16 08:36:07.640 : sysmgr[91]: %OS-SYSMGR-5-NOTICE : Card is COLD started
LC/0/1/CPU0:Aug 16 08:36:08.008 : init[65540]: %OS-INIT-7-INSTALL_READY : total time 48.016 seconds
LC/0/1/CPU0:Aug 16 08:36:08.528 : sysmgr[347]: %OS-SYSMGR-6-INFO : Backup system manager is ready
LC/0/1/CPU0:Aug 16 08:36:17.546 : prm_server_ty[300]: %PLATFORM-QOSHAL-6-FLOW_QOS_CONFIG : Flow Aware QoS is disabled. max flow count set to 0
LC/0/1/CPU0:Aug 16 08:36:17.564 : prm_server_ty[300]: %PLATFORM-QOSHAL-6-QOS_MODE_CHANGE : Line-card QoS mode set to child-shaping-enabled.
LC/0/1/CPU0:Aug 16 08:36:17.564 : prm_server_ty[300]: %PLATFORM-QOSHAL-6-QOS_MODE_CHANGE : Line-card QoS mode set to lowburst-disabled.
LC/0/1/CPU0:Aug 16 08:36:17.564 : prm_server_ty[300]: %PLATFORM-QOSHAL-6-QOS_MODE_CHANGE : Line-card QoS mode set to l4-wred-buffer-mode-disabled.
LC/0/1/CPU0:Aug 16 08:36:17.564 : prm_server_ty[300]: %PLATFORM-QOSHAL-6-QOS_MODE_CHANGE : Line-card QoS mode set to ingress_queue for 4X10G disabled.
LC/0/1/CPU0:Aug 16 08:36:17.564 : prm_server_ty[300]: %PLATFORM-QOSHAL-6-QOS_MODE_CHANGE : Line-card QoS mode set to per-priority-limit-disabled.
RP/0/RSP0/CPU0:Aug 16 08:36:21.083 : shelfmgr[394]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 0/1/0 A9K-MPA-4X10GE state:UNPOWERED
RP/0/RSP0/CPU0:Aug 16 08:36:21.091 : shelfmgr[394]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 0/1/1 A9K-MPA-20X1GE state:UNPOWERED
LC/0/1/CPU0:Aug 16 08:36:24.683 : sysmgr[91]: %OS-SYSMGR-7-DEBUG : sysmgr_admin_plane_check:SYSMGR_PLANE_ADMIN Notification sent.
RP/0/RSP0/CPU0:Aug 16 08:36:25.265 : shelfmgr[394]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 0/1/0 A9K-MPA-4X10GE state:POWER UP
RP/0/RSP0/CPU0:Aug 16 08:36:25.508 : shelfmgr[394]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 0/1/1 A9K-MPA-20X1GE state:POWER UP
LC/0/1/CPU0:Aug 16 08:36:26.261 : lda_server[65]: %L2-SPA-5-STATE_CHANGE : SPA in bay 0 type A9K-MPA-4x10GE Initing
LC/0/1/CPU0:Aug 16 08:36:26.389 : lda_server[65]: %L2-SPA-5-STATE_CHANGE : SPA in bay 1 type A9K-MPA-20X1GE Initing
LC/0/1/CPU0:Aug 16 08:36:27.032 : syslog_dev[89]: hsbi_fpd_agent[203]: FPD ltrace_file_name => fpd-agent/hsbi_fpd_agent
RP/0/RSP0/CPU0:Aug 16 08:36:29.538 : shelfmgr[394]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 0/1/1 A9K-MPA-20X1GE state:INITIALIZED
RP/0/RSP0/CPU0:Aug 16 08:36:31.423 : invmgr[262]: %PLATFORM-INV-6-IF_OIRIN : xFP OIR: 0/1/1 port_num: 0 is inserted, state: 1
RP/0/RSP0/CPU0:Aug 16 08:36:31.807 : shelfmgr[394]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 0/1/0 A9K-MPA-4X10GE state:INITIALIZED
RP/0/RSP0/CPU0:Aug 16 08:36:32.558 : invmgr[262]: %PLATFORM-INV-6-IF_OIRIN : xFP OIR: 0/1/0 port_num: 0 is inserted, state: 1
RP/0/RSP0/CPU0:Aug 16 08:36:33.690 : invmgr[262]: %PLATFORM-INV-6-IF_OIRIN : xFP OIR: 0/1/0 port_num: 1 is inserted, state: 1
RP/0/RSP0/CPU0:Aug 16 08:36:34.821 : invmgr[262]: %PLATFORM-INV-6-IF_OIRIN : xFP OIR: 0/1/0 port_num: 2 is inserted, state: 1
RP/0/RSP0/CPU0:Aug 16 08:36:35.949 : invmgr[262]: %PLATFORM-INV-6-IF_OIRIN : xFP OIR: 0/1/0 port_num: 3 is inserted, state: 1
LC/0/1/CPU0:Aug 16 08:36:38.106 : pifibm_server_lc[291]: %OS-PLATFORM_LPTS_PIFIB-4-ERR_INVALID_POLICER_RATE_BURST : Policer Burst 7d0 is more than Policer Rate 3e8: Re-setting the Burst to Po
licerRate
RP/0/RSP0/CPU0:Aug 16 08:36:43.305 : SSHD_[65762]: %SECURITY-SSHD-6-INFO_GENERAL : Failed to read from socket
RP/0/RSP0/CPU0:Aug 16 08:36:50.359 : shelfmgr[394]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 0/1/0 A9K-MPA-4X10GE state:OK
RP/0/RSP0/CPU0:Aug 16 08:36:50.389 : invmgr[262]: %PLATFORM-INV-6-NODE_STATE_CHANGE : Node: 0/1/0, state: OK
RP/0/RSP0/CPU0:Aug 16 08:36:50.392 : invmgr[262]: %PLATFORM-INV-6-OIRIN : OIR: Node 0/1/0 inserted
LC/0/1/CPU0:Aug 16 08:36:53.188 : ifmgr[207]: %PKT_INFRA-LINK-3-UPDOWN : Interface TenGigE0/1/0/3, changed state to Down
LC/0/1/CPU0:Aug 16 08:36:53.191 : ifmgr[207]: %PKT_INFRA-LINEPROTO-5-UPDOWN : Line protocol on Interface TenGigE0/1/0/3, changed state to Down
LC/0/1/CPU0:Aug 16 08:36:53.191 : ifmgr[207]: %PKT_INFRA-LINK-3-UPDOWN : Interface TenGigE0/1/0/2, changed state to Down
LC/0/1/CPU0:Aug 16 08:36:53.191 : ifmgr[207]: %PKT_INFRA-LINEPROTO-5-UPDOWN : Line protocol on Interface TenGigE0/1/0/2, changed state to Down
LC/0/1/CPU0:Aug 16 08:36:53.191 : ifmgr[207]: %PKT_INFRA-LINK-3-UPDOWN : Interface TenGigE0/1/0/1, changed state to Down
LC/0/1/CPU0:Aug 16 08:36:53.191 : ifmgr[207]: %PKT_INFRA-LINEPROTO-5-UPDOWN : Line protocol on Interface TenGigE0/1/0/1, changed state to Down
LC/0/1/CPU0:Aug 16 08:36:53.191 : ifmgr[207]: %PKT_INFRA-LINK-5-CHANGED : Interface TenGigE0/1/0/0, changed state to Administratively Down
LC/0/1/CPU0:Aug 16 08:36:53.197 : cfgmgr-lc[136]: %MGBL-CONFIG-6-OIR_RESTORE : Configuration for node '0/1/0' has been restored.
RP/0/RSP0/CPU0:Aug 16 08:36:53.351 : shelfmgr[394]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 0/1/1 A9K-MPA-20X1GE state:OK
RP/0/RSP0/CPU0:Aug 16 08:36:53.357 : invmgr[262]: %PLATFORM-INV-6-NODE_STATE_CHANGE : Node: 0/1/1, state: OK
RP/0/RSP0/CPU0:Aug 16 08:36:53.359 : invmgr[262]: %PLATFORM-INV-6-OIRIN : OIR: Node 0/1/1 inserted

1 Accepted Solution

Accepted Solutions

Aleksandar Vidakovic
Cisco Employee
Cisco Employee

If reported during line card boot-up, this is very likely a software issue. There should be a SMU available for 5.1.3.

If reported during runtime, it's likely a HW failure.

Please note that our generic recommendation for this year is XR release 5.3.4 or 6.1.4. The fix for the Typhoon power sequencer issue is included in both releases.

/Aleksandar

View solution in original post

1 Reply 1

Aleksandar Vidakovic
Cisco Employee
Cisco Employee

If reported during line card boot-up, this is very likely a software issue. There should be a SMU available for 5.1.3.

If reported during runtime, it's likely a HW failure.

Please note that our generic recommendation for this year is XR release 5.3.4 or 6.1.4. The fix for the Typhoon power sequencer issue is included in both releases.

/Aleksandar