ISM with NAT44 - Need help with configuration

[Renato Reis]

Hello everyone,

I'm trying to set up NAT44 in the following scenario below and I'm having a hard time figuring out how to redirect the traffic. As you can see the big problem is that I have one single interface that connects to the internal network (10.0.0.0/8) and also to the tunnel destinations all in the same VRF. Can you guys give me a hand? The trafiic comes from network network 10.0.0.0/8 enters interface bundle-ether 2 (Now it needs to be translated), once it is translated, now it needs to reach the destination known via GRE tunnel.

Configurations

-----------------------------------------------

!

vrf NAT_IN

address-family ipv4 unicast

!

!

vrf BLUE

address-family ipv4 unicast

!

!

hw-module service cgn location 0/3/CPU0

!

interface Bundle-Ether2

description UPLINK TO METRO ETHERNET

!

interface Bundle-Ether2.2 l2transport

encapsulation dot1q 2

rewrite ingress tag pop 1 symmetric

!

interface GigabitEthernet200/0/0/43

description LINK TO METRO ETHERNET

bundle id 2 mode active

interface GigabitEthernet300/0/0/43

description LINK TO METRO ETHERNET

bundle id 2 mode active

interface BVI2

description METRO

vrf BLUE

ipv4 address 100.0.0.10/24

!

interface tunnel-ip 101

description GRE_TUNNEL

vrf BLUE

ipv4 address 1.1.1.1/32

tunnel mode gre ipv4

tunnel source interface bvi 2

tunnel destination 200.0.0.1

!

!

interface BVI 100

vrf BLUE

ipv4 address [GATEWAY_100] [MASK_100]

!

interface BVI 200

vrf BLUE

ipv4 address [GATEWAY_200] [MASK_200]

!

interface BVI 300

vrf BLUE

ipv4 address [GATEWAY_300] [MASK_300]

!

!

interface ServiceApp1

vrf NAT_IN

ipv4 address 10.0.2.1 255.255.255.252

service cgn CGN service-type nat44

!

interface ServiceApp2

vrf BLUE

ipv4 address 10.0.2.2 255.255.255.252

service cgn CGN service-type nat44

!

interface ServiceInfra1

ipv4 address 10.0.3.1 255.255.255.0

service-location 0/3/CPU0

!

!

router static

address-family ipv4 unicast

!

vrf NAT_IN

address-family ipv4 unicast

0.0.0.0/0 ServiceApp1

10.0.0.0/8 vrf BLUE bvI 2 <NEXT HOP>

!

!

vrf BLUE

address-family ipv4 unicast

172.16.0.0/24 ServiceApp2

!

!

router ospf METRO

vrf BLUE

router-id [ROUTER_ID]

redistribute bgp 65500 metric 100

area 0

interface bvi 2

!

router ospf BLUE

vrf BLUE

router-id [ROUTER ID]

redistribute bgp 65500 metric 100

area 10

interface BVI100

!

interface BVI200

!

interface BVI200

!

!

!

router bgp 65500

address-family ipv4 unicast

!

address-family vpnv4 unicast

!

!

vrf BLUE

rd 65500:2

address-family ipv4 unicast

redistribute static

redistribute ospf BLUE

!

neighbor 1.1.1.2

remote-as 64512

ebgp-multihop 5

address-family ipv4 unicast

route-policy PASS in

route-policy PASS out

!

!

!

service cgn CGN

service-location preferred-active 0/3/CPU0

service-type nat44 nat44

portlimit 20000

inside-vrf NAT_IN

map outside-vrf BLUE address-pool 172.16.0.0/24

!

!

!

Thanks in advance,

Renato

[somnathr]

One more question - Can I ask who is the customer here and also are you part of the customer organization or some other partner organization who is helping customer ?

[Harold Ritter]

Hi Renato,

Congratulations. You are very welcome. Let us know if you have any additional questions or concerns.

Regards

[Renato Reis]

Hi Somnath.

I will post the configuration as soon as possible. I would like to know if is there any command to check what is the current version of the linux I'm using on the ISM module?

Thanks in advance,

Renato Reis

[somnathr]

Hi Renato,

You can use "show platform summary location " command

regards,

Somnath.

[Renato Reis]

Thank you Somnath,

I'm still confused if the version that is being shown in the output below (IOS SW Ver : 4.3.1) is related to the linux kit or the IOS-XR itself.

:router#show platform summary location 0/3/CPU0

Fri Sep 20 17:45:50.010 UTC

-------------------------------------------------------------------------------

     Platform Node : 0/3/CPU0 (slot 5)

               PID : A9K-ISM-100

         Card Type : Integrated Services Module

            VID/SN : V01 / FOC1710N5NX

        Oper State : IOS XR RUN

        Last Reset : N/A

                   : N/A

     Configuration : Power is enabled

                     Bootup enabled. 

                     Monitoring enabled

        Rommon Ver : Version 1.2(20091201:235620)

        IOS SW Ver : 4.3.1

        Main Power : Power state Enabled. Estimate power 405 Watts of power required.

            Faults : N/A

-------------------------------------------------------------------------------

     Platform Node : 0/3/CPU1 (slot 5)

         Card Type : Integrated Services Module (Service Engine)

        Oper State : APP-READY

   Last Start Time : Sun Sep  8 18:20:55 2013

   Last Ready Time : Sun Sep  8 19:53:01 2013

            Uptime : 285:52:49

          BIOS Ver : 0.17 (Thurley.3.60.18.0033)

            SW Ver : 1.0.1.0 (Built on May 3, 2012, from services/cgn@r421-support/7)

        App Status : 8 CGv6 Application instance(s) is/are running

-------------------------------------------------------------------------------

:router#

[]'s

Renato Reis

[somnathr]

Hi Renato,

We need to look at "CPU1" status as that is the Application CPU. "CPU0" is the XR CPU.

I see -

SW Ver : 1.0.1.0 (Built on May 3, 2012, from services/cgn@r421-support/7)

This gives the Application s/w version.

It looks like you need to upgrade the Linux part (install-kit) to 4.3.1. (it is running 421 now).

Procedure to upgrade the install-kit is in CCO.

regards,

Somnath.

[Renato Reis]

Hello Somnath,

I'm so sorry I didn't see that...thank you again !

Regards,

Renato

[Renato Reis]

Hi guys, It`s me again !

Could you guys help me with an ISM module stuck in the BRINGDOWN state?

RP/0/RSP0/CPU0:router#admin show platform

Tue Oct 29 10:34:32.782 UTC

Node            Type                      State            Config State

-----------------------------------------------------------------------------

0/RSP0/CPU0     A9K-RSP440-TR(Active)     IOS XR RUN       PWR,NSHUT,MON

0/RSP1/CPU0     A9K-RSP440-TR(Standby)    IOS XR RUN       PWR,NSHUT,MON

0/FT0/SP        FAN TRAY                  READY           

0/FT1/SP        FAN TRAY                  READY           

0/0/CPU0        A9K-MOD160-TR             IOS XR RUN       PWR,NSHUT,MON

0/0/0           A9K-MPA-8X10GE            OK               PWR,NSHUT,MON

0/0/1           A9K-MPA-8X10GE            OK               PWR,NSHUT,MON

0/1/CPU0        A9K-MOD160-TR             IOS XR RUN       PWR,NSHUT,MON

0/1/0           A9K-MPA-8X10GE            OK               PWR,NSHUT,MON

0/1/1           A9K-MPA-8X10GE            OK               PWR,NSHUT,MON

0/3/CPU0        A9K-ISM-100(LCP)          BRINGDOWN        PWR,NSHUT,MON

0/PM0/SP        PWR-3KW-AC-V2             READY            PWR,NSHUT,MON

0/PM1/SP        PWR-3KW-AC-V2             READY            PWR,NSHUT,MON

0/PM2/SP        PWR-3KW-AC-V2             READY            PWR,NSHUT,MON

RP/0/RSP0/CPU0:router#

Thank you in advance,

Renato Reis

[somnathr]

Hi Renato,

How did it come to this stage ? Were you installing / upgrading the s/w ?

If so, you can refer to / follow some of the steps mentioned under http://www.cisco.com/en/US/docs/routers/asr9000/software/asr9k_r4.3/cg_nat/configuration/guide/cgnat43cgn.html#wp1015556.

regards,

Somnath.

[Renato Reis]

Hi Somnath,

Actually it was right after a power outage...

Thanks,

Renato Reis

[somnathr]

Hi Renato,

Ok. In that case, as a recovery, you may want to try "hw-module reload loc ".

Can you please provide "sh logging" output which possibly would give more details on the issue(s) faced by the card ?

regards,

Somnath.

[Renato Reis]

Hi Somnath,

I've opened a TAC and they recommended R|MA for this module, thank you for you attention.

Renato

[Renato Reis]

Hi Somnath,

We replaced the module but the new one cant boot up either, here is the log message and the current state of the ISM module.

RP/0/RSP1/CPU0:router#admin show platform

Fri Nov  1 16:17:16.265 UTC

Node            Type                      State            Config State

-----------------------------------------------------------------------------

0/RSP0/CPU0     A9K-RSP440-TR(Standby)    IOS XR RUN       PWR,NSHUT,MON

0/RSP1/CPU0     A9K-RSP440-TR(Active)     IOS XR RUN       PWR,NSHUT,MON

0/FT0/SP        FAN TRAY                  READY          

0/FT1/SP        FAN TRAY                  READY          

0/0/CPU0        A9K-MOD160-TR             IOS XR RUN       PWR,NSHUT,MON

0/0/0           A9K-MPA-8X10GE            OK               PWR,NSHUT,MON

0/0/1           A9K-MPA-8X10GE            OK               PWR,NSHUT,MON

0/1/CPU0        A9K-MOD160-TR             IOS XR RUN       PWR,NSHUT,MON

0/1/0           A9K-MPA-8X10GE            OK               PWR,NSHUT,MON

0/1/1           A9K-MPA-8X10GE            OK               PWR,NSHUT,MON

0/3/CPU0        A9K-ISM-100(LCP)          IN-RESET         PWR,NSHUT,MON

0/3/SAM0        A9K-SAM-2TB               BOOTING          PWR,NSHUT,NMON

0/3/SAM1        A9K-SAM-2TB               FAILED           PWR,NSHUT,NMON

0/PM0/SP        PWR-3KW-AC-V2             READY            PWR,NSHUT,MON

0/PM1/SP        PWR-3KW-AC-V2             READY            PWR,NSHUT,MON

0/PM2/SP        PWR-3KW-AC-V2             READY            PWR,NSHUT,MON

RP/0/RSP1/CPU0:router#

LC/0/3/CPU0:Nov  1 16:16:11.475 : apiv_srvr[115]: %PLATFORM-APIV-3-MODULE_INCOMPATIBLE : APIV module APIV_SI is incompatible

LC/0/3/CPU0:Nov  1 16:16:11.697 : vkg_l2fib_mac_cache[340]: %PLATFORM-PLAT_L2FIB-6-GENERIC : avsm l2fib: initializing L2 FIB MAC CAHE APIV modules.

LC/0/3/CPU0:Nov  1 16:16:11.705 : /pkg/sbin/sysmgr_log[65661]: %OS-SYSMGR-7-CHECK_LOG : /pkg/bin/sysmgr_debug_script invoked for: (fib_mgr) process did not signal EOI and for level:100 . Output is in harddisk:/sysmgr_debug/debug.node0_3_CPU0.442485

LC/0/3/CPU0:Nov  1 16:16:11.801 : vkg_l2fib_mac_cache[340]: %PLATFORM-PLAT_L2FIB-6-GENERIC : avsm l2fib: retrieving SysDB notifications ...

LC/0/3/CPU0:Nov  1 16:16:11.801 : vkg_l2fib_mac_cache[340]: %PLATFORM-PLAT_L2FIB-6-GENERIC : avsm l2fib: Starting of L2FIB MAC CACHE APIV version negotiation.

LC/0/3/CPU0:Nov  1 16:16:13.624 : canb_upg_agt[132]: %PLATFORM-UPGRADE_FPD-4-DOWN_REV : cbc instance 0 is down-rev (V18.05), upgrade to (V18.08). Use the "upgrade hw-module fpd" CLI in admin mode.

LC/0/3/CPU0:Nov  1 16:16:14.119 : l2fib[239]: %PLATFORM-PLAT_L2FIB-6-GENERIC : avsm l2fib: Initializing L2 FIB APIV modules.

LC/0/3/CPU0:Nov  1 16:16:14.192 : l2fib[239]: %PLATFORM-PLAT_L2FIB-6-GENERIC : avsm l2fib: retrieving SysDB notifications.

LC/0/3/CPU0:Nov  1 16:16:14.192 : l2fib[239]: %PLATFORM-PLAT_L2FIB-6-GENERIC : avsm l2fib: starting of APIV version negotiation.

LC/0/3/CPU0:Nov  1 16:16:14.784 : avsm_se_sm[125]: %PLATFORM-SIM_SE-6-STATE_CHANGE : Service Engine is in shutting down state.

LC/0/3/CPU0:Nov  1 16:16:14.790 : sis[307]: %PLATFORM-VKG_SIS-6-GENERIC_EVENT : sis event: Starting of SI APIV Deletion ...

LC/0/3/CPU0:Nov  1 16:16:15.420 : apiv_srvr[115]: %PLATFORM-APIV-5-API_INCOMPATIBLE : Message 8 in APIV module ISM_L2FIB_APIV is incompatible (reason: Not supported on the remote side)

LC/0/3/CPU0:Nov  1 16:16:15.420 : apiv_srvr[115]: %PLATFORM-APIV-3-MODULE_INCOMPATIBLE : APIV module ISM_L2FIB_APIV is incompatible

LC/0/3/CPU0:Nov  1 16:16:16.421 : avsm_agent[124]: %ISM_L2_UFA-3-ERR :  L2UFA: apiv/ipcp init failed

LC/0/3/CPU0:Nov  1 16:16:21.641 : avsm_agent[124]: %SAM_OIR-3-SAM_ERR_FPD : SAM/1: Unable to initialize. Error in FPD of device(s):CPLD. Detailed message -23:Unable to connect to socket:/tmp/fpdinfra_socket  -23 111:Connection refused

RP/0/RSP1/CPU0:Nov  1 16:16:21.647 : invmgr[257]: %PLATFORM-INV-6-NODE_STATE_CHANGE : Node: 0/3/SAM1, state: FAILED

LC/0/3/CPU0:Nov  1 16:16:24.704 : fib_mgr[172]: %PLATFORM-PLAT_FIB-3-ERR_STR_NEGO_FAIL : CGN fib apiv ipcp init: Failed to negotiate the apiv version.: UNKNOWN (12293)

LC/0/3/CPU0:Nov  1 16:16:30.695 : fib_mgr[172]: %ROUTING-FIB-3-TABLE : table operation failed during Invalid table create failed: Resource temporarily unavailable  : pkg/bin/fib_mgr : (PID=434279) :  -Traceback= 4002b9cc 4001426c 40014630 400019f4 4ba73a44 4ba71554 400003f0 40014a78 4bada400

RP/0/RSP1/CPU0:Nov  1 16:16:37.142 : shelfmgr[387]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 0/3/CPU0 A9K-ISM-100 state:IOS XR RUN

RP/0/RSP1/CPU0:Nov  1 16:16:37.144 : invmgr[257]: %PLATFORM-INV-6-NODE_STATE_CHANGE : Node: 0/3/CPU0, state: IOS XR RUN

LC/0/3/CPU0:Nov  1 16:16:47.370 : avsm_se_sm[125]: %PLATFORM-SIM_SE-6-STATE_CHANGE : Service Engine is in reset(Service Engine Software) state.

RP/0/RSP0/CPU0:Nov  1 16:16:47.418 : canb-server[149]: %PLATFORM-CANB_SERVER-7-CBC_PRE_RESET_NOTIFICATION : Node 0/3/CPU0 , Power Cycle (0x05000000)

RP/0/RSP0/CPU0:Nov  1 16:16:47.418 : canb-server[149]: %PLATFORM-CANB_SERVER-7-CBC_PRE_RESET_NOTIFICATION : Node 0/3/CPU0 , PLDREQ Sreset (0x0b000000)

RP/0/RSP1/CPU0:Nov  1 16:16:47.424 : canb-server[149]: %PLATFORM-CANB_SERVER-7-CBC_PRE_RESET_NOTIFICATION : Node 0/3/CPU0 , Power Cycle (0x05000000)

RP/0/RSP1/CPU0:Nov  1 16:16:47.424 : canb-server[149]: %PLATFORM-CANB_SERVER-7-CBC_PRE_RESET_NOTIFICATION : Node 0/3/CPU0 , PLDREQ Sreset (0x0b000000)

RP/0/RSP1/CPU0:Nov  1 16:16:47.425 : shelfmgr[387]: %PLATFORM-SHELFMGR-0-MAX_RESET_BRINGDOWN : Can not boot node 0/3/CPU0 A9K-ISM-100 due to multiple resets, putting it IN_RESET state. The probable cause is an unexpected event on the node or a failure in communication with the node. Please refer to the Cisco ASR 9000 System Error Message Reference Guide for further information if needed.

RP/0/RSP1/CPU0:Nov  1 16:16:47.425 : shelfmgr[387]: %PLATFORM-SHELFMGR-6-NODE_CPU_RESET : Node 0/3/CPU0 CPU reset detected.

RP/0/RSP1/CPU0:Nov  1 16:16:47.427 : shelfmgr[387]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 0/3/CPU0 A9K-ISM-100 state:IN-RESET

RP/0/RSP1/CPU0:Nov  1 16:16:47.434 : mibd_entity[324]: %HA-HA_EM-7-FMFD_CONNECTION_FAIL : Could not connect to /dev/fm/fd_wdsysmon.d/node0_3_CPU0 : No such file or directory

RP/0/RSP0/CPU0:Nov  1 16:16:47.548 : ce_switch_srv[53]: %PLATFORM-CE_SWITCH-6-UPDN : Interface 7 (LC_Slot_3) is down

RP/0/RSP1/CPU0:Nov  1 16:16:47.683 : ce_switch_srv[53]: %PLATFORM-CE_SWITCH-6-UPDN : Interface 7 (LC_Slot_3) is down

RP/0/RSP1/CPU0:Nov  1 16:16:48.436 : mibd_entity[324]: %HA-HA_EM-7-FMFD_CONNECTION_FAIL : Could not connect to /dev/fm/fd_wdsysmon.d/node0_3_CPU0 : No such file or directory

RP/0/RSP1/CPU0:Nov  1 16:16:50.437 : mibd_entity[324]: %HA-HA_EM-7-FMFD_CONNECTION_FAIL : Could not connect to /dev/fm/fd_wdsysmon.d/node0_3_CPU0 : No such file or directory

RP/0/RSP1/CPU0:Nov  1 16:16:54.439 : mibd_entity[324]: %HA-HA_EM-7-FMFD_CONNECTION_FAIL : Could not connect to /dev/fm/fd_wdsysmon.d/node0_3_CPU0 : No such file or directory

RP/0/RSP1/CPU0:router#

Thanks

Renato Reis

[somnathr]

Hi Renato,

Couple of things:

• You do not need SAM modules on ISM (for CGN/CGv6 application). So, you can remove those.
  
• What is the version that ISM module is running ? Can you pl. capture 'show platform summary loc ' output ?
  
  • If it is older one (I see some API-V mismatch message), you may want to upgrade the Linux install-kit (pl. use the CCO configuration guide link)
    

regards,

Somnath.

[Renato Reis]

Hi Somnath,

I guess the ISM's software version is up to date. How can I disadle the SAM modules?

RP/0/RSP1/CPU0:router#admin show platform summary location 0/3/CPU0

Sat Nov  2 10:57:05.277 UTC

-------------------------------------------------------------------------------

     Platform Node : 0/3/CPU0 (slot 5)

               PID : A9K-ISM-100

         Card Type : Integrated Services Module

            VID/SN : V01 / FOC151984LQ

        Oper State : IN-RESET

        Last Reset : N/A

                   : N/A

     Configuration : Power is enabled

                     Bootup enabled. 

                     Monitoring enabled

        Rommon Ver : Version 1.2(20091201:235620)

        IOS SW Ver : 4.3.2

        Main Power : Power state Disabled.

            Faults : N/A

-------------------------------------------------------------------------------

RP/0/RSP1/CPU0:router#

RP/0/RSP1/CPU0:router#admin show install active summary

Sat Nov  2 10:57:11.659 UTC

Default Profile:

  SDRs:

    Owner

  Active Packages:

    disk0:asr9k-mini-px-4.3.2

    disk0:asr9k-9000v-nV-px-4.3.2

    disk0:asr9k-doc-px-4.3.2

    disk0:asr9k-fpd-px-4.3.2

    disk0:asr9k-k9sec-px-4.3.2

    disk0:asr9k-mgbl-px-4.3.2

    disk0:asr9k-mpls-px-4.3.2

    disk0:asr9k-services-px-4.3.2

RP/0/RSP1/CPU0:router#

LC/0/3/CPU0:Nov  1 17:24:54.895 : avsm_agent[124]: %PROCMGR-3-PROCESS_CRASH : process avsm_sia crashed, restarting it...

LC/0/3/CPU0:Nov  1 17:24:54.896 : avsm_agent[124]: %PROCMGR-2-SE_RESTART : process avsm_sia restart too many times, Service Engine is going to reboot.

LC/0/3/CPU0:Nov  1 17:24:54.959 : apiv_srvr[115]: %PLATFORM-APIV-5-API_INCOMPATIBLE : Message 24 in APIV module APIV_SI is incompatible (reason: Not supported on the remote side)

LC/0/3/CPU0:Nov  1 17:24:54.959 : apiv_srvr[115]: %PLATFORM-APIV-3-MODULE_INCOMPATIBLE : APIV module APIV_SI is incompatible

LC/0/3/CPU0:Nov  1 17:24:56.642 : canb_upg_agt[132]: %PLATFORM-UPGRADE_FPD-4-DOWN_REV : cbc instance 0 is down-rev (V18.05), upgrade to (V18.08). Use the "upgrade hw-module fpd" CLI in admin mode.

LC/0/3/CPU0:Nov  1 17:24:57.241 : l2fib[239]: %PLATFORM-PLAT_L2FIB-6-GENERIC : avsm l2fib: Initializing L2 FIB APIV modules.

LC/0/3/CPU0:Nov  1 17:24:57.313 : l2fib[239]: %PLATFORM-PLAT_L2FIB-6-GENERIC : avsm l2fib: retrieving SysDB notifications.

LC/0/3/CPU0:Nov  1 17:24:57.313 : l2fib[239]: %PLATFORM-PLAT_L2FIB-6-GENERIC : avsm l2fib: starting of APIV version negotiation.

LC/0/3/CPU0:Nov  1 17:24:58.033 : avsm_se_sm[125]: %PLATFORM-SIM_SE-6-STATE_CHANGE : Service Engine is in shutting down state.

LC/0/3/CPU0:Nov  1 17:24:58.035 : sis[307]: %PLATFORM-VKG_SIS-6-GENERIC_EVENT : sis event: Starting of SI APIV Deletion ...

LC/0/3/CPU0:Nov  1 17:24:58.840 : apiv_srvr[115]: %PLATFORM-APIV-5-API_INCOMPATIBLE : Message 8 in APIV module ISM_L2FIB_APIV is incompatible (reason: Not supported on the remote side)

LC/0/3/CPU0:Nov  1 17:24:58.840 : apiv_srvr[115]: %PLATFORM-APIV-3-MODULE_INCOMPATIBLE : APIV module ISM_L2FIB_APIV is incompatible

LC/0/3/CPU0:Nov  1 17:24:59.842 : avsm_agent[124]: %ISM_L2_UFA-3-ERR :  L2UFA: apiv/ipcp init failed

LC/0/3/CPU0:Nov  1 17:25:05.063 : avsm_agent[124]: %SAM_OIR-3-SAM_ERR_FPD : SAM/1: Unable to initialize. Error in FPD of device(s):CPLD. Detailed message -23:Unable to connect to socket:/tmp/fpdinfra_socket  -23 111:Connection refused 

RP/0/RSP1/CPU0:Nov  1 17:25:05.065 : invmgr[257]: %PLATFORM-INV-6-NODE_STATE_CHANGE : Node: 0/3/SAM1, state: FAILED

LC/0/3/CPU0:Nov  1 17:25:07.897 : fib_mgr[172]: %PLATFORM-PLAT_FIB-3-ERR_STR_NEGO_FAIL : CGN fib apiv ipcp init: Failed to negotiate the apiv version.: UNKNOWN (12293)

LC/0/3/CPU0:Nov  1 17:25:13.838 : fib_mgr[172]: %ROUTING-FIB-3-TABLE : table operation failed during Invalid table create failed: Resource temporarily unavailable  : pkg/bin/fib_mgr : (PID=442471) :  -Traceback= 4002b9cc 4001426c 40014630 400019f4 4ba73a44 4ba71554 400003f0 40014a78 4bada400

RP/0/RSP1/CPU0:Nov  1 17:25:20.654 : shelfmgr[387]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 0/3/CPU0 A9K-ISM-100 state:IOS XR RUN

RP/0/RSP1/CPU0:Nov  1 17:25:20.656 : invmgr[257]: %PLATFORM-INV-6-NODE_STATE_CHANGE : Node: 0/3/CPU0, state: IOS XR RUN

LC/0/3/CPU0:Nov  1 17:25:32.631 : avsm_se_sm[125]: %PLATFORM-SIM_SE-6-STATE_CHANGE : Service Engine is in reset(Service Engine Software) state.

RP/0/RSP1/CPU0:Nov  1 17:25:32.678 : canb-server[149]: %PLATFORM-CANB_SERVER-7-CBC_PRE_RESET_NOTIFICATION : Node 0/3/CPU0 , Power Cycle (0x05000000) 

RP/0/RSP1/CPU0:Nov  1 17:25:32.678 : canb-server[149]: %PLATFORM-CANB_SERVER-7-CBC_PRE_RESET_NOTIFICATION : Node 0/3/CPU0 , PLDREQ Sreset (0x0b000000) 

RP/0/RSP1/CPU0:Nov  1 17:25:32.678 : shelfmgr[387]: %PLATFORM-SHELFMGR-0-MAX_RESET_BRINGDOWN : Can not boot node 0/3/CPU0 A9K-ISM-100 due to multiple resets, putting it IN_RESET state. The probable cause is an unexpected event on the node or a failure in communication with the node. Please refer to the Cisco ASR 9000 System Error Message Reference Guide for further information if needed.

RP/0/RSP1/CPU0:Nov  1 17:25:32.679 : shelfmgr[387]: %PLATFORM-SHELFMGR-6-NODE_CPU_RESET : Node 0/3/CPU0 CPU reset detected.

RP/0/RSP0/CPU0:Nov  1 17:25:32.681 : canb-server[149]: %PLATFORM-CANB_SERVER-7-CBC_PRE_RESET_NOTIFICATION : Node 0/3/CPU0 , Power Cycle (0x05000000) 

RP/0/RSP0/CPU0:Nov  1 17:25:32.681 : canb-server[149]: %PLATFORM-CANB_SERVER-7-CBC_PRE_RESET_NOTIFICATION : Node 0/3/CPU0 , PLDREQ Sreset (0x0b000000) 

RP/0/RSP1/CPU0:Nov  1 17:25:32.681 : shelfmgr[387]: %PLATFORM-SHELFMGR-6-NODE_STATE_CHANGE : 0/3/CPU0 A9K-ISM-100 state:IN-RESET

RP/0/RSP1/CPU0:Nov  1 17:25:32.689 : mibd_entity[324]: %HA-HA_EM-7-FMFD_CONNECTION_FAIL : Could not connect to /dev/fm/fd_wdsysmon.d/node0_3_CPU0 : No such file or directory

RP/0/RSP1/CPU0:Nov  1 17:25:32.702 : canb-server[149]: %PLATFORM-CANB_SERVER-7-CBC_PRE_RESET_NOTIFICATION : Node 0/3/CPU0 , Power Off (0x0a000000) 

RP/0/RSP0/CPU0:Nov  1 17:25:32.705 : canb-server[149]: %PLATFORM-CANB_SERVER-7-CBC_PRE_RESET_NOTIFICATION : Node 0/3/CPU0 , Power Off (0x0a000000) 

RP/0/RSP0/CPU0:Nov  1 17:25:32.917 : ce_switch_srv[53]: %PLATFORM-CE_SWITCH-6-UPDN : Interface 7 (LC_Slot_3) is down

RP/0/RSP1/CPU0:Nov  1 17:25:32.922 : ce_switch_srv[53]: %PLATFORM-CE_SWITCH-6-UPDN : Interface 7 (LC_Slot_3) is down

RP/0/RSP1/CPU0:Nov  1 17:25:33.691 : mibd_entity[324]: %HA-HA_EM-7-FMFD_CONNECTION_FAIL : Could not connect to /dev/fm/fd_wdsysmon.d/node0_3_CPU0 : No such file or directory

RP/0/RSP1/CPU0:Nov  1 17:25:35.693 : mibd_entity[324]: %HA-HA_EM-7-FMFD_CONNECTION_FAIL : Could not connect to /dev/fm/fd_wdsysmon.d/node0_3_CPU0 : No such file or directory

RP/0/RSP1/CPU0:Nov  1 17:25:39.694 : mibd_entity[324]: %HA-HA_EM-7-FMFD_CONNECTION_FAIL : Could not connect to /dev/fm/fd_wdsysmon.d/node0_3_CPU0 : No such file or directory

Thanks,

Renato