MPLS VPN Issues in 9606R Stackwise Virtual

[Learnercisco]

Hi Tecck Guys,

MPLS VPN implementation in core and two seprate distribution switches clusters.

i have Core switches (virtual stackwise) + Route reflector /MBGP/MPLS 

Distribution Cluster 1 = (virtual stackwise): CE to MPLS VPN domain //MBGP/MPLS 

Distribution Cluster 2 = (virtual stackwise): CE to MPLS VPN domain///MBGP/MPLS 

Issue:

Reachibility is working fine on the Active switches. Reachibiity  is not working when all switches failovers to STandby in a sequence of Test

Test conducted

Test the reachibility between 2 distribution clusters via CORE Switches through single management VRF import/export between distirbution clusters via CORE (Route Reflector) 

Test Performed

1- Active Core shutdown, connectivty restablished after few packet drops after failover to Standby Core

2- power off Active distribution switch  on cluster 1, (no reachibility) Error:

*Jul 9 11:46:16.633: %FMFP-3-OBJ_DWNLD_TO_DP_STUCK: Chassis 2 R0/0: fman_fp_image: AOM download to Data Plane is stuck for more than 1800 seconds due to error object: obj[1686] type[52] 'label 0x10000087', resulting in pending-issue object: obj[1688] type[49] 'EOS Choice 0x10000088'

3- Power of Active distribution switches on cluster 2

 No icmp working, OSPF neighbourship UP and MPLS is up (Strange issue)

topology attached

i 

[balaji.bandi]

Not sure what is the version of code running here :

worth looking at this bug:  (advise if that is not your case ?)

https://bst.cloudapps.cisco.com/bugsearch/bug/CSCvo55783/?rfs=iqvred

[Learnercisco]

thanks balaji.bandi for reply

the code Cisco IOS XE Gibraltar 16.12.2 (ALL 6 switches)

May be CEF forwarding issue in NSF 

[Learnercisco]

ERROR

*Jul  9 11:46:16.633: %FMFP-3-OBJ_DWNLD_TO_DP_STUCK: Chassis 2 R0/0: fman_fp_image: AOM download to Data Plane is stuck for more than 1800 seconds due to error object: obj[1686] type[52] 'label 0x10000087', resulting in pending-issue object: obj[1688] type[49] 'EOS Choice 0x10000088'

930BG001TLSW0001-1A#show platform software object-manage SWitch 2 f0 err

930BG001TLSW0001-1A#$rm software object-manage SWitch 2 f0 error-object

Object identifier: 1686

  Description: label 0x10000087

  Status: Create-failed

Object identifier: 1687

  Description: label 0x1000008a

  Status: Create-failed

Object identifier: 1729

  Description: label 0x10000015

  Status: Create-failed