cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
Announcements

181
Views
0
Helpful
5
Replies
Beginner

C9500-16X - %FMFP-3-OBJ_DWNLD_TO_DP_STUCK: Switch 1 R0/0: fman_fp_image: AOM download to Data Plane is stuck for more than 1800 seconds for obj[2253953] type[21] pending-issue Req-delete Issued-none 'uRPF-list(hdl=0x500000d6)'

Hello Guys,

 

Since last week my catalyst 9500 start to show the following logs:

 

001204: Oct 4 00:10:08.930 BST: %FMFP-6-OBJ_DWNLD_TO_DP_RESUME: Switch 1 R0/0: fman_fp_image: AOM download of objects to Data Plane is back to normal
001206: Oct 4 11:40:08.855 BST: %FMFP-3-OBJ_DWNLD_TO_DP_STUCK: Switch 1 R0/0: fman_fp_image: AOM download to Data Plane is stuck for more than 1800 seconds for obj[274354] type[21] pending-issue Req-delete Issued-none 'uRPF-list(hdl=0x5000021b)'
001207: Oct 4 17:10:08.820 BST: %FMFP-6-OBJ_DWNLD_TO_DP_RESUME: Switch 1 R0/0: fman_fp_image: AOM download of objects to Data Plane is back to normal
001208: Oct 4 18:10:08.814 BST: %FMFP-3-OBJ_DWNLD_TO_DP_STUCK: Switch 1 R0/0: fman_fp_image: AOM download to Data Plane is stuck for more than 1800 seconds for obj[274354] type[21] pending-issue Req-delete Issued-none 'uRPF-list(hdl=0x5000021b)'
001210: Oct 4 21:40:08.795 BST: %FMFP-6-OBJ_DWNLD_TO_DP_RESUME: Switch 1 R0/0: fman_fp_image: AOM download of objects to Data Plane is back to normal
001221: Oct 7 23:40:08.310 BST: %FMFP-3-OBJ_DWNLD_TO_DP_STUCK: Switch 1 R0/0: fman_fp_image: AOM download to Data Plane is stuck for more than 1800 seconds for obj[1939605] type[21] pending-issue Req-delete Issued-none 'uRPF-list(hdl=0x50000578)'
001222: Oct 8 03:40:08.281 BST: %FMFP-6-OBJ_DWNLD_TO_DP_RESUME: Switch 1 R0/0: fman_fp_image: AOM download of objects to Data Plane is back to normal
001223: Oct 8 10:40:08.234 BST: %FMFP-3-OBJ_DWNLD_TO_DP_STUCK: Switch 1 R0/0: fman_fp_image: AOM download to Data Plane is stuck for more than 1800 seconds for obj[2253953] type[21] pending-issue Req-delete Issued-none 'uRPF-list(hdl=0x500000d6)'
001224: Oct 8 11:10:08.232 BST: %FMFP-6-OBJ_DWNLD_TO_DP_RESUME: Switch 1 R0/0: fman_fp_image: AOM download of objects to Data Plane is back to normal

 

 

Checking the following Cisco doc i found this system error:

 

https://www.cisco.com/c/en/us/td/docs/ios-xml/ios/16_xe/smg/xe-16-10/b-sem-16-10-1/b-sem-16-10-1_chapter_010.html

 

%FMFP-3-OBJ_DWNLD_TO_DP_STUCK : AOM download of [chars] to Data Plane is stuck for more than [int] seconds
ExplanationAn object download from FMAN-FP to lower layer has taken long time. It can be caused by incomplete configuration or software defects
Recommended ActionRun show platform software object-manager fp [active|standby] [pending-issue-update|pending-issue-batch] sorted <min_pending_time> to see the sorted list of update/batch/ command in pending state for more than the min_pending_time. For incomplete configuration, use show platform platform software object fp [active|standby] resolve to see if there is any resolve object

 

 %FMFP-6-OBJ_DWNLD_TO_DP_RESUME : AOM download of objects to Data Plane is back to normal
ExplanationAn object download from FMAN-FP to lower layer has finished after a temporary stuck. It can be caused by incomplete configuration or software defects
Recommended Actioncheck if there is any functional impact after recovery

 

 

 

Using the commands in "Recommended Action" i don't get any conclusive idea if this cloud lead to a future problem or not.

 

<catalyst 9500># show platform software object-manager switch 1 R0 object-type-info | i RPF

Object type Name Count Del Pend Layer
------------------------------------------------------------------------------
RPF_CFG_IPV4 rpf_cfg_ipv4 0 0 24
RPF_CFG_IPV6 rpf_cfg_ipv6 0 0 24
RPF_LIST rpf_list 533 0 24
RPF_LOOSE_SDROP_IPV4 rpf_loose_sdrop_ipv4 0 0 24
RPF_LOOSE_SDROP_IPV6 rpf_loose_sdrop_ipv6 0 0 24

 

Note: The counter sometimes increment and other times decrement.

 

After search on the running-config for any feature related to RPF i found this four lines:

 

<catalyst 9500>#sh run all | i rpf

platform urpf loose counter ipv4 supress asymmetric_only
platform urpf loose counter ipv6 supress asymmetric_only
ipv6 multicast rpf use-bgp
ipv6 multicast vrf Mgmt-vrf rpf use-bgp

 

The software on the switch is:

 

Cisco IOS Software [Gibraltar], Catalyst L3 Switch Software (CAT9K_IOSXE), Version 16.11.1, RELEASE SOFTWARE (fc3)

BOOTLDR: System Bootstrap, Version 16.10.1r[FC1], RELEASE SOFTWARE (P)

 

 

Any one have a clue of what this is?

 

 

 

5 REPLIES 5
VIP Advocate

Re: C9500-16X - %FMFP-3-OBJ_DWNLD_TO_DP_STUCK: Switch 1 R0/0: fman_fp_image: AOM download to Data Plane is stuck for more than 1800 seconds for obj[2253953] type[21] pending-issue Req-delete Issued-none 'uRPF-list(hdl=0x500000d6)'

Hi,

Have you checked this bug CSCvn08705

https://bst.cloudapps.cisco.com/bugsearch/bug/CSCvn08705/?rfs=iqvred

Regards,
Deepak Kumar,
Don't forget to vote and accept the solution If this comment will make help you!
Everyone's tags (1)
Beginner

Re: C9500-16X - %FMFP-3-OBJ_DWNLD_TO_DP_STUCK: Switch 1 R0/0: fman_fp_image: AOM download to Data Plane is stuck for more than 1800 seconds for obj[2253953] type[21] pending-issue Req-delete Issued-none 'uRPF-list(hdl=0x500000d6)'

Yes i checked the bug that you refer, is related with QOS and the issue is related with uRPF-list.

The switch is running an 16.11.1 and the detailed notes of the bug show this release as a "Known Fixed Releases" so this bug is fixed on my code.

Any other ideia?
Hall of Fame Community Legend

Re: C9500-16X - %FMFP-3-OBJ_DWNLD_TO_DP_STUCK: Switch 1 R0/0: fman_fp_image: AOM download to Data Plane is stuck for more than 1800 seconds for obj[2253953] type[21] pending-issue Req-delete Issued-none 'uRPF-list(hdl=0x500000d6)'

Upgrade to the latest 16.12.X rebuild and see if the problem goes away.
Beginner

Re: C9500-16X - %FMFP-3-OBJ_DWNLD_TO_DP_STUCK: Switch 1 R0/0: fman_fp_image: AOM download to Data Plane is stuck for more than 1800 seconds for obj[2253953] type[21] pending-issue Req-delete Issued-none 'uRPF-list(hdl=0x500000d6)'

Hello Leo,

Reading the release notes of this version (16.12.1) i don't find any resolved Caveats related with this issue.

https://www.cisco.com/c/en/us/td/docs/switches/lan/catalyst9500/software/release/16-12/release_notes/ol-16-12-9500.html

Do you have any evidence that an upgrade to the code will solve this issue?





Highlighted
Hall of Fame Community Legend

Re: C9500-16X - %FMFP-3-OBJ_DWNLD_TO_DP_STUCK: Switch 1 R0/0: fman_fp_image: AOM download to Data Plane is stuck for more than 1800 seconds for obj[2253953] type[21] pending-issue Req-delete Issued-none 'uRPF-list(hdl=0x500000d6)'

Raise a TAC Case. 

Based on my experience Bug IDs are seldom and/or rarely updated (or accurate).

16.11.X is not a "stable" code. 

CreatePlease to create content
Content for Community-Ad
July's Community Spotlight Awards