cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
3010
Views
5
Helpful
15
Replies

cisco 7606 FIB Protocol Allocation mismatch after mls cef maximum-routes command

paolo liberati
Level 1
Level 1

Hi,

we are trying to fine tune the mls cef maximum-routes without success for ipv4 on our Cisco 7606 router equiped like this:

 

######################################################

Mod Ports Card Type                              Model              Serial No.
--- ----- -------------------------------------- ------------------ -----------
  2   24  CEF720 24 port 1000mb SFP              WS-X6724-SFP       SAL09169CP0
  6    2  Supervisor Engine 720 (Active)         WS-SUP720-3BXL     SAL10370YH7

Mod MAC addresses                       Hw    Fw           Sw           Status
--- ---------------------------------- ------ ------------ ------------ -------
  2  0013.c38b.ed9c to 0013.c38b.edb3   2.2   12.2(14r)S5  12.2(33)SRC1 Ok
  6  0017.9441.b750 to 0017.9441.b753   5.2   8.4(2)       12.2(33)SRC1 Ok

Mod  Sub-Module                  Model              Serial       Hw     Status 
---- --------------------------- ------------------ ----------- ------- -------
  2  Centralized Forwarding Card WS-F6700-CFC       SAL09159C8T  2.0    Ok
  6  Policy Feature Card 3       WS-F6K-PFC3BXL     SAL10360CJ0  1.8    Ok
  6  MSFC3 Daughterboard         WS-SUP720          SAL10360GNX  2.5    Ok

###################################################################

 

the show version is like this:

 

##################################################################

System image file is "bootdisk:c7600s72033-adventerprisek9-mz.122-33.SRC1.bin"

##################################################################

 

We tryied to set the value of the ipv4 FIB TCAM to 720k with this command:

 

##################################################################

mls cef maximum-routes ip 720

##################################################################

 

and then to save the configuration we used the "write" command. This was the output after we wrote the configuration:

 

##################################################################

FIB TCAM maximum routes :
=======================
Current :-
-------
 IPv4 + MPLS         - 512k (default)
 IPv6 + IP Multicast - 256k (default)

User configured :-
---------------
 IPv4                - 720k
 MPLS                - 16k (default)
 IPv6 + IP Multicast - 144k (default)

Upon reboot :-
-----------
 IPv4                - 720k
 MPLS                - 16k (default)
 IPv6 + IP Multicast - 144k (default)

###########################################################################

 

so we reloaded the router to get the new value.

when the router was up again it start to reload each 4 minutes. The FIB TCAM value was:

 

###########################################################################

show mls cef maximum-routes

Reload scheduled for 13:50:09 DST Wed Aug 13 2014 (in 2 minutes and 51 seconds)
Reload reason: FIB Protocol Allocation mismatchFIB TCAM maximum routes :
=======================
Current :-
-------
 IPv4 + MPLS         - 512k (default)
 IPv6 + IP Multicast - 256k (default)

User configured :-
---------------
 IPv4 + MPLS         - 512k (default)
 IPv6 + IP Multicast - 256k (default)

Upon reboot :-
-----------
 IPv4 + MPLS         - 512k (default)
 IPv6 + IP Multicast - 256k (default)

###########################################################################

 

We know that our cisco is able to handle up to 1M of ipv4 routes inside the TCAM but we cannot set more than 512k ipv4 routes.

Why the router doesn't accept the new value?

Thanks

http://www.cisco.com/c/en/us/support/docs/switches/catalyst-6500-series-switches/117712-problemsolution-cat6500-00.html

http://www.cisco.com/c/en/us/support/docs/switches/catalyst-6500-series-switches/116132-problem-catalyst6500-00.html

https://supportforums.cisco.com/discussion/12250356/recommended-value-7600-ipv4-fib-tcam

15 Replies 15

express17187
Level 1
Level 1

We are having exactly the same problem on a 6504 platform with SUP720-3BXL and 6748-SFP w/DFC 3, on 12.2(33)SXJ3.

sho mod
Mod Ports Card Type                              Model              Serial No.
--- ----- -------------------------------------- ------------------ -----------
  1    2  Supervisor Engine 720 (Active)         WS-SUP720-3BXL     
  4   48  CEF720 48 port 1000mb SFP              WS-X6748-SFP       

Mod MAC addresses                       Hw    Fw           Sw           Status
--- ---------------------------------- ------ ------------ ------------ -------
  1  000f.9094.4464 to 000f.9094.4467   4.1   8.5(2)       12.2(33)SXJ3 Ok
  4  588d.09e5.4c30 to 588d.09e5.4c5f   2.4   12.2(18r)S1  12.2(33)SXJ3 Ok

Mod  Sub-Module                  Model              Serial       Hw     Status 
---- --------------------------- ------------------ ----------- ------- -------
  1  Policy Feature Card 3       WS-F6K-PFC3BXL     1.4    Ok
  1  MSFC3 Daughterboard         WS-SUP720          2.2    Ok
  4  Distributed Forwarding Card WS-F6700-DFC3BXL   5.2    Ok

Mod  Online Diag Status 
---- -------------------
  1  Pass
  4  Pass

 

Funny thing is we have another 6504 which has exactly the same cards, IOS etc. and that worked perfectly.

 

I can't think of anything that would be causing this:

sho mls cef max

Reload scheduled for 08:30:47 BST Sat Jun 10 2000 (in 1 minute and 54 seconds)
Reload reason: FIB Protocol Allocation mismatchFIB TCAM maximum routes :
=======================
Current :-
-------
 IPv4 + MPLS         - 512k (default)
 IPv6 + IP Multicast - 256k (default)


sho run | sec mls
mls netflow interface
mls rate-limit unicast cef receive 10000 100
mls cef error action reset
mls cef maximum-routes ip 600

 

Hi express17187,

Do you know the difference between the running-config of the switchs?

Did they get the same configuration?

thanks

They are nearly identical! Single BGP session with different providers, and HSRP for gateway reundancy, but apart from that exactly the same. 

 

*edit* I do have the following line on the working platfom:

 

diagnostic bootup level minimal

 

Which I don't on the platform that keeps reloading, I doubt it could be this though?

 

Now when we first had this issue we had a 10G line card in the offeneding platform that was powered off due the card not havening enough memory (was a 3B, not 3BXL). Although this was powered off we thought this might be causing the issue, mismatch in hardware or something.

 

I have removed the card and the cleared the config for that linecard, and gave it another go. Exactly the same results. 

 

Strange...

Hello Guys,

 

Problem here is your config register or RP and SP not same and that is the reason you are getting mismtach error. Refer the below details that I have pasted in my first reply where I asked for the show version from both RP and SP.

"

The protocol allocation information is distributed from RP to DFCs and SP. Active SP also gets this information through the rommon variable TYFIB_BLOCK_ALLOC. So, when RP sends the message about protocol allocation, SP will verify the data against the values stored in the rommon variable. SP and RP config registers should be the same else it will throw the miss match. If SP detects a mismatch, it will throw a "FIB Protocol Allocations Mismatch"error. On older IOS versions, this might result in reload of the active.To remedy the issue, reconfigure the maximum routes and reload the box after saving the config.

 

Note: It is recommended not to save the config after issuing "no mls cef maximum routes". This is because, when this command is issued, RP sets the values to their default but SP rommon is not written. So, on reload, SP will detect the mismatch and throw the error."

 

Hope it resolved your query.

 

Thanks & Regards

Sandeep

La Quy Phai
Level 1
Level 1
Hi everynone
i had the same problem with my Cisco Router 7609 with SUP 7203BXL, i try to change the maximum of ip route to 768k. 
Reload scheduled in 4 minutes and 59 seconds
Reload reason: FIB Protocol Allocation mismatchFIB TCAM maximum routes :

At the begining, i think it had problem with memory and i replaced DRAM, but the issue still appearing
After that i must change the new SUP for resolving it.
Anyone had a suggestion about this case and has any problem about hardware?
Thank
Dautroc

HI,

did you try to set manually ipv6 and multicast and let decide the router for the rest? I mean just like this....example:

mls cef maximum-routes ipv6 128

mls cef maxixum-routes ip-multicast 16

thanks

--

paolo

We tried this, and an number of other combinations with no luck.

We are currently running 12.2(33)SXJ3 and we may upgrade to 12.2(33)SXI13 to see if that fixes the issue.

I hope this isn't a hardware issue.

thanks for your answer.

please, let me know if you solve the problem upgrading to 12.2(33)SXI13.

--

paolo

Upgraded to, Version 12.2(33)SXI13. Still the same problem. 

 

Any other ideas?!

Reload scheduled for 22:46:28 BST Mon Jun 19 2000 (in 4 minutes and 29 seconds)

Reload reason: FIB Protocol Allocation mismatchFIB TCAM maximum routes :

=======================

Current :-

-------

IPv4 + MPLS         - 512k (default)

IPv6 + IP Multicast - 256k (default)

Sucess!

 

So we noticed the HW and FW versions of routers elsewhere in the network were 5.2 (HW) and 8.5(2)  (FW) or higher. 


The device we were having trouble with has HW4.1 and FW 8.5(2).

 

We swapped out the SUP for one with a newer hardware revision and firmware and volia. It took the command perfectly. Our current setup is as follows:

 

Mod Ports Card Type                              Model              Serial No.
--- ----- -------------------------------------- ------------------ -----------
  1    2  Supervisor Engine 720 (Active)         WS-SUP720-3BXL     
  4   48  CEF720 48 port 1000mb SFP              WS-X6748-SFP       

Mod MAC addresses                       Hw    Fw           Sw           Status
--- ---------------------------------- ------ ------------ ------------ -------
  1  0013.7f0d.8b58 to 0013.7f0d.8b5b   4.3   8.5(4)       12.2(33)SXI1 Ok
  4  588d.09e5.4c30 to 588d.09e5.4c5f   2.4   12.2(18r)S1  12.2(33)SXI1 Ok

Mod  Sub-Module                  Model              Serial       Hw     Status 
---- --------------------------- ------------------ ----------- ------- -------
  1  Policy Feature Card 3       WS-F6K-PFC3BXL     1.6    Ok
  1  MSFC3 Daughterboard         WS-SUP720          2.3    Ok
  4  Distributed Forwarding Card WS-F6700-DFC3BXL   5.2    Ok

 

Mod  Online Diag Status 
---- -------------------
  1  Pass
  4  Pass

 

So it seems that anything higher than 4.3 works, I can't comment for 4.2.

The issue seems to be with the hardware revision and/or firmware.

 

Hope this helps others.

Hi express17187,

well done :).

Can you please share the output of the below command:

+ show version
+ remote command switch show version

thanks for your help.

--

paolo

Hi Paolo,

 

#sho ver
Cisco IOS Software, s72033_rp Software (s72033_rp-ADVENTERPRISEK9_WAN-M), Version 12.2(33)SXI13, RELEASE SOFTWARE (fc3)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2014 by Cisco Systems, Inc.
Compiled Tue 11-Mar-14 04:53 by prod_rel_team

ROM: System Bootstrap, Version 12.2(17r)S2, RELEASE SOFTWARE (fc1)

 punk.gs2 uptime is 17 hours, 55 minutes
Uptime for this control processor is 17 hours, 55 minutes
Time since punk.gs2 switched to active is 17 hours, 54 minutes
System returned to ROM by reload at 22:32:30 BST Mon Sep 1 2014 (SP by reload)
System restarted at 22:35:24 BST Mon Sep 1 2014
System image file is "disk0:s72033-adventerprisek9_wan-mz.122-33.SXI13.bin"
Last reload reason: Reload Command

 

This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to
export@cisco.com.

cisco WS-C6504-E (R7000) processor (revision 2.0) with 983008K/65536K bytes of memory.
Processor board ID FOX11270F1B
SR71000 CPU at 600Mhz, Implementation 0x504, Rev 1.2, 512KB L2 Cache
Last reset from power-on
11 Virtual Ethernet interfaces
50 Gigabit Ethernet interfaces
1917K bytes of non-volatile configuration memory.
8192K bytes of packet buffer memory.

65536K bytes of Flash internal SIMM (Sector size 512K).
Configuration register is 0x2102

 

#remote command switch show version
Cisco IOS Software, s72033_sp Software (s72033_sp-ADVENTERPRISEK9_WAN-M), Version 12.2(33)SXI13, RELEASE SOFTWARE (fc3)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2014 by Cisco Systems, Inc.
Compiled Tue 11-Mar-14 05:09 by prod_rel_team

ROM: System Bootstrap, Version 8.5(4)

 punk.gs2 uptime is 17 hours, 55 minutes
Time since punk.gs2 switched to active is 17 hours, 55 minutes
System returned to ROM by reload at 22:32:30 BST Mon Sep 1 2014
System restarted at 22:34:17 BST Mon Sep 1 2014
System image file is "disk0:s72033-adventerprisek9_wan-mz.122-33.SXI13.bin"
Last reload reason: Reload Command


cisco Catalyst 6000 (R7000) processor with 983008K/65536K bytes of memory.
Processor board ID FOX11270F1B
SR71000 CPU at 600Mhz, Implementation 0x504, Rev 1.2, 512KB L2 Cache
Last reset from s/w reset
50 Gigabit Ethernet interfaces
1917K bytes of non-volatile configuration memory.
8192K bytes of packet buffer memory.
          
500472K bytes of ATA PCMCIA card at slot 0 (Sector size 512 bytes).
65536K bytes of Flash internal SIMM (Sector size 512K).
Configuration register is 0x2102

 

Hope that helps.

Hi express17187,

for our side the problem was so simple (or at least we think so). You have your config_register set to:

#sho ver

Configuration register is 0x2102

#remote command switch show version

Configuration register is 0x2102

and that's correct.

Instead we have our config_register set like this:

GW-XXX#show version

Configuration register is 0x2102

GW-XXX#remote command switch show version

Configuration register is 0x2142

they are not set to the same value and that's why we are getting  miss match message. As Cisco (sanshar4) said:

" SP and RP config registers should be the same else it will throw the miss match."

Probably this was your problem too. We have no idea why the config_register is set like this. We have other routers and the values are set to 0x2102. This is the only router set with different config_register value.

We didn't try to change it but we are going to try in a short time.

thanks again for your support.

--

paolo

 

 

 

 

 

Sandeep Sharma
Cisco Employee
Cisco Employee

Hi,

Can you please share the output of the below commands:

+ show version
+ remote command switch show version
+ show module
+ show log
+ show mls cef summary
+ show mls cef max

:::: 

The protocol allocation information is distributed from RP to DFCs and SP. Active SP also gets this information through the rommon variable TYFIB_BLOCK_ALLOC. So, when RP sends the message about protocol allocation, SP will verify the data against the values stored in the rommon variable. SP and RP config registers should be the same else it will throw the miss match. If SP detects a mismatch, it will throw a "FIB Protocol Allocations Mismatch"error. On older IOS versions, this might result in reload of the active.To remedy the issue, reconfigure the maximum routes and reload the box after saving the config.

 

Note: It is recommended not to save the config after issuing "no mls cef maximum routes". This is because, when this command is issued, RP sets the values to their default but SP rommon is not written. So, on reload, SP will detect the mismatch and throw the error.

 

Thanks & regards

Sandeep

 

Getting Started

Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: