08-14-2014 08:23 AM - edited 03-04-2019 11:32 PM
Hi,
we are trying to fine tune the mls cef maximum-routes without success for ipv4 on our Cisco 7606 router equiped like this:
######################################################
Mod Ports Card Type Model Serial No.
--- ----- -------------------------------------- ------------------ -----------
2 24 CEF720 24 port 1000mb SFP WS-X6724-SFP SAL09169CP0
6 2 Supervisor Engine 720 (Active) WS-SUP720-3BXL SAL10370YH7
Mod MAC addresses Hw Fw Sw Status
--- ---------------------------------- ------ ------------ ------------ -------
2 0013.c38b.ed9c to 0013.c38b.edb3 2.2 12.2(14r)S5 12.2(33)SRC1 Ok
6 0017.9441.b750 to 0017.9441.b753 5.2 8.4(2) 12.2(33)SRC1 Ok
Mod Sub-Module Model Serial Hw Status
---- --------------------------- ------------------ ----------- ------- -------
2 Centralized Forwarding Card WS-F6700-CFC SAL09159C8T 2.0 Ok
6 Policy Feature Card 3 WS-F6K-PFC3BXL SAL10360CJ0 1.8 Ok
6 MSFC3 Daughterboard WS-SUP720 SAL10360GNX 2.5 Ok
###################################################################
the show version is like this:
##################################################################
System image file is "bootdisk:c7600s72033-adventerprisek9-mz.122-33.SRC1.bin"
##################################################################
We tryied to set the value of the ipv4 FIB TCAM to 720k with this command:
##################################################################
mls cef maximum-routes ip 720
##################################################################
and then to save the configuration we used the "write" command. This was the output after we wrote the configuration:
##################################################################
FIB TCAM maximum routes :
=======================
Current :-
-------
IPv4 + MPLS - 512k (default)
IPv6 + IP Multicast - 256k (default)
User configured :-
---------------
IPv4 - 720k
MPLS - 16k (default)
IPv6 + IP Multicast - 144k (default)
Upon reboot :-
-----------
IPv4 - 720k
MPLS - 16k (default)
IPv6 + IP Multicast - 144k (default)
###########################################################################
so we reloaded the router to get the new value.
when the router was up again it start to reload each 4 minutes. The FIB TCAM value was:
###########################################################################
show mls cef maximum-routes
Reload scheduled for 13:50:09 DST Wed Aug 13 2014 (in 2 minutes and 51 seconds)
Reload reason: FIB Protocol Allocation mismatchFIB TCAM maximum routes :
=======================
Current :-
-------
IPv4 + MPLS - 512k (default)
IPv6 + IP Multicast - 256k (default)
User configured :-
---------------
IPv4 + MPLS - 512k (default)
IPv6 + IP Multicast - 256k (default)
Upon reboot :-
-----------
IPv4 + MPLS - 512k (default)
IPv6 + IP Multicast - 256k (default)
###########################################################################
We know that our cisco is able to handle up to 1M of ipv4 routes inside the TCAM but we cannot set more than 512k ipv4 routes.
Why the router doesn't accept the new value?
Thanks
https://supportforums.cisco.com/discussion/12250356/recommended-value-7600-ipv4-fib-tcam
08-15-2014 04:25 AM
We are having exactly the same problem on a 6504 platform with SUP720-3BXL and 6748-SFP w/DFC 3, on 12.2(33)SXJ3.
sho mod
Mod Ports Card Type Model Serial No.
--- ----- -------------------------------------- ------------------ -----------
1 2 Supervisor Engine 720 (Active) WS-SUP720-3BXL
4 48 CEF720 48 port 1000mb SFP WS-X6748-SFP
Mod MAC addresses Hw Fw Sw Status
--- ---------------------------------- ------ ------------ ------------ -------
1 000f.9094.4464 to 000f.9094.4467 4.1 8.5(2) 12.2(33)SXJ3 Ok
4 588d.09e5.4c30 to 588d.09e5.4c5f 2.4 12.2(18r)S1 12.2(33)SXJ3 Ok
Mod Sub-Module Model Serial Hw Status
---- --------------------------- ------------------ ----------- ------- -------
1 Policy Feature Card 3 WS-F6K-PFC3BXL 1.4 Ok
1 MSFC3 Daughterboard WS-SUP720 2.2 Ok
4 Distributed Forwarding Card WS-F6700-DFC3BXL 5.2 Ok
Mod Online Diag Status
---- -------------------
1 Pass
4 Pass
Funny thing is we have another 6504 which has exactly the same cards, IOS etc. and that worked perfectly.
I can't think of anything that would be causing this:
sho mls cef max
Reload scheduled for 08:30:47 BST Sat Jun 10 2000 (in 1 minute and 54 seconds)
Reload reason: FIB Protocol Allocation mismatchFIB TCAM maximum routes :
=======================
Current :-
-------
IPv4 + MPLS - 512k (default)
IPv6 + IP Multicast - 256k (default)
sho run | sec mls
mls netflow interface
mls rate-limit unicast cef receive 10000 100
mls cef error action reset
mls cef maximum-routes ip 600
08-15-2014 04:25 AM
Hi express17187,
Do you know the difference between the running-config of the switchs?
Did they get the same configuration?
thanks
08-15-2014 04:50 AM
They are nearly identical! Single BGP session with different providers, and HSRP for gateway reundancy, but apart from that exactly the same.
*edit* I do have the following line on the working platfom:
diagnostic bootup level minimal
Which I don't on the platform that keeps reloading, I doubt it could be this though?
Now when we first had this issue we had a 10G line card in the offeneding platform that was powered off due the card not havening enough memory (was a 3B, not 3BXL). Although this was powered off we thought this might be causing the issue, mismatch in hardware or something.
I have removed the card and the cleared the config for that linecard, and gave it another go. Exactly the same results.
Strange...
09-02-2014 05:31 PM
Hello Guys,
Problem here is your config register or RP and SP not same and that is the reason you are getting mismtach error. Refer the below details that I have pasted in my first reply where I asked for the show version from both RP and SP.
"
The protocol allocation information is distributed from RP to DFCs and SP. Active SP also gets this information through the rommon variable TYFIB_BLOCK_ALLOC. So, when RP sends the message about protocol allocation, SP will verify the data against the values stored in the rommon variable. SP and RP config registers should be the same else it will throw the miss match. If SP detects a mismatch, it will throw a "FIB Protocol Allocations Mismatch"error. On older IOS versions, this might result in reload of the active.To remedy the issue, reconfigure the maximum routes and reload the box after saving the config.
Note: It is recommended not to save the config after issuing "no mls cef maximum routes". This is because, when this command is issued, RP sets the values to their default but SP rommon is not written. So, on reload, SP will detect the mismatch and throw the error."
Hope it resolved your query.
Thanks & Regards
Sandeep
08-18-2014 07:33 PM
08-19-2014 12:37 AM
HI,
did you try to set manually ipv6 and multicast and let decide the router for the rest? I mean just like this....example:
mls cef maximum-routes ipv6 128
mls cef maxixum-routes ip-multicast 16
thanks
--
paolo
08-19-2014 01:14 AM
We tried this, and an number of other combinations with no luck.
We are currently running 12.2(33)SXJ3 and we may upgrade to 12.2(33)SXI13 to see if that fixes the issue.
I hope this isn't a hardware issue.
08-19-2014 07:05 AM
thanks for your answer.
please, let me know if you solve the problem upgrading to 12.2(33)SXI13.
--
paolo
08-24-2014 05:59 AM
Upgraded to, Version 12.2(33)SXI13. Still the same problem.
Any other ideas?!
Reload scheduled for 22:46:28 BST Mon Jun 19 2000 (in 4 minutes and 29 seconds)
Reload reason: FIB Protocol Allocation mismatchFIB TCAM maximum routes :
=======================
Current :-
-------
IPv4 + MPLS - 512k (default)
IPv6 + IP Multicast - 256k (default)
09-01-2014 03:16 PM
Sucess!
So we noticed the HW and FW versions of routers elsewhere in the network were 5.2 (HW) and 8.5(2) (FW) or higher.
The device we were having trouble with has HW4.1 and FW 8.5(2).
We swapped out the SUP for one with a newer hardware revision and firmware and volia. It took the command perfectly. Our current setup is as follows:
Mod Ports Card Type Model Serial No.
--- ----- -------------------------------------- ------------------ -----------
1 2 Supervisor Engine 720 (Active) WS-SUP720-3BXL
4 48 CEF720 48 port 1000mb SFP WS-X6748-SFP
Mod MAC addresses Hw Fw Sw Status
--- ---------------------------------- ------ ------------ ------------ -------
1 0013.7f0d.8b58 to 0013.7f0d.8b5b 4.3 8.5(4) 12.2(33)SXI1 Ok
4 588d.09e5.4c30 to 588d.09e5.4c5f 2.4 12.2(18r)S1 12.2(33)SXI1 Ok
Mod Sub-Module Model Serial Hw Status
---- --------------------------- ------------------ ----------- ------- -------
1 Policy Feature Card 3 WS-F6K-PFC3BXL 1.6 Ok
1 MSFC3 Daughterboard WS-SUP720 2.3 Ok
4 Distributed Forwarding Card WS-F6700-DFC3BXL 5.2 Ok
Mod Online Diag Status
---- -------------------
1 Pass
4 Pass
So it seems that anything higher than 4.3 works, I can't comment for 4.2.
The issue seems to be with the hardware revision and/or firmware.
Hope this helps others.
09-02-2014 08:39 AM
well done :).
Can you please share the output of the below command:
+ show version
+ remote command switch show version
thanks for your help.
--
paolo
09-02-2014 08:43 AM
Hi Paolo,
#sho ver
Cisco IOS Software, s72033_rp Software (s72033_rp-ADVENTERPRISEK9_WAN-M), Version 12.2(33)SXI13, RELEASE SOFTWARE (fc3)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2014 by Cisco Systems, Inc.
Compiled Tue 11-Mar-14 04:53 by prod_rel_team
ROM: System Bootstrap, Version 12.2(17r)S2, RELEASE SOFTWARE (fc1)
punk.gs2 uptime is 17 hours, 55 minutes
Uptime for this control processor is 17 hours, 55 minutes
Time since punk.gs2 switched to active is 17 hours, 54 minutes
System returned to ROM by reload at 22:32:30 BST Mon Sep 1 2014 (SP by reload)
System restarted at 22:35:24 BST Mon Sep 1 2014
System image file is "disk0:s72033-adventerprisek9_wan-mz.122-33.SXI13.bin"
Last reload reason: Reload Command
This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.
A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html
If you require further assistance please contact us by sending email to
export@cisco.com.
cisco WS-C6504-E (R7000) processor (revision 2.0) with 983008K/65536K bytes of memory.
Processor board ID FOX11270F1B
SR71000 CPU at 600Mhz, Implementation 0x504, Rev 1.2, 512KB L2 Cache
Last reset from power-on
11 Virtual Ethernet interfaces
50 Gigabit Ethernet interfaces
1917K bytes of non-volatile configuration memory.
8192K bytes of packet buffer memory.
65536K bytes of Flash internal SIMM (Sector size 512K).
Configuration register is 0x2102
#remote command switch show version
Cisco IOS Software, s72033_sp Software (s72033_sp-ADVENTERPRISEK9_WAN-M), Version 12.2(33)SXI13, RELEASE SOFTWARE (fc3)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2014 by Cisco Systems, Inc.
Compiled Tue 11-Mar-14 05:09 by prod_rel_team
ROM: System Bootstrap, Version 8.5(4)
punk.gs2 uptime is 17 hours, 55 minutes
Time since punk.gs2 switched to active is 17 hours, 55 minutes
System returned to ROM by reload at 22:32:30 BST Mon Sep 1 2014
System restarted at 22:34:17 BST Mon Sep 1 2014
System image file is "disk0:s72033-adventerprisek9_wan-mz.122-33.SXI13.bin"
Last reload reason: Reload Command
cisco Catalyst 6000 (R7000) processor with 983008K/65536K bytes of memory.
Processor board ID FOX11270F1B
SR71000 CPU at 600Mhz, Implementation 0x504, Rev 1.2, 512KB L2 Cache
Last reset from s/w reset
50 Gigabit Ethernet interfaces
1917K bytes of non-volatile configuration memory.
8192K bytes of packet buffer memory.
500472K bytes of ATA PCMCIA card at slot 0 (Sector size 512 bytes).
65536K bytes of Flash internal SIMM (Sector size 512K).
Configuration register is 0x2102
Hope that helps.
09-02-2014 09:36 AM
Hi express17187,
for our side the problem was so simple (or at least we think so). You have your config_register set to:
#sho ver
Configuration register is 0x2102
#remote command switch show version
Configuration register is 0x2102
and that's correct.
Instead we have our config_register set like this:
GW-XXX#show version
Configuration register is 0x2102
GW-XXX#remote command switch show version
Configuration register is 0x2142
they are not set to the same value and that's why we are getting miss match message. As Cisco (sanshar4) said:
" SP and RP config registers should be the same else it will throw the miss match."
Probably this was your problem too. We have no idea why the config_register is set like this. We have other routers and the values are set to 0x2102. This is the only router set with different config_register value.
We didn't try to change it but we are going to try in a short time.
thanks again for your support.
--
paolo
09-01-2014 07:01 PM
Hi,
Can you please share the output of the below commands:
+ show version
+ remote command switch show version
+ show module
+ show log
+ show mls cef summary
+ show mls cef max
::::
The protocol allocation information is distributed from RP to DFCs and SP. Active SP also gets this information through the rommon variable TYFIB_BLOCK_ALLOC. So, when RP sends the message about protocol allocation, SP will verify the data against the values stored in the rommon variable. SP and RP config registers should be the same else it will throw the miss match. If SP detects a mismatch, it will throw a "FIB Protocol Allocations Mismatch"error. On older IOS versions, this might result in reload of the active.To remedy the issue, reconfigure the maximum routes and reload the box after saving the config.
Note: It is recommended not to save the config after issuing "no mls cef maximum routes". This is because, when this command is issued, RP sets the values to their default but SP rommon is not written. So, on reload, SP will detect the mismatch and throw the error.
Thanks & regards
Sandeep
Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: