06-04-2019 10:23 PM - edited 06-04-2019 11:17 PM
ISR4451-X/K9, Fuji-16.9.3 MD based, two ISPs via BGP connected - unable to fill BGP table (it hangs, when about get 600k prefixes and throwing famous PLATFORM_INFRA-5-IOS_INTR_OVER_LIMIT twice a row.)
Jun 5 06:48:24: %PLATFORM_INFRA-5-IOS_INTR_OVER_LIMIT: IOS thread disabled interrupt for 14 msec
-Traceback= 1#0b114a08bdbd3e456bac12840fb612b6 :56522655F000+67EFF69 :56522655F000+77CC9B1 :56522655F000+3AD1727 :56522655F000+4905D0D :56522655F000+4906897 :56522655F000+49053D3 :56522655F000+48FC81A :56522655F000+7D9608E :56522655F000+7D96C53 :56522655F000+7DBE064 :56522655F000+7D9F24B
Jun 5 06:48:31: %PLATFORM_INFRA-5-IOS_INTR_OVER_LIMIT: IOS thread disabled interrupt for 11 msec
-Traceback= 1#0b114a08bdbd3e456bac12840fb612b6 :56522655F000+67EFF69 :56522655F000+67BE980 :56522655F000+77CC9C5 iosd_shr_m_uk9_CDP_Core_crb:7F4E9BD4F000+30649 iosd_shr_m_uk9_CDP_Core_crb:7F4E9BD4F000+2D126 iosd_shr_m_uk9_CDP_Core_crb:7F4E9BD4F000+2C58F iosd_shr_m_uk9_CDP_Core_crb:7F4E9BD4F000+2B3F3
# show ip bgp sum (seconds before hangs and throwing errors)
BGP router identifier x.x.x.x, local AS number yyyyy
BGP table version is 786077, main routing table version 785624
593415 network entries using 147166920 bytes of memory
1992233 path entries using 270943688 bytes of memory
225686/72969 BGP path/bestpath attribute entries using 63192080 bytes of memory
96096 BGP AS-PATH entries using 4990968 bytes of memory
1 BGP ATTR_SET entries using 40 bytes of memory
6253 BGP community entries using 637046 bytes of memory
155 BGP extended community entries using 6174 bytes of memory
112844 BGP route-map cache entries using 7222016 bytes of memory
63949 BGP filter-list cache entries using 2046368 bytes of memory
BGP using 496205260 total bytes of memory
996116 received paths for inbound soft reconfiguration
BGP activity 594820/0 prefixes, 2000569/0 paths, scan interval 60 secs
sh ver (after reload and no peers connected)
cisco ISR4451-X/K9 (2RU) processor with 1784679K/6147K bytes of memory.
Processor board ID FGL2150816T
4 Gigabit Ethernet interfaces
32768K bytes of non-volatile configuration memory.
4194304K bytes of physical memory.
6598655K bytes of flash memory at bootflash:.
Solved! Go to Solution.
06-05-2019 03:56 AM - edited 06-05-2019 10:18 PM
This router has 2 GB of DRAM for the data plane, 4 GB of DRAM for the control plane.
I upgraded to 4GB for data plane and 8GB control plane and I tried next morning (in maintenance window)
With 8GB control plane memory it works fine.
#show memory platform
Virtual memory : 57069338624
Pages resident : 1394638
Major page faults: 3958
Minor page faults: 2269781
Architecture : x86_64
Memory (kB)
Physical : 8094348
Total : 8094348
Used : 5017796
Free : 3076552
Active : 4584796
Inactive : 1465376
Inact-dirty : 0
Inact-clean : 0
Dirty : 0
AnonPages : 3290772
Bounce : 0
Cached : 2473248
Commit Limit : 4047172
Committed As : 4477676
PS: It is ridiculous that in this router (ISR4451-X/K9) BGP and routing has to use so much memory. I have tested different linux-based router (Ubiquiti Edgerouter Pro) with 2GB ram and it is able to get and maintain BGP table from two peers and works ... (I didn't have to mention that the old 2921,with 1GB onboard, only needs about 320-340 MB for that)
06-05-2019 03:56 AM - edited 06-05-2019 10:18 PM
This router has 2 GB of DRAM for the data plane, 4 GB of DRAM for the control plane.
I upgraded to 4GB for data plane and 8GB control plane and I tried next morning (in maintenance window)
With 8GB control plane memory it works fine.
#show memory platform
Virtual memory : 57069338624
Pages resident : 1394638
Major page faults: 3958
Minor page faults: 2269781
Architecture : x86_64
Memory (kB)
Physical : 8094348
Total : 8094348
Used : 5017796
Free : 3076552
Active : 4584796
Inactive : 1465376
Inact-dirty : 0
Inact-clean : 0
Dirty : 0
AnonPages : 3290772
Bounce : 0
Cached : 2473248
Commit Limit : 4047172
Committed As : 4477676
PS: It is ridiculous that in this router (ISR4451-X/K9) BGP and routing has to use so much memory. I have tested different linux-based router (Ubiquiti Edgerouter Pro) with 2GB ram and it is able to get and maintain BGP table from two peers and works ... (I didn't have to mention that the old 2921,with 1GB onboard, only needs about 320-340 MB for that)
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide