ASR-1004 with ESP40 and SIP40 No more than 16GB of Traffic

Fernando Almondes · ‎05-21-2020

Hello,

Has anyone had a problem like this?

I have an ASR-1004 with ESP-40 and SIP-40 and the traffic comes when it reaches 16GB.

I have two port-channels, making 20GB of uplink and 20GB of downlink.

But the traffic is no more than 20GB.

The box is used for PPPoE and CGNAT.

Best regards,
Fernando

Giuseppe Larosa · ‎05-22-2020

Hello @Fernando Almondes ,

>> The box is used for PPPoE and CGNAT.

This can explain the reduced performance that you see on the device as both services use many resources and your scenario cannot be compared to simple routing where the device just performs packet rewrite between interfaces.

Hope to help

Giuseppe

Fernando Almondes · ‎05-22-2020

Hi Giuseppe Larosa,

I checked and even at peak times, the box does not show it is using high processing or memory.

The QFP works at a maximum of 60%.

And the processing itself is no more than 30% overall.

We increased the hold-queue, we have tried different versions of software, but nothing has resolved.

Best regards,
Fernando

Giuseppe Larosa · ‎05-22-2020

Hello @Fernando Almondes ,

I understand your point of view.

I tried to look at data sheet for performance data of CGNAT with no success.

At this point if this issue is causing an impact I would suggest to open a ticket with Cisco TAC and ask them if your performance are the expected ones or there is something that can be improved in the configuration if any.

if we look at the performance data we see that for example for encypted data the declared performance is lower then the stated performance for clear text traffic.

For CGNAT there can be a global max number of NAT sessions that can be supported at the same time and this might be the indirect reason for your limited troughtput.

Hope to help

Giuseppe

Leo Laohoo · ‎05-23-2020

What firmware is the router running on?

Fernando Almondes · ‎05-25-2020

Hello @Leo Laohoo,

The current version is: BRAS-1004 # show ver
Cisco IOS XE Software, Version 03.16.02b.S - Extended Support Release
Cisco IOS Software, ASR1000 Software (X86_64_LINUX_IOSD-ADVIPSERVICESK9_NOLI-M), Version 15.5 (3) S2b, RELEASE SOFTWARE (fc1)

In summary in the IOS tests we did, we obtained the following:

* asr1000rp2-advipservicesk9_noli.03.16.02b.S.155-3.S2b-ext.bin -> (2016)
- Bug with PPTP VPNs.
- It reached 16G, no more than that.

* asr1000rp2-adventerprisek9.03.16.10.S.155-3.S10-ext.bin -> (2019)
- Traffic hits when it arrives at around 14.5G.

* asr1000rpx86-universalk9.16.06.07.SPA.bin -> (2019)
- Traffic runs at exactly 14G.

ASR-1004
2x SIP-40
1x ESP-40

20GB port-channel for WAN
20GB port-channel for LAN

BRAS-1004#show platform
Chassis type: ASR1004

Slot Type State Insert time (ago)
--------- ------------------- --------------------- -----------------
0 ASR1000-SIP40 ok 4w6d
0/1 SPA-1X10GE-WL-V2 ok 4w6d
0/3 SPA-1X10GE-WL-V2 ok 4w6d
1 ASR1000-SIP40 ok 4w6d
1/1 SPA-1X10GE-WL-V2 ok 4w6d
1/2 SPA-1X10GE-WL-V2 ok 4w6d
R0 ASR1000-RP2 ok, active 4w6d
F0 ASR1000-ESP40 ok, active 4w6d
P0 ASR1004-PWR-AC ok 4w6d
P1 ASR1004-PWR-AC ok 4w6d

Slot CPLD Version Firmware Version
--------- ------------------- ---------------------------------------
0 00200800 16.2(1r)
1 00200800 15.3(3r)S
R0 14111801 16.2(1r)
F0 1003190E 15.0(1r)S

Best regards,
Fernando

Leo Laohoo · ‎05-25-2020

 0 00200800 16.2(1r)
 1 00200800 15.3(3r)S
R0 14111801 16.2(1r)
F0 1003190E 15.0(1r)S

The bootstrap of these components are way off.

Has anyone ever considered upgrading the bootstrap?

Fernando Almondes · ‎05-26-2020

Hello @Leo Laohoo,

Thanks for the answer.

We have already considered, but we did not imagine that it could be influencing.

I will perform the update, and return here.

Do you recommend a specific version of IOS and firmware?

Best regards,
Fernando

Leo Laohoo · ‎05-26-2020

16.12(8r).

Fernando Almondes · ‎05-26-2020

@Leo Laohoo,

Thanks for the answer.

Does any version of IOS specify?

Leo Laohoo · ‎05-26-2020

No, it is not specific to any version.
The ROMMON of the line cards have never been updated before (will require a reboot).
Might try that first and see if it makes any improvements.

maxthetor · ‎03-07-2021

Fernando ,

achou alguma solucao?

Tambem estou com o mesmo problema e ainda nao achei o solucao

Georg Pauwen · ‎03-08-2021

Hello,

can you post the output of:

show interfaces x

where 'x' are the physical member interfaces of the port channel ?

maxthetor · ‎03-08-2021

Yes. two interfaces in one port-channel.

--------------------------------------------

show interfaces TenGigabitEthernet 0/0/0
TenGigabitEthernet0/0/0 is up, line protocol is up
Hardware is SPA-1X10GE-L-V2, address is acf2.c5d3.80c0 (bia acf2.c5d3.8000)
Description: XXXXXXXXXXXXXXXXXXX
MTU 1500 bytes, BW 10000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 53/255, rxload 51/255
Encapsulation ARPA, loopback not set
Keepalive not supported
Full Duplex, 10000Mbps, link type is force-up, media type is 10GBase-SR
output flow-control is on, input flow-control is on
ARP type: ARPA, ARP Timeout 04:00:00
Last input never, output 00:00:00, output hang never
Last clearing of "show interface" counters 22w5d
Input queue: 0/4096/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/4096 (size/max)
5 minute input rate 2036457000 bits/sec, 276719 packets/sec
5 minute output rate 2106988000 bits/sec, 273590 packets/sec
4204832652909 packets input, 4249389538458807 bytes, 0 no buffer
Received 284556357 broadcasts (0 IP multicasts)
0 runts, 287156 giants, 0 throttles
154949444 input errors, 0 CRC, 0 frame, 154662290 overrun, 0 ignored
0 watchdog, 176322499 multicast, 0 pause input
4170487000896 packets output, 4249188650174686 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 10 pause output
0 output buffer failures, 0 output buffers swapped out

----------------------------------------------------------------------------

show interfaces TenGigabitEthernet 0/1/0
TenGigabitEthernet0/1/0 is up, line protocol is up
Hardware is SPA-1X10GE-L-V2, address is acf2.c5d3.80c0 (bia acf2.c5d3.8010)
Description: XXXXXXXXXXXXXXXXXXXXX
MTU 1500 bytes, BW 10000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 56/255, rxload 57/255
Encapsulation ARPA, loopback not set
Keepalive not supported
Full Duplex, 10000Mbps, link type is force-up, media type is 10GBase-SR
output flow-control is on, input flow-control is on
ARP type: ARPA, ARP Timeout 04:00:00
Last input 14w1d, output 00:00:06, output hang never
Last clearing of "show interface" counters 14w1d
Input queue: 0/4096/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/4096 (size/max)
5 minute input rate 2264164000 bits/sec, 298086 packets/sec
5 minute output rate 2214214000 bits/sec, 302087 packets/sec
2416624870795 packets input, 2434203744582999 bytes, 0 no buffer
Received 225086500 broadcasts (0 IP multicasts)
0 runts, 271632 giants, 0 throttles
147528599 input errors, 0 CRC, 0 frame, 147256967 overrun, 0 ignored
0 watchdog, 84854450 multicast, 0 pause input
2451040451240 packets output, 2467270267925581 bytes, 0 underruns
0 output errors, 0 collisions, 1 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out

-----------------------------------------------------------------

show interfaces port-channel1
Port-channel1 is up, line protocol is up
Hardware is 10GEChannel, address is acf2.c5d3.80c0 (bia acf2.c5d3.80c0)
Description: XXXXXXXXXXXXXXXXXX
MTU 1500 bytes, BW 20000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 55/255, rxload 55/255
Encapsulation 802.1Q Virtual LAN, Vlan ID 1., loopback not set
Keepalive set (10 sec)
ARP type: ARPA, ARP Timeout 04:00:00
No. of active members in this channel: 2
Member 0 : TenGigabitEthernet0/0/0 , Full-duplex, 10000Mb/s
Member 1 : TenGigabitEthernet0/1/0 , Full-duplex, 10000Mb/s
No. of PF_JUMBO supported members in this channel : 2
Last input 00:00:00, output never, output hang never
Last clearing of "show interface" counters 22w5d
Input queue: 0/8192/0/15 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/8192 (size/max)
5 minute input rate 4343833000 bits/sec, 581911 packets/sec
5 minute output rate 4367076000 bits/sec, 582231 packets/sec
6621072705594 packets input, 6683299205100560 bytes, 0 no buffer
Received 509645913 broadcasts (0 IP multicasts)
0 runts, 558788 giants, 0 throttles
302478043 input errors, 0 CRC, 0 frame, 301919257 overrun, 0 ignored
0 watchdog, 261178602 multicast, 0 pause input
6621585895417 packets output, 6716512093324311 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
451714 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out

Leo Laohoo · ‎03-08-2021

@maxthetor wrote:

TenGigabitEthernet0/0/0 is up, line protocol is up
 154949444 input errors, 0 CRC, 0 frame, 154662290 overrun, 0 ignored
TenGigabitEthernet0/1/0 is up, line protocol is up
 147528599 input errors, 0 CRC, 0 frame, 147256967 overrun, 0 ignored
Port-channel1 is up, line protocol is up
 302478043 input errors, 0 CRC, 0 frame, 301919257 overrun, 0 ignored

Hmmmm ... That's interesting.
NOTE: The counters were just cleared "22w5d" ago.