Solved: Application Interface Running Slow on MPLS

nasdaq123 · ‎06-02-2017

Evening All,

We have an MPLS Core Which has connection to 3 sites and a Datacentre. the datacentre is where the Database Server sits for this application Database which uses Interbase XE7, this a Borland Database which is SQL92 compliant, the application seems to work fine from Monday to Tuesday but from Wednesday onwards as there is more data going across to the database server, the transmission starts to slow down from clients to server with connection to the databse dropping on some of the clients at times. The network 1GB bandwidth over 1GB bearer line, this was the requirement from the supplier.. Our MPLS uses BGP protocol to route traffic.

We have done everything possible on the network but we cannot see any issues with the network. could it be that the database has limitations with BGP routing. We did a wireshark trace as well and noticed that the DB was refusing incoming connections when it was very busy. is there anything else we can do on the network to stop the slowness and the dropouts. we had discussed the idea of keep alive with the suppliers but they cannot do that.

Thanks

Reza Sharifi · ‎06-03-2017

Hi,

On a Gig interface, 500-600Mb of traffic is not bad at all and so there is enough bandwidth for the DB to use. I think the issue is application related and not so much the switch or the LAN environment.

HTH

View solution in original post

Reza Sharifi · ‎06-02-2017

Hi,

Do you any QOS deployed anywhere on the path?

If you did a Wireshark and the DB is refusing connection then that is a limitation on the data base.

When the network is busy and this happens, what is the amount of traffic on the 1Gig link?

HTH

nasdaq123 · ‎06-03-2017

Hi,

There is Qos on the network as it might impact the other services, what we have done on the Local LAN is to create VLANs, Thsi Interface has it's own VLAN which connect to the Database server at the Datacentre

The max amount of the traffic is usually around 500-600MB and the latency is 3ms

Thanks

Yemi

Reza Sharifi · ‎06-03-2017

Hi,

On a Gig interface, 500-600Mb of traffic is not bad at all and so there is enough bandwidth for the DB to use. I think the issue is application related and not so much the switch or the LAN environment.

HTH

Georg Pauwen · ‎06-03-2017

Hello,

in addition to Reza's suggestions, you also might want to check MTU settings (MPLS is usually higher than the standard 1500).

Can you post the running config of the router facing the MPLS core ?

nasdaq123 · ‎06-15-2017

Hi,

Sorry have been busy, please see the routers both the core and site as requested

CE WAN port

GigabitEthernet0/0/1 is up, line protocol is up

Hardware is ISR4431-X-4x1GE, address is d8b1.90eb.9051 (bia d8b1.90eb.9051)

Description: ***CEW009274 - Fibre WAN Link - 1Gb/1Gb******

Internet address is 172.18.1.2/30

MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,

reliability 255/255, txload 1/255, rxload 6/255

Encapsulation ARPA, loopback not set

Keepalive not supported

Full Duplex, 1000Mbps, link type is auto, media type is SX

output flow-control is off, input flow-control is off

ARP type: ARPA, ARP Timeout 04:00:00

Last input 01:03:38, output 00:00:35, output hang never

Last clearing of "show interface" counters never

Input queue: 0/375/0/0 (size/max/drops/flushes); Total output drops: 0

Queueing strategy: Class-based queueing

Output queue: 0/40 (size/max)

5 minute input rate 25673000 bits/sec, 4179 packets/sec

5 minute output rate 4658000 bits/sec, 3086 packets/sec

3518513005 packets input, 2567544396268 bytes, 0 no buffer

Received 0 broadcasts (0 IP multicasts)

0 runts, 0 giants, 0 throttles

0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored

0 watchdog, 0 multicast, 0 pause input

2654766208 packets output, 542848336049 bytes, 0 underruns

0 output errors, 0 collisions, 1 interface resets

0 unknown protocol drops

0 babbles, 0 late collision, 0 deferred

0 lost carrier, 0 no carrier, 0 pause output

0 output buffer failures, 0 output buffers swapped out

Protocol status

#show ip int br

Interface IP-Address OK? Method Status Protocol

GigabitEthernet0/0/0 unassigned YES NVRAM up up

GigabitEthernet0/0/0.1 172.18.6.3 YES NVRAM up up

Gi0/0/0.10 192.168.110.1 YES NVRAM up up

Gi0/0/0.99 192.168.113.1 YES NVRAM up up

Gi0/0/0.100 192.168.111.1 YES NVRAM up up

Gi0/0/0.110 192.168.112.1 YES NVRAM up up

Gi0/0/0.130 192.168.114.1 YES NVRAM up up

Gi0/0/0.140 192.168.115.1 YES NVRAM up up

GigabitEthernet0/0/1 172.18.1.2 YES NVRAM up up

GigabitEthernet0/0/2 unassigned YES NVRAM administratively down down

GigabitEthernet0/0/3 unassigned YES NVRAM administratively down down

ATM0/1/0 unassigned YES NVRAM up up

ATM0/1/0.38 unassigned YES unset up up

Ethernet0/1/0 unassigned YES NVRAM down down

GigabitEthernet0 unassigned YES NVRAM administratively down down

Dialer1 109.176.112.146 YES IPCP up up

Loopback0 109.176.109.6 YES NVRAM up up

Virtual-Access1 unassigned YES unset up up

Virtual-Access2 unassigned YES NVRAM up up

Local Lan interface

show int gig 0/0/0

GigabitEthernet0/0/0 is up, line protocol is up

Hardware is ISR4431-X-4x1GE, address is d8b1.90eb.9050 (bia d8b1.90eb.9050)

MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,

reliability 255/255, txload 6/255, rxload 1/255

Encapsulation ARPA, loopback not set

Keepalive not supported

Full Duplex, 1000Mbps, link type is auto, media type is RJ45

output flow-control is off, input flow-control is off

ARP type: ARPA, ARP Timeout 04:00:00

Last input 00:00:00, output 00:00:00, output hang never

Last clearing of "show interface" counters never

Input queue: 0/375/0/0 (size/max/drops/flushes); Total output drops: 0

Queueing strategy: fifo

Output queue: 0/40 (size/max)

5 minute input rate 4687000 bits/sec, 3026 packets/sec

5 minute output rate 24173000 bits/sec, 4029 packets/sec

2730013692 packets input, 563427876638 bytes, 0 no buffer

Received 19612368 broadcasts (0 IP multicasts)

0 runts, 0 giants, 0 throttles

1 input errors, 1 CRC, 0 frame, 0 overrun, 0 ignored

0 watchdog, 12984701 multicast, 0 pause input

3570759117 packets output, 2587530711568 bytes, 0 underruns

0 output errors, 0 collisions, 1 interface resets

141955 unknown protocol drops

0 babbles, 0 late collision, 0 deferred

1 lost carrier, 0 no carrier, 0 pause output

0 output buffer failures, 0 output buffers swapped out EMR00620A#

And Core router port.

RP/0/RSP0/CPU0:lon-th1eagw#show running interface TenGigE0/0/0/0.2601 Wed Jun 14 12:50:56.080 BST interface TenGigE0/0/0/0.2601 description ***IPP EMR00620A*** vrf EC_IPP

ipv4 address 172.18.1.1 255.255.255.252 load-interval 30 encapsulation dot1q 2601 !

RP/0/RSP0/CPU0:lon-th1eagw#show int TenGigE0/0/0/0.2601 Wed Jun 14 12:51:34.202 BST

TenGigE0/0/0/0.2601 is up, line protocol is up

Interface state transitions: 1

Hardware is VLAN sub-interface(s), address is d867.d933.198e

Description: ***IPP EMR00620A***

Internet address is 172.18.1.1/30

MTU 2004 bytes, BW 10000000 Kbit (Max: 10000000 Kbit)

reliability 255/255, txload 0/255, rxload 0/255

Encapsulation 802.1Q Virtual LAN, VLAN Id 2601, loopback not set,

Last link flapped 30w2d

ARP type ARPA, ARP timeout 04:00:00

Last input 00:00:00, output 00:00:00

Last clearing of "show interface" counters never

30 second input rate 4019000 bits/sec, 2911 packets/sec

30 second output rate 21770000 bits/sec, 3647 packets/sec

19094274569 packets input, 4661561168594 bytes, 0 total input drops

0 drops for unrecognized upper-level protocol

Received 21 broadcast packets, 339493 multicast packets

23011016992 packets output, 15776326087362 bytes, 0 total output drops

Output 2 broadcast packets, 0 multicast packets