High Bandwidth Utilization

bhisham Sharma · ‎01-08-2013

Hi All,

I am facing issue in my Domestic MPLS, let me explain below.

we have 2 sites in different states connected with MPLS with 45Mbps b/w capacity, Internet gateway is flowing like from Site A to Site B on MPLS then Internet link on site B. i have run prtg to see b/w utilization and there are lot spikes in it, i saw ip flow top-talkers on both sites routers and can see one destination which we have allowed for some users to download some data from client ftp in Gbs.

My question is this the only reason of the spikes? i have 45 B/w capacity i think its enough. If this the only reason then can any body suggest any option by which i can specify some part of b/w to this only via rate-limit or by any other method will that work?

below is the output of ip flow top-talker

SrcIf SrcIPaddress DstIf DstIPaddress Pr SrcP DstP Bytes

Gi0/0 209.x.x.51 Gi0/1 10.x.x.50 06 0016 ED6F 100M

Gi0/0 209.x.x.51 Gi0/1 10.x.x.77 06 0016 C0E7 60M

Gi0/0 209.x.x.51 Gi0/1 10.x.x.50 06 0016 ED8B 50M

Gi0/0 209.x.x.51 Gi0/1 10.x.x.50 06 0016 ED6E 24M

Gi0/0 10.x.x.115 Gi0/1 10.x.x.52 06 F2B7 043C 15M

Gi0/0 10.x.x.6 Gi0/1 10.x.x.222 06 1F90 0425 9873K

Gi0/0 209.x.x.51 Gi0/1 10.x.x.50 06 0016 ED8A 7811K

Gi0/0 10.x.x.6 Gi0/1 10.x.x.204 06 1F90 0420 7190K

Gi0/0 172.x.x.5 Gi0/1 10.x.x.152 11 D522 270C 5821K

Gi0/0 10.x.x.6 Gi0/1 10.x.x.202 06 1F90 049E 5633K

Gi0/0 209.x.x.51 Gi0/1 10.x.x.83 06 0016 0691 5381K

Gi0/0 209.x.x.51 Gi0/1 10.x.x.50 06 0016 EDA6 5375K

Gi0/1 10.x.x.45 Gi0/0 10.x.x.77 11 6824 C9AC 5332K

Gi0/1 10.x.x.45 Gi0/0* 10.x.x.77 11 6824 C9AC 5332K

Gi0/1 10.x.x.142 Gi0/0 10.x.x.121 11 0A8C 0A84 5332K

Gi0/1 10.x.x.142 Gi0/0* 10.x.x.121 11 0A8C 0A84 5332K

Gi0/0 10.x.x.77 Gi0/1 10.x.x.45 11 C9AC 6824 5331K

Gi0/0 10.x.x.6 Gi0/1 10.x.x.211 06 1F90 0428 4871K

Gi0/0 10.x.x.17 Gi0/1 10.x.x.77 06 01BD C39B 3864K

Gi0/0 209.x.x.51 Gi0/1 10.x.x.77 06 0016 C0E5 3856K

Gi0/0 209.x.x.51 Gi0/1 10.x.x.83 06 0016 0690 3772K

Joseph W. Doherty · ‎01-08-2013

Disclaimer

The Author of this posting offers the information contained within this posting without consideration and with the reader's understanding that there's no implied or expressed suitability or fitness for any purpose. Information provided is for informational purposes only and should not be construed as rendering professional advice of any kind. Usage of this posting's information is solely at reader's own risk.

Liability Disclaimer

In no event shall Author be liable for any damages whatsoever (including, without limitation, damages for loss of use, data or profit) arising out of the use or inability to use the posting's information even if Author has been advised of the possibility of such damage.

Posting

My question is this the only reason of the spikes?

Insufficient information.

If this the only reason then can any body suggest any option by which i can specify some part of b/w to this only via rate-limit or by any other method will that work?

Rate-limiting (or policing) is probably a possible method to restrict bandwidth utilization, but unclear there's a need to do so. Additionally, if bandwidth consumption is from an Internet site, rate-limiting it will be downstream of the Internet link, so it can be less than ideal. Across the MPLS link, if you control both sides egress, there might be many things you could do.

A bandwidth utilization graph, with spikes or not, tells you very little, by itself, about bandwidth needs. It's sort of like if I graphed your pulse rate. It too would likely have highs and low, spikes too, but if that's all I know it tells me little (other than your heart is beating).

bhisham Sharma · ‎01-09-2013

Thanks Joseph!!

"Across the MPLS link, if you control both sides egress, there might be many things you could do"

I have access to both sites, could plese let me know what other things i can do.

People at site A download data from Client FTP in GBs on daily basis via Internet link which in Site B, that's why MPLS link connecting both sites having spikes.This is the main reason.

I am attaching graph where you can see spikes,

Joseph W. Doherty · ‎01-09-2013

Disclaimer

The Author of this posting offers the information contained within this posting without consideration and with the reader's understanding that there's no implied or expressed suitability or fitness for any purpose. Information provided is for informational purposes only and should not be construed as rendering professional advice of any kind. Usage of this posting's information is solely at reader's own risk.

Liability Disclaimer

In no event shall Author be liable for any damages whatsoever (including, without limitation, damages for loss of use, data or profit) arising out of the use or inability to use the posting's information even if Author has been advised of the possibility of such damage.

Posting

For your MPLS links, if your hardware supports it, and if you're only using FIFO queuing, I would recommend using a CBWFQ policy with default class defined and with fair-queue enabled, i.e.:

policy-map SampleOut

class class-default

fair-queue

interface (T3)

service-policy output SampleOut

Such a policy often mitigates the adverse impact of a high-volume flow against other low-volume flows.

If your MPLS has multipoint, i.e. more than one other possible router can send to your receiving router, you may want to investigate the QoS options supported by your MPLS vendor (if any).

For your Internet link, what you can do effectively, is curtailed, if you can't directly manage traffic toward you. However, you can rate-limit specific traffic to specific rates, for example:

class-map match-any bulkTraffic

match protocol ftp

policy-map SampleLimitIn

class bulkTraffic

police average #

Interface (Internet)

service-policy in SampleLimitIn

bhisham Sharma · ‎01-10-2013

Hi Joseph,

Thanks a lot!!

I am not confident enough in Qos so attaching config of my & ISP managed routers & attached one rough diagram to make you understabd the setup, could you please see and let me knwo what can i do to stop those spikes and to reserve some b/w for that particular destination.

All config are from Site A only.

It would be great help for me thanks.

My Managed Router:-

!
class-map match-any business
match access-group name business_critical
class-map match-any Exch-Rate-Limit
match access-group name Exch-Rate-Limit
class-map match-any Rate-Limit-Test
match access-group name Rate-Limit-Test
class-map match-any non-business
match access-group name non-critical
class-map match-any premium
match access-group name interactive_video_or_voice
!
!
policy-map parent-test
class premium
set ip dscp ef
priority percent 20
class business
set ip dscp default
bandwidth remaining percent 60
class non-business
bandwidth remaining percent 30
class class-default
policy-map MPLS-TATA
class class-default
shape average 46080000
service-policy parent-test
policy-map Exch-Rate-Limit-Policy
class Exch-Rate-Limit
police cir 4096000 bc 1024000 be 1024000
policy-map Rate-Limit-Test-Policy
class Rate-Limit-Test
police cir 3145500 bc 1024000 be 1024000
!

!
interface GigabitEthernet0/0
description << Connected to TCL primary on X over g0/1>>
ip address 172.x.x.2 255.255.255.252
ip access-group Security_tata_mpls in
no ip redirects
no ip unreachables
no ip proxy-arp
ip accounting output-packets
ip flow ingress
ip flow egress
ip route-cache flow
ip summary-address eigrp 17XXX 10.x.x.0 255.255.224.0 5
ip summary-address eigrp 17XXX 10.x.x.0 255.255.224.0 5
load-interval 60
duplex full
speed 100
no cdp enable
service-policy output MPLS-TATA
!
interface GigabitEthernet0/1
description << Connected to LAN >>
ip address 10.x.x.131 255.255.255.248
no ip redirects
no ip unreachables
no ip proxy-arp
ip route-cache flow
no ip mroute-cache
load-interval 30
duplex full
speed 100
service-policy input Exch-Rate-Limit-Policy
service-policy output Rate-Limit-Test-Policy
!
router eigrp 17xxx
redistribute eigrp 33xx route-map advertiselan
passive-interface default
no passive-interface GigabitEthernet0/0
network 172.x.x.0 0.0.0.3
no auto-summary
no eigrp log-neighbor-changes
!
router eigrp 33xx
redistribute eigrp 17xxx route-map advertisempls
passive-interface default
no passive-interface GigabitEthernet0/1
network 10.x.x.0 0.0.31.255
network 10.x.x.0 0.0.31.255
distribute-list mpls_to_lan out GigabitEthernet0/1
distribute-list lan_to_mpls in GigabitEthernet0/1
no auto-summary
no eigrp log-neighbor-changes
!

route-map advertiselan deny 5
match tag 4755124
!
route-map advertiselan permit 10
match ip address lan_to_mpls
!
route-map advertisempls permit 10
match ip address mpls_to_lan
set tag 4755124
!
!

ISP managed Router:

class-map match-any business

match ip dscp default

class-map match-all Rate-Limit-Test

match access-group name Rate-Limit-Test

class-map match-all Exch-Rate-Limit

match access-group name Exch-Rate-Limit

match any

class-map match-any ABC_C2_WAN

match ip dscp default

class-map match-any ABC_C1_WAN

match ip dscp ef

class-map match-any premium

match ip dscp ef

!

policy-map parent

class premium

priority percent 20

class business

bandwidth remaining percent 60

class class-default

policy-map ABC_30Mb_WAN_Child_Out

class ABC_C1_WAN

priority 6144

class ABC_C2_WAN

bandwidth 18432

class class-default

policy-map ABC_45Mb_WAN_Child_Out

class ABC_C1_WAN

priority 9216

class ABC_C2_WAN

bandwidth 27648

class class-default

policy-map ABC_45Mb_WAN_Parent_Out

class class-default

shape average 46080000

service-policy ABC_45Mb_WAN_Child_Out

policy-map ABC_30Mb_WAN_Parent_Out

class class-default

shape average 30720000

service-policy ABC_30Mb_WAN_Child_Out

!

interface Loopback0

description *** MGMT ***

ip address 10.x.x.151 255.255.255.255

!

interface Tunnel100

description TUNNEL to XXX

ip address 1.x.x.2 255.255.255.252

tunnel source 10.x.x.18

tunnel destination 10.x.x.14

tunnel mode ipip

!

interface GigabitEthernet0/0

description **** XXX WAN ***

bandwidth 46080

ip address 10.X.X.18 255.255.255.252

load-interval 30

delay 10

duplex full

speed 100

service-policy output ABC_45Mb_WAN_Parent_Out

!

interface GigabitEthernet0/1

description << Connected to ABC LAN >>

ip address 172.X.X.1 255.255.255.252

ip accounting output-packets

load-interval 30

duplex full

speed 100

!

router eigrp 17xxx

network 10.x.x.16 0.0.0.3

network 172.x.x.0 0.0.0.3

no auto-summary

!

i

!

route-map SET_TAG_TCL permit 10

set tag 4755124

!

route-map MATCH_TAG deny 5

match tag 4755124

!

route-map MATCH_TAG permit 10

!

route-map advertisempls permit 10

match ip address ExceptGGN

!