01-08-2013 08:01 AM - edited 03-04-2019 06:37 PM
Hi All,
I am facing issue in my Domestic MPLS, let me explain below.
we have 2 sites in different states connected with MPLS with 45Mbps b/w capacity, Internet gateway is flowing like from Site A to Site B on MPLS then Internet link on site B. i have run prtg to see b/w utilization and there are lot spikes in it, i saw ip flow top-talkers on both sites routers and can see one destination which we have allowed for some users to download some data from client ftp in Gbs.
My question is this the only reason of the spikes? i have 45 B/w capacity i think its enough. If this the only reason then can any body suggest any option by which i can specify some part of b/w to this only via rate-limit or by any other method will that work?
below is the output of ip flow top-talker
SrcIf SrcIPaddress DstIf DstIPaddress Pr SrcP DstP Bytes
Gi0/0 209.x.x.51 Gi0/1 10.x.x.50 06 0016 ED6F 100M
Gi0/0 209.x.x.51 Gi0/1 10.x.x.77 06 0016 C0E7 60M
Gi0/0 209.x.x.51 Gi0/1 10.x.x.50 06 0016 ED8B 50M
Gi0/0 209.x.x.51 Gi0/1 10.x.x.50 06 0016 ED6E 24M
Gi0/0 10.x.x.115 Gi0/1 10.x.x.52 06 F2B7 043C 15M
Gi0/0 10.x.x.6 Gi0/1 10.x.x.222 06 1F90 0425 9873K
Gi0/0 209.x.x.51 Gi0/1 10.x.x.50 06 0016 ED8A 7811K
Gi0/0 10.x.x.6 Gi0/1 10.x.x.204 06 1F90 0420 7190K
Gi0/0 172.x.x.5 Gi0/1 10.x.x.152 11 D522 270C 5821K
Gi0/0 10.x.x.6 Gi0/1 10.x.x.202 06 1F90 049E 5633K
Gi0/0 209.x.x.51 Gi0/1 10.x.x.83 06 0016 0691 5381K
Gi0/0 209.x.x.51 Gi0/1 10.x.x.50 06 0016 EDA6 5375K
Gi0/1 10.x.x.45 Gi0/0 10.x.x.77 11 6824 C9AC 5332K
Gi0/1 10.x.x.45 Gi0/0* 10.x.x.77 11 6824 C9AC 5332K
Gi0/1 10.x.x.142 Gi0/0 10.x.x.121 11 0A8C 0A84 5332K
Gi0/1 10.x.x.142 Gi0/0* 10.x.x.121 11 0A8C 0A84 5332K
Gi0/0 10.x.x.77 Gi0/1 10.x.x.45 11 C9AC 6824 5331K
Gi0/0 10.x.x.6 Gi0/1 10.x.x.211 06 1F90 0428 4871K
Gi0/0 10.x.x.17 Gi0/1 10.x.x.77 06 01BD C39B 3864K
Gi0/0 209.x.x.51 Gi0/1 10.x.x.77 06 0016 C0E5 3856K
Gi0/0 209.x.x.51 Gi0/1 10.x.x.83 06 0016 0690 3772K
01-08-2013 09:47 AM
Disclaimer
The Author of this posting offers the information contained within this posting without consideration and with the reader's understanding that there's no implied or expressed suitability or fitness for any purpose. Information provided is for informational purposes only and should not be construed as rendering professional advice of any kind. Usage of this posting's information is solely at reader's own risk.
Liability Disclaimer
In no event shall Author be liable for any damages whatsoever (including, without limitation, damages for loss of use, data or profit) arising out of the use or inability to use the posting's information even if Author has been advised of the possibility of such damage.
Posting
My question is this the only reason of the spikes?
Insufficient information.
If this the only reason then can any body suggest any option by which i can specify some part of b/w to this only via rate-limit or by any other method will that work?
Rate-limiting (or policing) is probably a possible method to restrict bandwidth utilization, but unclear there's a need to do so. Additionally, if bandwidth consumption is from an Internet site, rate-limiting it will be downstream of the Internet link, so it can be less than ideal. Across the MPLS link, if you control both sides egress, there might be many things you could do.
A bandwidth utilization graph, with spikes or not, tells you very little, by itself, about bandwidth needs. It's sort of like if I graphed your pulse rate. It too would likely have highs and low, spikes too, but if that's all I know it tells me little (other than your heart is beating).
01-09-2013 05:56 AM
Thanks Joseph!!
"Across the MPLS link, if you control both sides egress, there might be many things you could do"
I have access to both sites, could plese let me know what other things i can do.
People at site A download data from Client FTP in GBs on daily basis via Internet link which in Site B, that's why MPLS link connecting both sites having spikes.This is the main reason.
I am attaching graph where you can see spikes,
01-09-2013 06:52 AM
Disclaimer
The Author of this posting offers the information contained within this posting without consideration and with the reader's understanding that there's no implied or expressed suitability or fitness for any purpose. Information provided is for informational purposes only and should not be construed as rendering professional advice of any kind. Usage of this posting's information is solely at reader's own risk.
Liability Disclaimer
In no event shall Author be liable for any damages whatsoever (including, without limitation, damages for loss of use, data or profit) arising out of the use or inability to use the posting's information even if Author has been advised of the possibility of such damage.
Posting
For your MPLS links, if your hardware supports it, and if you're only using FIFO queuing, I would recommend using a CBWFQ policy with default class defined and with fair-queue enabled, i.e.:
policy-map SampleOut
class class-default
fair-queue
interface (T3)
service-policy output SampleOut
Such a policy often mitigates the adverse impact of a high-volume flow against other low-volume flows.
If your MPLS has multipoint, i.e. more than one other possible router can send to your receiving router, you may want to investigate the QoS options supported by your MPLS vendor (if any).
For your Internet link, what you can do effectively, is curtailed, if you can't directly manage traffic toward you. However, you can rate-limit specific traffic to specific rates, for example:
class-map match-any bulkTraffic
match protocol ftp
policy-map SampleLimitIn
class bulkTraffic
police average #
Interface (Internet)
service-policy in SampleLimitIn
01-10-2013 07:34 AM
Hi Joseph,
Thanks a lot!!
I am not confident enough in Qos so attaching config of my & ISP managed routers & attached one rough diagram to make you understabd the setup, could you please see and let me knwo what can i do to stop those spikes and to reserve some b/w for that particular destination.
All config are from Site A only.
It would be great help for me thanks.
My Managed Router:-
!
class-map match-any business
match access-group name business_critical
class-map match-any Exch-Rate-Limit
match access-group name Exch-Rate-Limit
class-map match-any Rate-Limit-Test
match access-group name Rate-Limit-Test
class-map match-any non-business
match access-group name non-critical
class-map match-any premium
match access-group name interactive_video_or_voice
!
!
policy-map parent-test
class premium
set ip dscp ef
priority percent 20
class business
set ip dscp default
bandwidth remaining percent 60
class non-business
bandwidth remaining percent 30
class class-default
policy-map MPLS-TATA
class class-default
shape average 46080000
service-policy parent-test
policy-map Exch-Rate-Limit-Policy
class Exch-Rate-Limit
police cir 4096000 bc 1024000 be 1024000
policy-map Rate-Limit-Test-Policy
class Rate-Limit-Test
police cir 3145500 bc 1024000 be 1024000
!
!
interface GigabitEthernet0/0
description << Connected to TCL primary on X over g0/1>>
ip address 172.x.x.2 255.255.255.252
ip access-group Security_tata_mpls in
no ip redirects
no ip unreachables
no ip proxy-arp
ip accounting output-packets
ip flow ingress
ip flow egress
ip route-cache flow
ip summary-address eigrp 17XXX 10.x.x.0 255.255.224.0 5
ip summary-address eigrp 17XXX 10.x.x.0 255.255.224.0 5
load-interval 60
duplex full
speed 100
no cdp enable
service-policy output MPLS-TATA
!
interface GigabitEthernet0/1
description << Connected to LAN >>
ip address 10.x.x.131 255.255.255.248
no ip redirects
no ip unreachables
no ip proxy-arp
ip route-cache flow
no ip mroute-cache
load-interval 30
duplex full
speed 100
service-policy input Exch-Rate-Limit-Policy
service-policy output Rate-Limit-Test-Policy
!
router eigrp 17xxx
redistribute eigrp 33xx route-map advertiselan
passive-interface default
no passive-interface GigabitEthernet0/0
network 172.x.x.0 0.0.0.3
no auto-summary
no eigrp log-neighbor-changes
!
router eigrp 33xx
redistribute eigrp 17xxx route-map advertisempls
passive-interface default
no passive-interface GigabitEthernet0/1
network 10.x.x.0 0.0.31.255
network 10.x.x.0 0.0.31.255
distribute-list mpls_to_lan out GigabitEthernet0/1
distribute-list lan_to_mpls in GigabitEthernet0/1
no auto-summary
no eigrp log-neighbor-changes
!
route-map advertiselan deny 5
match tag 4755124
!
route-map advertiselan permit 10
match ip address lan_to_mpls
!
route-map advertisempls permit 10
match ip address mpls_to_lan
set tag 4755124
!
!
ISP managed Router:
class-map match-any business
match ip dscp default
class-map match-all Rate-Limit-Test
match access-group name Rate-Limit-Test
class-map match-all Exch-Rate-Limit
match access-group name Exch-Rate-Limit
match any
class-map match-any ABC_C2_WAN
match ip dscp default
class-map match-any ABC_C1_WAN
match ip dscp ef
class-map match-any premium
match ip dscp ef
!
!
policy-map parent
class premium
priority percent 20
class business
bandwidth remaining percent 60
class class-default
policy-map ABC_30Mb_WAN_Child_Out
class ABC_C1_WAN
priority 6144
class ABC_C2_WAN
bandwidth 18432
class class-default
policy-map ABC_45Mb_WAN_Child_Out
class ABC_C1_WAN
priority 9216
class ABC_C2_WAN
bandwidth 27648
class class-default
policy-map ABC_45Mb_WAN_Parent_Out
class class-default
shape average 46080000
service-policy ABC_45Mb_WAN_Child_Out
policy-map ABC_30Mb_WAN_Parent_Out
class class-default
shape average 30720000
service-policy ABC_30Mb_WAN_Child_Out
!
!
!
!
interface Loopback0
description *** MGMT ***
ip address 10.x.x.151 255.255.255.255
!
interface Tunnel100
description TUNNEL to XXX
ip address 1.x.x.2 255.255.255.252
tunnel source 10.x.x.18
tunnel destination 10.x.x.14
tunnel mode ipip
!
interface GigabitEthernet0/0
description **** XXX WAN ***
bandwidth 46080
ip address 10.X.X.18 255.255.255.252
load-interval 30
delay 10
duplex full
speed 100
service-policy output ABC_45Mb_WAN_Parent_Out
!
interface GigabitEthernet0/1
description << Connected to ABC LAN >>
ip address 172.X.X.1 255.255.255.252
ip accounting output-packets
load-interval 30
duplex full
speed 100
!
router eigrp 17xxx
network 10.x.x.16 0.0.0.3
network 172.x.x.0 0.0.0.3
no auto-summary
!
i
!
route-map SET_TAG_TCL permit 10
set tag 4755124
!
route-map MATCH_TAG deny 5
match tag 4755124
!
route-map MATCH_TAG permit 10
!
route-map advertisempls permit 10
match ip address ExceptGGN
!
!
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide