cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
2500
Views
12
Helpful
48
Replies

Extreme and constant 2000-3000 ms Latency through ISR C1111

TheGoob
Level 4
Level 4

Hello

So I have DSL 40/5 Service and for the past 2 years I have had no issues. As of this past 3 weeks I have these insane lag spikes. It could stay normal for 30 minutes or 5 hours, then it happens. My 30ms goes to 2000-3000 ms. It either will not go back down, or will after a while. I have removed every device except the ISRC1111 and the PC plugged into it, same thing. Currently my DSL Modem is in Bridge mode and ISR is doing PPPoE.

To test it, I eliminated everything Cisco and simply used my DSL Modem in PPPoE and 2 days went by 0 issues and my continuous ping stayed 30-60 ms. With that said, when using my ISR C1111 as PPPoE and the lag starts, if I reboot the ISR it all goes back to normal...for 30 mins maybe or several hours.

I really do not know how to troubleshoot this, especially when all in same exact config has been fine. Also, even doing the traceroute and ping ON the ISR, same madness.

What all would be needed from me to help in helping me figure it out?

48 Replies 48

TheGoob
Level 4
Level 4

It seems that since I had done the changes to the timeouts, I am having no more issues... I mean, I personally do not understand the correlation between high latency and those timeouts, but it seems to have been it. I will go to "solved" at this point but I assure you I will open it again if it happens. I thank you all for your patience and guidance.

TheGoob
Level 4
Level 4

Well it did it again, 2000-3000ms Ping/Latency. I was home during it and got the stats again, I will post 5 here and the bigger ones as .txt files.

ip nat translation tcp-timeout 86400
ip nat translation udp-timeout 60
ip nat translation syn-timeout 60
ip nat translation dns-timeout 60
ip nat translation icmp-timeout 60
ip nat translation max-entries 200000
show interface Gi0/0/0
GigabitEthernet0/0/0 is up, line protocol is up
Hardware is C1111-2x1GE, address is 00ea.bded.c480 (bia 00ea.bded.c480)
Description: WAN
MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 5/255
Encapsulation ARPA, loopback not set
Keepalive not supported
Full Duplex, 1000Mbps, link type is auto, media type is RJ45
output flow-control is off, input flow-control is off
ARP type: ARPA, ARP Timeout 04:00:00
Last input never, output 00:00:01, output hang never
Last clearing of "show interface" counters never
Input queue: 0/375/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 23354000 bits/sec, 2154 packets/sec
5 minute output rate 1269000 bits/sec, 1067 packets/sec
166171719 packets input, 196785156375 bytes, 0 no buffer
Received 0 broadcasts (0 IP multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 271891 multicast, 0 pause input
118002146 packets output, 25277039269 bytes, 0 underruns
Output 1 broadcasts (0 IP multicasts)
0 output errors, 0 collisions, 1 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out
show arp
Protocol  Address          Age (min)  Hardware Addr   Type   Interface
Internet  172.16.1.1              -   00ea.bded.c4f4  ARPA   Vlan8
Internet  172.16.1.2            212   d0e0.42d9.6e48  ARPA   Vlan8
Internet  192.168.10.1            -   00ea.bded.c4f4  ARPA   Vlan10
Internet  192.168.10.179          6   5254.00f0.439e  ARPA   Vlan10
Internet  192.168.20.1            -   00ea.bded.c4f4  ARPA   Vlan1
show ip traffic
IP statistics:
  Rcvd:  233524349 total, 850431 local destination
         0 format errors, 0 checksum errors, 55 bad hop count
         0 unknown protocol, 0 not a gateway
         0 security failures, 0 bad options, 0 with options
  Opts:  0 end, 0 nop, 0 basic security, 0 loose source route
         0 timestamp, 0 extended security, 0 record route
         0 stream ID, 0 strict source route, 0 alert, 0 cipso, 0 ump
         0 other, 0 ignored
  Frags: 60 reassembled, 0 timeouts, 0 couldn't reassemble
         2598 fragmented, 5496 fragments, 198 couldn't fragment
         0 invalid hole
  Bcast: 0 received, 0 sent
  Mcast: 2736 received, 0 sent
  Sent:  434675 generated, 163825275 forwarded
  Drop:  0 encapsulation failed, 0 unresolved, 1149 no adjacency
         0 no route, 0 unicast RPF, 0 forced drop, 0 unsupported-addr
         0 options denied, 0 source IP address zero

ICMP statistics:
  Rcvd: 3 format errors, 0 checksum errors, 0 redirects, 30 unreachable
        233034 echo, 5 echo reply, 0 mask requests, 0 mask replies, 0 quench
        0 parameter, 0 timestamp, 0 timestamp replies, 0 info request, 0 other
        0 irdp solicitations, 673 irdp advertisements
        0 time exceeded, 0 info replies
  Sent: 0 redirects, 48911 unreachable, 5 echo, 233034 echo reply
        0 mask requests, 0 mask replies, 0 quench, 0 timestamp, 0 timestamp replies
        0 info reply, 55 time exceeded, 0 parameter problem
        0 irdp solicitations, 0 irdp advertisements

UDP statistics:
  Rcvd: 409852 total, 0 checksum errors, 409852 no port 0 finput
  Sent: 0 total, 0 forwarded broadcasts

TCP statistics:
  Rcvd: 439810 total, 53 checksum errors, 39246 no port
  Sent: 385934 total

PIMv2 statistics: Sent/Received
  Total: 0/0, 0 checksum errors, 0 format errors
  Registers: 0/0 (0 non-rp, 0 non-sm-group), Register Stops: 0/0,  Hellos: 0/0
  Join/Prunes: 0/0, Asserts: 0/0, grafts: 0/0
  Bootstraps: 0/0, Candidate_RP_Advertisements: 0/0
  Queue drops: 0
  State-Refresh: 0/0

IGMP statistics: Sent/Received
  Total: 0/0, Format errors: 0/0, Checksum errors: 0/0
  Host Queries: 0/0, Host Reports: 0/0, Host Leaves: 0/0
  DVMRP: 0/0, PIM: 0/0
  Queue drops: 0
  Report VRF mismatch drops: 0

EIGRP-IPv4 statistics:
  Rcvd: 0 total
  Sent: 0 total

NHRP statistics:
   Sent: Total 0
         0 Resolution Request  0 Resolution Reply  0 Registration Request
         0 Registration Reply  0 Purge Request  0 Purge Reply
         0 Error Indication  0 Traffic Indication  0 Redirect Suppress
   Rcvd: Total 0
         0 Resolution Request  0 Resolution Reply  0 Registration Request
         0 Registration Reply  0 Purge Request  0 Purge Reply
         0 Error Indication  0 Traffic Indication  0 Redirect Suppress

OSPF statistics:
  Last clearing of OSPF traffic counters never
  Rcvd: 0 total, 0 checksum errors
        0 hello, 0 database desc, 0 link state req
        0 link state updates, 0 link state acks
  Sent: 0 total
        0 hello, 0 database desc, 0 link state req
        0 link state updates, 0 link state acks

BGP statistics:
  Rcvd: 0 total, 0 opens, 0 notifications, 0 updates
        0 keepalives, 0 route-refresh, 0 unrecognized
  Sent: 0 total, 0 opens, 0 notifications, 0 updates
        0 keepalives, 0 route-refresh

ARP statistics:
  Rcvd: 1365 requests, 26 replies, 0 reverse, 0 other
  Sent: 28 requests, 1381 replies (0 proxy), 0 reverse
  Drop due to input queue full: 0
show processes cpu history




                  11111          11111               11111
  100
   90
   80
   70
   60
   50
   40
   30
   20
   10
     0....5....1....1....2....2....3....3....4....4....5....5....6
               0    5    0    5    0    5    0    5    0    5    0
               CPU% per second (last 60 seconds)





      1 11 11 21111 21 111111 12 22131 111111111111211 1111 1122 1
  100
   90
   80
   70
   60
   50
   40
   30
   20
   10
     0....5....1....1....2....2....3....3....4....4....5....5....6
               0    5    0    5    0    5    0    5    0    5    0
               CPU% per minute (last 60 minutes)
              * = maximum CPU%   # = average CPU%




             3        2 1         1           3     1  1            1
      348423403732344453182333333343434323324473326314314334925637673767657734
  100
   90
   80
   70
   60
   50
   40                                         *
   30        *        *                       *
   20        *        *                       *
   10   *    * *      * **        *           *   * *  *    * ** ***********
     0....5....1....1....2....2....3....3....4....4....5....5....6....6....7..
               0    5    0    5    0    5    0    5    0    5    0    5    0
                   CPU% per hour (last 72 hours)
                  * = maximum CPU%   # = average CPU%

 

Bad news 

Can you make udp timeput 300 sec and check

Waiting your reply 

MHM

Hello friend, afternoon.

Just made the change, so I will let ya know if anything arises.