12-01-2017 10:23 PM - edited 03-05-2019 09:34 AM
Need a second set of eyes on this one please. Very simple network setup. Comcast Gateway with a connection to the WS-C3560G-24PS on interface GigabitEthernet0/1. There are two Cisco ESW-540-8P switches hanging off the WS-C3560G-24PS. This has worked great for a long time. Recently I noticed if I attempted to ping from a workstation to a device out on the net I would see a major loss in ping response even with a few timeouts at times. Now it's so bad (as you will see below) it's become a major issue. If I connect a laptop directly to the Comcast gateway and disconnect the link to the WS-C3560G-24PS, a continuous ping to 8.8.8.8 is perfect and as expected. Now move the laptop to the WS-C3560G-24PS and reconnect the link between Comcast Gateway and WS-C3560G-24PS and boom I see the issue again. The port on the Comcast Gateway going to GigabitEthernet0/1 is Auto/1000/Full. Perfect example here of the issue...
Request timeout for icmp_seq 0
64 bytes from 8.8.8.8: icmp_seq=0 ttl=57 time=1896.077 ms
Request timeout for icmp_seq 2
64 bytes from 8.8.8.8: icmp_seq=1 ttl=57 time=2978.907 ms
64 bytes from 8.8.8.8: icmp_seq=2 ttl=57 time=1977.587 ms
64 bytes from 8.8.8.8: icmp_seq=3 ttl=57 time=976.796 ms
64 bytes from 8.8.8.8: icmp_seq=4 ttl=57 time=1974.770 ms
64 bytes from 8.8.8.8: icmp_seq=5 ttl=57 time=975.989 ms
64 bytes from 8.8.8.8: icmp_seq=6 ttl=57 time=12.060 ms
64 bytes from 8.8.8.8: icmp_seq=7 ttl=57 time=14.000 ms
64 bytes from 8.8.8.8: icmp_seq=8 ttl=57 time=11.580 ms
64 bytes from 8.8.8.8: icmp_seq=9 ttl=57 time=12.095 ms
64 bytes from 8.8.8.8: icmp_seq=10 ttl=57 time=12.098 ms
64 bytes from 8.8.8.8: icmp_seq=11 ttl=57 time=11.981 ms
64 bytes from 8.8.8.8: icmp_seq=12 ttl=57 time=20.931 ms
64 bytes from 8.8.8.8: icmp_seq=13 ttl=57 time=13.224 ms
64 bytes from 8.8.8.8: icmp_seq=14 ttl=57 time=885.150 ms
64 bytes from 8.8.8.8: icmp_seq=15 ttl=57 time=15.262 ms
64 bytes from 8.8.8.8: icmp_seq=16 ttl=57 time=18.642 ms
64 bytes from 8.8.8.8: icmp_seq=17 ttl=57 time=13.935 ms
64 bytes from 8.8.8.8: icmp_seq=18 ttl=57 time=12.743 ms
64 bytes from 8.8.8.8: icmp_seq=19 ttl=57 time=13.502 ms
64 bytes from 8.8.8.8: icmp_seq=20 ttl=57 time=12.263 ms
64 bytes from 8.8.8.8: icmp_seq=21 ttl=57 time=12.797 ms
64 bytes from 8.8.8.8: icmp_seq=22 ttl=57 time=1916.390 ms
64 bytes from 8.8.8.8: icmp_seq=23 ttl=57 time=1048.069 ms
64 bytes from 8.8.8.8: icmp_seq=24 ttl=57 time=1178.554 ms
64 bytes from 8.8.8.8: icmp_seq=25 ttl=57 time=197.182 ms
64 bytes from 8.8.8.8: icmp_seq=26 ttl=57 time=1895.396 ms
64 bytes from 8.8.8.8: icmp_seq=27 ttl=57 time=893.229 ms
64 bytes from 8.8.8.8: icmp_seq=28 ttl=57 time=12.622 ms
64 bytes from 8.8.8.8: icmp_seq=29 ttl=57 time=11.743 ms
I am the only one who touches the network. First thing I thought is somehow a loop was introduced. I traced all cables. No loop. I removed all cables and inserted one at a time, then removed it after noting the ping delays and connected the next and so on. I simply could not pinpoint the issue. I then decided to replace all the cables. I use high end Systimax. After replacing them all the issue still persists. What am I missing? I have provided the current config (minus a few personal bits) below for review. Any help is most appreciated.
3560-Switch#sho config
Using 2668 out of 524288 bytes
!
version 12.2
no service pad
service timestamps debug uptime
service timestamps log uptime
no service password-encryption
!
hostname 3560-Switch
!
boot-start-marker
boot-end-marker
!
enable secret 5 REMOVED
enable password REMOVED
!
!
!
no aaa new-model
system mtu routing 1500
ip routing
!
!
!
!
crypto pki trustpoint TP-self-signed-3479437184
enrollment selfsigned
subject-name cn=IOS-Self-Signed-Certificate-3479437184
revocation-check none
rsakeypair TP-self-signed-3479437184
!
!
crypto pki certificate chain TP-self-signed-3479437184
certificate self-signed 01 nvram:IOS-Self-Sig#3434.cer
auto qos srnd4
!
!
!
spanning-tree mode pvst
spanning-tree extend system-id
!
vlan internal allocation policy ascending
!
!
!
interface GigabitEthernet0/1
description COMCAST GATEWAY
switchport mode access
!
interface GigabitEthernet0/2
description APPLE AIRPORT EXTREME
!
interface GigabitEthernet0/3
description CISCO SWITCH SECOND FLOOR
!
interface GigabitEthernet0/4
description CISCO SWITCH FIRST FLOOR
!
interface GigabitEthernet0/5
description NOT IN USE
!
interface GigabitEthernet0/6
description SONOS OFFICE
!
interface GigabitEthernet0/7
description NOT IN USE
!
interface GigabitEthernet0/8
description OFFICE TIVO
!
interface GigabitEthernet0/9
description NOT IN USE
!
interface GigabitEthernet0/10
description NOT IN USE
!
interface GigabitEthernet0/11
description ATTIC CAMERA
!
interface GigabitEthernet0/12
description MAC PRO MAIN
!
interface GigabitEthernet0/13
description NOT IN USE
!
interface GigabitEthernet0/14
description IN USE UNKNOWN SOURCE
!
interface GigabitEthernet0/15
description PATIO CAMERA
!
interface GigabitEthernet0/16
description HP PRINTER OFFICE
!
interface GigabitEthernet0/17
description NOT IN USE
!
interface GigabitEthernet0/18
description NOT IN USE
!
interface GigabitEthernet0/19
description FRONT DOOR CAMERA
!
interface GigabitEthernet0/20
description NOT IN USE
!
interface GigabitEthernet0/21
description NOT IN USE
!
interface GigabitEthernet0/22
description OFFICE CAMERA
!
interface GigabitEthernet0/23
description IMAC SERVER 10.1.10.20
!
interface GigabitEthernet0/24
description HALL CAMERA
!
interface GigabitEthernet0/25
description NOT IN USE
!
interface GigabitEthernet0/26
description NOT IN USE
!
interface GigabitEthernet0/27
description NOT IN USE
!
interface GigabitEthernet0/28
description NOT IN USE
!
interface Vlan1
ip address 10.1.10.5 255.255.255.0
!
ip classless
ip http server
ip http secure-server
!
!
!
line con 0
exec-timeout 0 0
line vty 0 4
password REMOVED
login
length 0
line vty 5 15
password REMOVED
login
!
end
12-01-2017 11:25 PM
12-01-2017 11:44 PM
Hello,
what is the uptime of the switch ?
12-02-2017 02:11 PM
12-02-2017 12:30 AM - edited 12-02-2017 12:31 AM
Hello
Make sure ip routing is disabled and also any MLS qos.
Conf t
no mls qos
no auto qos srnd4
no ip routing
res
Paul
12-02-2017 02:44 PM
12-07-2017 02:36 PM
You can see the CPU spike here
3560-Switch#show processes cpu history
11 11111
2255555666665555555555555555555544446666655555666663333355
100
90
80
70
60
50
40
30
20
10 ******************************** **********************
0....5....1....1....2....2....3....3....4....4....5....5....
0 5 0 5 0 5 0 5 0 5
CPU% per second (last 60 seconds)
1111111111111111211111111111111111411111111111111111111111
3333433331143304033434323343334332533233325221343332303333
100
90
80
70
60
50 *
40 *
30 *
20 * * *
10 #################################*######################*#
0....5....1....1....2....2....3....3....4....4....5....5....
0 5 0 5 0 5 0 5 0 5
CPU% per minute (last 60 minutes)
* = maximum CPU% # = average CPU%
2223332323332426354234233232334346223245322234336262332421322253243521
3792977280937306153625327611066678973103201330754154155997078540010759
100
90
80
70 * * *
60 * * * * * *
50 * * * * ** * * * * * *
40 ** * * * ** * * ***** ** **** * * * * * *
30 ************* ******* **** ********* *** ***** * ***** ****** ****
20 **********************************************************************
10 ######################################################################
0....5....1....1....2....2....3....3....4....4....5....5....6....6....7.
0 5 0 5 0 5 0 5 0 5 0 5 0
CPU% per hour (last 72 hours)
* = maximum CPU% # = average CPU%
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide