Catalyst 3560G drops connectivity for high use endpoints

[0rion447]

Hey all,

Lately my network has been having major connectivity problems. I have 3 Esxis host, host 1 handled AD and DHCP then the host started dropping connectivity. Everyday at one point and multiple times a day I would need to reboot the host as it could not be contacted. After searching through the logs on the host I couldn't find anything suspicious but the network kept going down so I migrated to host 3. Host 3 at the time had never gone down during these outages and after getting everything set up host 3 is now expiring the same issues. Disconnecting then reconnecting the host from the switch remedies the issue but I know it will continue to happen. Host one had 2 failover connections and each went down during these outages host 3 does not have any failover. Any suggestions would be greatly appreciated.

[balaji.bandi]

You need to post more information, what IOS running , show run and explain how this connected to esxi

what is the process load that time ? what kind of Logs you have same time ?

any small network digram to help to advise better.,

[0rion447]

Of course sorry I didn't really know what to give as info. Ill get all this shortly, is there anything else that would help you help me?

[Joseph W. Doherty]

Also status on the switch ports and whether the links actually drop or just the host does.

[0rion447]

Cisco IOS Software, C3560 Software (C3560-IPSERVICESK9-M), Version 12.2(55)SE12, RELEASE SOFTWARE (fc2)

Log Buffer (4096 bytes):
down
*Mar 24 18:41:44.644: %LINK-3-UPDOWN: Interface GigabitEthernet0/10, changed state to down
*Mar 24 18:41:47.110: %LINK-3-UPDOWN: Interface GigabitEthernet0/10, changed state to up
*Mar 24 18:41:48.117: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/10, changed state to up
*Mar 24 18:44:00.909: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/10, changed state to down
*Mar 24 18:44:01.915: %LINK-3-UPDOWN: Interface GigabitEthernet0/10, changed state to down
*Mar 24 18:44:04.373: %LINK-3-UPDOWN: Interface GigabitEthernet0/10, changed state to up
*Mar 24 18:44:05.380: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/10, changed state to up
*Mar 24 18:46:44.042: %LINK-3-UPDOWN: Interface GigabitEthernet0/4, changed state to up
*Mar 24 18:46:45.049: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/4, changed state to up
*Mar 24 18:48:47.531: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/10, changed state to down
*Mar 24 18:48:48.537: %LINK-3-UPDOWN: Interface GigabitEthernet0/10, changed state to down
*Mar 24 18:48:50.995: %LINK-3-UPDOWN: Interface GigabitEthernet0/10, changed state to up
*Mar 24 18:48:52.002: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/10, changed state to up
*Mar 24 19:23:29.281: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/4, changed state to down
*Mar 24 19:23:30.288: %LINK-3-UPDOWN: Interface GigabitEthernet0/4, changed state to down
*Mar 24 19:23:32.360: %LINK-3-UPDOWN: Interface GigabitEthernet0/4, changed state to up
*Mar 24 19:23:33.375: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/4, changed state to up
*Mar 24 19:38:30.704: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/4, changed state to down
*Mar 24 19:38:31.711: %LINK-3-UPDOWN: Interface GigabitEthernet0/4, changed state to down
*Mar 24 19:38:33.783: %LINK-3-UPDOWN: Interface GigabitEthernet0/4, changed state to up
*Mar 24 19:38:34.789: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/4, changed state to up
*Mar 24 19:43:15.749: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/4, changed state to down
*Mar 24 19:43:16.756: %LINK-3-UPDOWN: Interface GigabitEthernet0/4, changed state to down
*Mar 24 19:43:18.811: %LINK-3-UPDOWN: Interface GigabitEthernet0/4, changed state to up
*Mar 24 19:43:19.818: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/4, changed state to up
*Mar 24 19:48:46.294: %LINK-3-UPDOWN: Interface GigabitEthernet0/8, changed state to up
*Mar 24 19:48:47.300: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/8, changed state to up
*Mar 24 20:22:24.962: %SSH-4-SSH2_UNEXPECTED_MSG: Unexpected message type has arrived. Terminating the connection
*Mar 24 21:06:53.730: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/10, changed state to down
*Mar 24 21:06:54.737: %LINK-3-UPDOWN: Interface GigabitEthernet0/10, changed state to down
*Mar 24 21:06:57.312: %LINK-3-UPDOWN: Interface GigabitEthernet0/10, changed state to up
*Mar 24 21:06:58.319: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/10, changed state to up
*Mar 24 21:37:02.155: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/10, changed state to down
*Mar 24 21:37:03.161: %LINK-3-UPDOWN: Interface GigabitEthernet0/10, changed state to down
*Mar 24 21:37:05.611: %LINK-3-UPDOWN: Interface GigabitEthernet0/10, changed state to up
*Mar 24 21:37:06.618: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/10, changed state to up
*Mar 24 22:04:26.624: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/10, changed state to down
*Mar 24 22:04:27.631: %LINK-3-UPDOWN: Interface GigabitEthernet0/10, changed state to down
*Mar 24 22:04:30.072: %LINK-3-UPDOWN: Interface GigabitEthernet0/10, changed state to up
*Mar 24 22:04:31.078: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/10, changed state to up
#show clock
*22:07:54.863 UTC Wed Mar 24 1993

[balaji.bandi]

This does not give any information, other than port going up and down, we do not what is those ports.

if this what your issue, check the connectivity Layer 1 physical cables. or may be config issue.

please post full device model

setup NTP time

post-show run full config

explain what device connected to what port?

[Leo Laohoo]

Post the complete output to the following command:

sh interface <PORT/s> CONTROLL

[andrew.butterworth]

My 1st thought is speed & duplex, however since its a 3560G I am guessing your ESXi hosts are connected @ 1Gbps (which should by design only be operating at full-duplex)?  Worth verifying this though - 'show interface status' on the switch and in the ESXi GUI under the network configuration it will show you the status of the interfaces.

Are the two interfaces that are going up & down the interfaces connected to your ESXi hosts?  Are the logs when you are rebooting or disconnecting the servers?

Probably worth posting the switch configuration or at least the interface configurations where the ESXi hosts are connected.

IOS 12.2(55)SE12 is old and you have the option to upgrade this to 15.0(2)SE11 - although I doubt this will fix this particular issue.

QoS is also a possibility - again though I doubt it.

I'd be looking at L1/L2 issues.

Andy