Outage

[Bob Greer]

Hi there,

Thanks for reading!

Remote users complained of losing all network services.  Here's an ASCII "diagram":

Router1 <-> CoreSW1
  |       |
Router2 <-> CoreSW2

RT1 & RT2 are confd as an HSRP pair.

RT1 reports Late Collisions at the time of the outage (%PQ3_TSEC-5-LATECOLL:  Gi8, Late collision)

CSW1 logs have rolled off; no SNMP server :(

The RT1 inf:

607736482 packets input, 300775281669 bytes, 0 no buffer
     Received 1129957 broadcasts (404933 IP multicasts)
     35922 runts, 0 giants, 0 throttles
     35922 input errors, 35922 CRC, 0 frame, 0 overrun, 0 ignored
     0 watchdog, 1129768 multicast, 0 pause input

 590911295 packets output, 208858645583 bytes, 2 underruns
     38653 output errors, 53866 collisions, 4958 interface resets
     6 unknown protocol drops
     0 babbles, 8852 late collision, 29595 deferred
     3 lost carrier, 0 no carrier, 21672 pause output

The CSW1 inf:

     7018705987 packets input, 2486197387479 bytes, 0 no buffer
     Received 6056923 broadcasts (4917921 multicasts)
     78193 runts, 0 giants, 0 throttles
     145194 input errors, 67001 CRC, 0 frame, 0 overrun, 0 ignored
     0 input packets with dribble condition detected

     7306487991 packets output, 3774439462062 bytes, 0 underruns
     0 output errors, 37073 collisions, 0 interface resets
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier
     0 output buffer failures, 0 output buffers swapped out

I've got the show run all for only the two infs attached.  Duplex settings match.

This strikes me as bad hardware somewhere in the physical path (but my boss is looking for something more specific heh).

Thanks again for reading!

[Georg Pauwen]

Hello,

post the output of:

R1

show interfaces GigabitEthernet8

CSW1

show interfaces GigabitEthernet5/43

Also, what platforms are you using (e.g. ISR4321, Catalyst 3750), and which IOS (XE) versions are you running ?

[Bob Greer]

Hi Georg,

Thanks again for reading.  Here's the hardware and IOS versions.  Attached is the show interfaces output.

C892FSP-K9: 15.5(3)M

WS-C4507R+E: 03.02.03.SG

[Georg Pauwen]

Hello Bob,

the late collisions are unusual Do you have port 5/43 on the 4507 configured with 'speed nonegotiate' ?

What options do you have on the 892 with regard to interface settings ?

892(config-if)#?

[Bob Greer]

Thanks again both of your for writing.

@Reza: I will recommend swapping the cat5 as a starting point.

@Georg:Please see the show run all for the two interfaces.

[Georg Pauwen]

Bob,

I don't see 'speed nonegotiate' on the switch interface.

That said, Reza's post reminded me of something: make sure you have a Cat 5e cable or better. That is required for GigabitEthernet. I have come across a few cases where standard Cat 5 cables were used...

[Bob Greer]

Hi guys,

One of my peers had one of the interfaces set to half-duplex.  By the time I showed stats on the infs, they had set to auto.  Thought you'd be curious.

Thanks for your help!

Bob

[Reza Sharifi]

Hi,

Can you make sure both sides are configured as auto or hard set to Gig.

HTH

[Reza Sharifi]

Hi Bob,

It appears that only the router's interface has output errors, collisions, interface reset, etc..and the switch interface is clean.  I think before you change any hardware you should simply replace the copper cable between the 2 devices. If that does not help, you can than fail-over HSRP from router-1 to router-2. If the problem disappears than the issue could be a faulty interface on router-1.

HTH