Good morning all. I am troubleshooting an issue with a switch in our network our Distro Node (SW1) which connects to a Core Node (SW2) through a port-channel is having an issue with one of its interfaces which causes an outage about once a day for an hour or so. I have attached the configs and errors that we are getting there are two interfaces configured for the port-channel but the second interface is down due to a fiber cut. TIA.
=======================================
SW1 - C9300
=======================================
interface GigabitEthernet1/0/1
description XXX
switchport trunk native vlan XXX
switchport trunk allowed vlan XXX
switchport mode trunk
switchport nonegotiate
channel-protocol lacp
channel-group 1 mode active
service-policy output BANDWIDTH
interface Port-channel1
description XXX
switchport trunk native vlan XXX
switchport trunk allowed XXX
switchport mode trunk
switchport nonegotiate
end
Aug 20 13:01:29.485: %UDLD-4-UDLD_PORT_DISABLED: UDLD disabled interface Gi1/0/1, unidirectional link detected
Aug 20 13:01:29.516: %PM-4-ERR_DISABLE: udld error detected on Gi1/0/1, putting Gi1/0/1 in err-disable state
Aug 20 13:01:30.491: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/0/1, changed state to down
Aug 20 13:01:30.499: %LINEPROTO-5-UPDOWN: Line protocol on Interface Port-channel1, changed state to down
Aug 20 13:01:31.509: %LINK-3-UPDOWN: Interface Port-channel1, changed state to down
Aug 20 13:01:31.522: %LINK-3-UPDOWN: Interface GigabitEthernet1/0/1, changed state to down
Aug 20 13:11:29.517: %PM-4-ERR_RECOVER: Attempting to recover from udld err-disable state on Gi1/0/1
Aug 20 13:11:31.664: %LINK-3-UPDOWN: Interface GigabitEthernet1/0/1, changed state to up
Aug 20 13:11:33.635: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/0/1, changed state to up
Aug 20 13:11:34.621: %LINK-3-UPDOWN: Interface Port-channel1, changed state to up
Aug 20 13:11:35.622: %LINEPROTO-5-UPDOWN: Line protocol on Interface Port-channel1, changed state to up
GigabitEthernet1/0/1 is up, line protocol is up (connected)
Hardware is Gigabit Ethernet, address is 00eb.d569.a401 (bia 00eb.d569.a401)
Description: XXX
MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 6/255
Encapsulation ARPA, loopback not set
Keepalive not set
Full-duplex, 1000Mb/s, link type is auto, media type is 1000BaseLX SFP
input flow-control is on, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:06, output 00:00:00, output hang never
Last clearing of "show interface" counters never
Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: Class-based queueing
Output queue: 0/40 (size/max)
5 minute input rate 24885000 bits/sec, 3062 packets/sec
5 minute output rate 7482000 bits/sec, 1788 packets/sec
3634479876 packets input, 3204419695642 bytes, 0 no buffer
Received 26387185 broadcasts (14724457 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 14724457 multicast, 0 pause input
0 input packets with dribble condition detected
2666598865 packets output, 1206231695947 bytes, 0 underruns
Output 21352830 broadcasts (0 multicasts)
0 output errors, 0 collisions, 2 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out
Transmit GigabitEthernet1/0/1 Receive
1206231695947 Total bytes 3204419695642 Total bytes
2637222976 Unicast frames 3608092691 Unicast frames
1202796061653 Unicast bytes 3201942914514 Unicast bytes
8023059 Multicast frames 14724457 Multicast frames
1339773999 Multicast bytes 1263441578 Multicast bytes
21352830 Broadcast frames 11662728 Broadcast frames
2095860295 Broadcast bytes 1213339550 Broadcast bytes
0 System FCS error frames 0 IpgViolation frames
0 MacUnderrun frames 0 MacOverrun frames
0 Pause frames 0 Pause frames
0 Cos 0 Pause frames 0 Cos 0 Pause frames
0 Cos 1 Pause frames 0 Cos 1 Pause frames
0 Cos 2 Pause frames 0 Cos 2 Pause frames
0 Cos 3 Pause frames 0 Cos 3 Pause frames
0 Cos 4 Pause frames 0 Cos 4 Pause frames
0 Cos 5 Pause frames 0 Cos 5 Pause frames
0 Cos 6 Pause frames 0 Cos 6 Pause frames
0 Cos 7 Pause frames 0 Cos 7 Pause frames
0 Oam frames 0 OamProcessed frames
0 Oam frames 0 OamDropped frames
1121640 Minimum size frames 365440 Minimum size frames
1376730159 65 to 127 byte frames 965372484 65 to 127 byte frames
372293538 128 to 255 byte frames 358346709 128 to 255 byte frames
167406773 256 to 511 byte frames 192374101 256 to 511 byte frames
138616814 512 to 1023 byte frames 108721262 512 to 1023 byte frames
402836432 1024 to 1518 byte frames 1176163367 1024 to 1518 byte frames
207593511 1519 to 2047 byte frames 833136514 1519 to 2047 byte frames
0 2048 to 4095 byte frames 0 2048 to 4095 byte frames
0 4096 to 8191 byte frames 0 4096 to 8191 byte frames
0 8192 to 16383 byte frames 0 8192 to 16383 byte frames
0 16384 to 32767 byte frame 0 16384 to 32767 byte frame
0 > 32768 byte frames 0 > 32768 byte frames
0 Late collision frames 0 SymbolErr frames
0 Excess Defer frames 0 Collision fragments
0 Good (1 coll) frames 0 ValidUnderSize frames
0 Good (>1 coll) frames 0 InvalidOverSize frames
0 Deferred frames 0 ValidOverSize frames
0 Gold frames dropped 0 FcsErr frames
0 Gold frames truncated
0 Gold frames successful
0 1 collision frames
0 2 collision frames
0 3 collision frames
0 4 collision frames
0 5 collision frames
0 6 collision frames
0 7 collision frames
0 8 collision frames
0 9 collision frames
0 10 collision frames
0 11 collision frames
0 12 collision frames
0 13 collision frames
0 14 collision frames
0 15 collision frames
0 Excess collision frames
=======================================
SW2 - C9407R
=======================================
interface GigabitEthernet2/0/2
description XXX
switchport trunk native vlan XXX
switchport trunk allowed vlan XXX
switchport mode trunk
switchport nonegotiate
channel-group 2 mode active
end
interface Port-channel2
description XXX
switchport trunk native vlan XXX
switchport trunk allowed vlan XXX
switchport mode trunk
switchport nonegotiate
end
