Solved: Re: VLAN trunk interface goes down after seconds - Page 3

seb1303 · ‎01-21-2024

Hello,

I currently try to get a couple of Cisco Catalyst 9500 switches running.

I would like to connect two StackWise Virtual stacks via VLAN trunking to each other.
See this basic image of the network:

After enabling one side get the VLAN trunk inferface up my whole network is not working for a few seconds until the link of the VLAN trunk interface goes down again. But the only thing I can see (on both StackWise switches) in logging is:

Jan 21 11:19:56.755: %LINK-3-UPDOWN: Interface HundredGigE1/0/28, changed state to down

Where can I dig deeper to get a more meaningful information?

The interface state is simply down. No errdisabled or something like that...

paul driver · ‎01-21-2024

Hello
Are those switch interconnects aggregated?
Can you post the trunk configration from the SW V1 & 2 please

sh run interface x/x
sh run interface port-channel
sh interface x/x status
sh interface x/x switchport
sh interface trunks
sh port-channel summary

Please rate and mark as an accepted solution if you have found any of the information provided useful.
This then could assist others on these forums to find a valuable answer and broadens the community’s global network.

Kind Regards
Paul

seb1303 · ‎01-27-2024

Here is the output:

SVL #1

# sh run interface hundredGigE 1/0/28
interface HundredGigE1/0/28
 switchport mode trunk
 channel-group 1 mode active
end

# sh run interface hundredGigE 2/0/28
interface HundredGigE2/0/28
 switchport mode trunk
 channel-group 1 mode active
end

# sh run interface port-channel 1
interface Port-channel1
 switchport mode trunk
end

# sh interface hundredGigE 1/0/28 status
Port         Name               Status       Vlan       Duplex  Speed Type
Hu1/0/28                        notconnect   1            full   100G QSFP 100G CWDM4

# sh interface hundredGigE 2/0/28 status
Port         Name               Status       Vlan       Duplex  Speed Type
Hu2/0/28                        notconnect   1            full   100G QSFP 100G CWDM4

# sh interface hundredGigE 1/0/28
HundredGigE1/0/28 is down, line protocol is down (notconnect)
  Hardware is Hundred Gigabit Ethernet, address is 3c8b.7f57.b2fc (bia 3c8b.7f57.b2fc)
  MTU 1500 bytes, BW 100000000 Kbit/sec, DLY 10 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation ARPA, loopback not set
  Keepalive set (10 sec)
  Full-duplex, 100Gb/s, link type is auto, media type is QSFP 100G CWDM4
  Fec is auto
  input flow-control is on, output flow-control is off
  ARP type: ARPA, ARP Timeout 04:00:00
  Last input 00:26:26, output 00:26:25, output hang never
  Last clearing of "show interface" counters 12w6d
  Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo
  Output queue: 0/40 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 0 bits/sec, 0 packets/sec
     26973 packets input, 2059624 bytes, 0 no buffer
     Received 26884 broadcasts (26884 multicasts)
     0 runts, 0 giants, 0 throttles
     14 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
     0 watchdog, 26884 multicast, 0 pause input
     0 input packets with dribble condition detected
     9932 packets output, 858788 bytes, 0 underruns
     Output 4008 broadcasts (0 multicasts)
     0 output errors, 0 collisions, 7 interface resets
     18 unknown protocol drops
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier, 0 pause output
     0 output buffer failures, 0 output buffers swapped out

# sh interface hundredGigE 2/0/28
HundredGigE2/0/28 is down, line protocol is down (notconnect)
  Hardware is Hundred Gigabit Ethernet, address is 5c31.924b.711c (bia 5c31.924b.711c)
  MTU 1500 bytes, BW 100000000 Kbit/sec, DLY 10 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation ARPA, loopback not set
  Keepalive set (10 sec)
  Full-duplex, 100Gb/s, link type is auto, media type is QSFP 100G CWDM4
  Fec is auto
  input flow-control is on, output flow-control is off
  ARP type: ARPA, ARP Timeout 04:00:00
  Last input 00:15:22, output 00:15:22, output hang never
  Last clearing of "show interface" counters 12w6d
  Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo
  Output queue: 0/40 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 0 bits/sec, 0 packets/sec
     14268 packets input, 1109615 bytes, 0 no buffer
     Received 14209 broadcasts (14209 multicasts)
     0 runts, 0 giants, 0 throttles
     9 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
     0 watchdog, 14209 multicast, 0 pause input
     0 input packets with dribble condition detected
     6711 packets output, 578792 bytes, 0 underruns
     Output 2461 broadcasts (0 multicasts)
     0 output errors, 0 collisions, 2 interface resets
     14 unknown protocol drops
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier, 0 pause output
     0 output buffer failures, 0 output buffers swapped out

# sh interface trunk
Port           Mode             Encapsulation  Status        Native vlan
Twe1/0/5       on               802.1q         trunking      1
Twe1/0/7       on               802.1q         trunking      1
Twe2/0/5       on               802.1q         trunking      1
Twe2/0/7       on               802.1q         trunking      1
Po2            on               802.1q         trunking      1
Po3            on               802.1q         trunking      1

Port           Vlans allowed on trunk
Twe1/0/5       1-4093
Twe1/0/7       1-4093
Twe2/0/5       1-4093
Twe2/0/7       1-4093
Po2            1-4093
Po3            1-4093

Port           Vlans allowed and active in management domain
Twe1/0/5       1-2,10,20-23,26,30,40,80,90,99,101-102,111-114,131,200,500,721,2190,2194,2252,2255,3801-3809,3898-3899,3901-3902,4000-4008,4010,4031,4041,4050-4052
Twe1/0/7       1-2,10,20-23,26,30,40,80,90,99,101-102,111-114,131,200,500,721,2190,2194,2252,2255,3801-3809,3898-3899,3901-3902,4000-4008,4010,4031,4041,4050-4052
Twe2/0/5       1-2,10,20-23,26,30,40,80,90,99,101-102,111-114,131,200,500,721,2190,2194,2252,2255,3801-3809,3898-3899,3901-3902,4000-4008,4010,4031,4041,4050-4052
Twe2/0/7       1-2,10,20-23,26,30,40,80,90,99,101-102,111-114,131,200,500,721,2190,2194,2252,2255,3801-3809,3898-3899,3901-3902,4000-4008,4010,4031,4041,4050-4052

Port           Vlans allowed and active in management domain
Po2            1-2,10,20-23,26,30,40,80,90,99,101-102,111-114,131,200,500,721,2190,2194,2252,2255,3801-3809,3898-3899,3901-3902,4000-4008,4010,4031,4041,4050-4052
Po3            1-2,10,20-23,26,30,40,80,90,99,101-102,111-114,131,200,500,721,2190,2194,2252,2255,3801-3809,3898-3899,3901-3902,4000-4008,4010,4031,4041,4050-4052

Port           Vlans in spanning tree forwarding state and not pruned
Twe1/0/5       1-2,10,20-23,26,30,40,80,90,99,101-102,111-114,131,200,500,721,2190,2194,2252,2255,3801-3809,3898-3899,3901-3902,4000-4008,4010,4031,4041,4050-4052
Twe1/0/7       1-2,10,20-23,26,30,40,80,90,99,101-102,111-114,131,200,500,721,2190,2194,2252,2255,3801-3809,3898-3899,3901-3902,4000-4008,4010,4031,4041,4050-4052
Twe2/0/5       1-2,10,20-23,26,30,40,80,90,99,101-102,111-114,131,200,500,721,2190,2194,2252,2255,3801-3809,3898-3899,3901-3902,4000-4008,4010,4031,4041,4050-4052
Twe2/0/7       1-2,10,20-23,26,30,40,80,90,99,101-102,111-114,131,200,500,721,2190,2194,2252,2255,3801-3809,3898-3899,3901-3902,4000-4008,4010,4031,4041,4050-4052
Po2            1-2,10,20-23,26,30,40,80,90,99,101-102,111-114,131,200,500,721,2190,2194,2252,2255,3801-3809,3898-3899,3901-3902,4000-4008,4010,4031,4041,4050-4052
Po3            1-2,10,20-23,26,30,40,80,90,99,101-102,111-114,131,200,500,721,2190,2194,2252,2255,3801-3809,3898-3899,3901-3902,4000-4008,4010,4031,4041,4050-4052

# sh interfaces port-channel 1 summary
 *: interface is up
 IHQ: pkts in input hold queue     IQD: pkts dropped from input queue
 OHQ: pkts in output hold queue    OQD: pkts dropped from output queue
 RXBS: rx rate (bits/sec)          RXPS: rx rate (pkts/sec)
 TXBS: tx rate (bits/sec)          TXPS: tx rate (pkts/sec)
 TRTL: throttle count

  Interface                   IHQ       IQD       OHQ       OQD      RXBS      RXPS      TXBS      TXPS      TRTL
-----------------------------------------------------------------------------------------------------------------
  Port-channel1                 0         0         0         0         0         0         0         0         0

SVL #2

# sh run interface hundredGigE 1/0/28
interface HundredGigE1/0/28
 switchport mode trunk
 shutdown
 channel-group 1 mode active
end

# sh run interface hundredGigE 2/0/28
interface HundredGigE2/0/28
 switchport mode trunk
 shutdown
 channel-group 1 mode active
end

# sh run interface port-channel 1
interface Port-channel1
 switchport mode trunk
 shutdown
end

# sh interface hundredGigE 1/0/28 status
Port         Name               Status       Vlan       Duplex  Speed Type
Hu1/0/28                        disabled     1            full   100G QSFP 100G CWDM4

# sh interface hundredGigE 2/0/28 status
Port         Name               Status       Vlan       Duplex  Speed Type
Hu2/0/28                        disabled     1            full   100G QSFP 100G CWDM4

# sh interface hundredGigE 1/0/28
HundredGigE1/0/28 is administratively down, line protocol is down (disabled)
  Hardware is Hundred Gigabit Ethernet, address is 3c8b.7f57.30fc (bia 3c8b.7f57.30fc)
  MTU 1500 bytes, BW 100000000 Kbit/sec, DLY 10 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation ARPA, loopback not set
  Keepalive set (10 sec)
  Full-duplex, 100Gb/s, link type is auto, media type is QSFP 100G CWDM4
  Fec is auto
  input flow-control is on, output flow-control is off
  ARP type: ARPA, ARP Timeout 04:00:00
  Last input 00:21:33, output 00:21:17, output hang never
  Last clearing of "show interface" counters 4d23h
  Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo
  Output queue: 0/40 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 0 bits/sec, 0 packets/sec
     3719 packets input, 328279 bytes, 0 no buffer
     Received 3568 broadcasts (2778 multicasts)
     0 runts, 0 giants, 0 throttles
     8 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
     0 watchdog, 2778 multicast, 0 pause input
     0 input packets with dribble condition detected
     8589 packets output, 675453 bytes, 0 underruns
     Output 0 broadcasts (0 multicasts)
     0 output errors, 0 collisions, 7 interface resets
     9 unknown protocol drops
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier, 0 pause output
     0 output buffer failures, 0 output buffers swapped out

# sh interface hundredGigE 2/0/28
HundredGigE2/0/28 is administratively down, line protocol is down (disabled)
  Hardware is Hundred Gigabit Ethernet, address is 6026.aaaf.04dc (bia 6026.aaaf.04dc)
  MTU 1500 bytes, BW 100000000 Kbit/sec, DLY 10 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation ARPA, loopback not set
  Keepalive set (10 sec)
  Full-duplex, 100Gb/s, link type is auto, media type is QSFP 100G CWDM4
  Fec is auto
  input flow-control is on, output flow-control is off
  ARP type: ARPA, ARP Timeout 04:00:00
  Last input 00:33:06, output 00:33:07, output hang never
  Last clearing of "show interface" counters 4d23h
  Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo
  Output queue: 0/40 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 0 bits/sec, 0 packets/sec
     51 packets input, 4272 bytes, 0 no buffer
     Received 51 broadcasts (51 multicasts)
     0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
     0 watchdog, 51 multicast, 0 pause input
     0 input packets with dribble condition detected
     88 packets output, 8518 bytes, 0 underruns
     Output 0 broadcasts (0 multicasts)
     0 output errors, 0 collisions, 4 interface resets
     5 unknown protocol drops
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier, 0 pause output
     0 output buffer failures, 0 output buffers swapped out

# sh interface trunk
# nothint to show here because there is nothing other attached/configured to the switch

# sh interfaces port-channel 1 summary
 *: interface is up
 IHQ: pkts in input hold queue     IQD: pkts dropped from input queue
 OHQ: pkts in output hold queue    OQD: pkts dropped from output queue
 RXBS: rx rate (bits/sec)          RXPS: rx rate (pkts/sec)
 TXBS: tx rate (bits/sec)          TXPS: tx rate (pkts/sec)
 TRTL: throttle count

  Interface                   IHQ       IQD       OHQ       OQD      RXBS      RXPS      TXBS      TXPS      TRTL
-----------------------------------------------------------------------------------------------------------------
  Port-channel1                 0         0         0         0         0         0         0         0         0

Georg Pauwen · ‎01-27-2024

Hello,

odd indeed. What if you configure the port channel and the member interfaces like this:

interface HundredGigE1/0/28
switchport
switchport mode trunk
switchport nonegotiate
logging event link-status
logging event trunk-status
logging event bundle-status
udld port aggressive
channel-protocol lacp
channel-group 1 mode active

interface HundredGigE2/0/28
switchport
switchport mode trunk
switchport nonegotiate
logging event link-status
logging event trunk-status
logging event bundle-status
udld port aggressive
channel-protocol lacp
channel-group 1 mode active

interface Port-channel1
switchport
switchport mode trunk
switchport nonegotiate

seb1303 · ‎01-27-2024

No change of the behavior at all

MHM Cisco World · ‎01-29-2024

Show interface count error

Share this I see some input error

MHM

seb1303 · ‎01-31-2024

I finally got it working... two problems I identified:

1. Both stacks had the same STP priority which lead to a short network outage at the beginning of each connection try

2. I used the wrong cables. The SFPs are for multi mode - I used single mode cables. Big mistake, but it happend...

Thanks to all for their help! I really appreciate it.

MHM Cisco World · ‎01-31-2024

2. I used the wrong cables. The SFPs are for multi mode - I used single mode cables. Big mistake, but it happend...

Ohhhh finally' I send to you twice' check cabling first step in PO.

So so so happy the issue is solved

Have a great nice day

MHM

seb1303 · ‎01-31-2024

Yes, cabling... I wasn't on-site. And nobody which was on-site could help...
Thanks @MHM Cisco World !

MHM Cisco World · ‎01-31-2024

Friend you are so so welcome

And I sorry if I was late in reply

Words like thanks make us continue to support you and other engineer.

Have a good cabling day lol..

MHM

balaji.bandi · ‎01-31-2024

Glad to know it all resolved now - i was suspected the cables when things come up and down. but you have confirmed cables are OM3 not OS2 ?

BB

=====Preenayamo Vasudevam=====

***** Rate All Helpful Responses *****

How to Ask The Cisco Community for Help