LACP failing between 2 C9500-16X switches

[Damon2021]

Hi,

I have 2 C9500-16X with 2 cables connecting each other. I would like to configure the interlinks as port channel LACP. I am getting below error:

%ETC-5-L3DONTBNDL2: Te1/0/14 suspended: LACP currently not enabled on the remote port.

Here are the configs:

Cat9500-SW1:

!

interface Port-channel1
switchport trunk allowed vlan 10,20,30
switchport mode trunk
switchport nonegotiate
dampening
bandwidth 10000000
load-interval 30
carrier-delay msec 0
end

!

interface TenGigabitEthernet1/0/14
switchport trunk allowed vlan 10,20,30
switchport mode trunk
switchport nonegotiate
dampening
bandwidth 10000000
load-interval 30
carrier-delay msec 0
channel-protocol lacp
channel-group 1 mode active
end

interface TenGigabitEthernet1/0/15
switchport trunk allowed vlan 10,20,30
switchport mode trunk
switchport nonegotiate
dampening
bandwidth 10000000
load-interval 30
carrier-delay msec 0
channel-protocol lacp
channel-group 1 mode active
end




Cat9500-SW2:

!

interface Port-channel1
switchport trunk allowed vlan 10,20,30
switchport mode trunk
switchport nonegotiate
dampening
bandwidth 10000000
load-interval 30
carrier-delay msec 0
end

!
interface TenGigabitEthernet1/0/14
switchport trunk allowed vlan 10,20,30
switchport mode trunk
switchport nonegotiate
dampening
bandwidth 10000000
load-interval 30
carrier-delay msec 0
channel-protocol lacp
channel-group 1 mode active
end

!
interface TenGigabitEthernet1/0/15
switchport trunk allowed vlan 10,20,30
switchport mode trunk
switchport nonegotiate
dampening
bandwidth 10000000
load-interval 30
carrier-delay msec 0
channel-protocol lacp
channel-group 1 mode active
end

Thanks

[balaji.bandi]

Group Port-channel Protocol Ports
------+-------------+-----------+-----------------------------------------------
1 Po1(SD) LACP Te1/0/14(I) Te1/0/15(I)

from what switch this output, this show they are individual ports, not configured as a trunk

As one of the posts suggested, default the interface and configure a simple config and test.

I have asked for some information- that information very important to understand the config.

by the what IOS-XE code running on both?

[Damon2021]

I did default and configured them again. It does the same thing.

Both running 17.x code

[balaji.bandi]

show etherchannel 1 summary

show interface TenGigabitEthernet1/0/14

show interface TenGigabitEthernet1/0/15

post the above information from both the switches - and give the Full IOS XE version to look for any bugs associated with that ( 17. X  have more 15 version available)

[MHM Cisco World]

show platform hardware fed switch XX qos queue config interface Te1/0/14 

check if the priority level 1 have queue length or it "0"

from above after add command both SW don't send or don't receive LACP, there is drop
either in L1 cable 
or
queue receive the LACP message 

[Damon2021]

Here is the output: (I dont see where to it show priority level)

Asic:0 Core:0 DATA Port:13 GPN:14 LinkSpeed:0xa
AFD:Disabled FlatAFD:Disabled QoSMap:0 HW Queues: 104 - 111
DrainFast:Disabled PortSoftStart:2 - 10800
DTS Hardmax Softmax PortSMin GlblSMin PortStEnd
----- -------- -------- -------- -------- ---------
0 1 6 1200 7 4800 16 2400 0 0 4 14400
1 1 5 0 8 7200 16 3600 8 1800 4 14400
2 1 5 0 6 0 0 0 0 0 4 14400
3 1 5 0 6 0 0 0 0 0 4 14400
4 1 5 0 6 0 0 0 0 0 4 14400
5 1 5 0 6 0 0 0 0 0 4 14400
6 1 5 0 6 0 0 0 0 0 4 14400
7 1 5 0 6 0 0 0 0 0 4 14400
Priority Shaped/shared weight shaping_step sharpedWeight
-------- ------------- ------ ------------ -------------
0 0 Shared 50 0 0
1 0 Shared 75 0 0
2 0 Shared 10000 0 0
3 0 Shared 10000 0 0
4 0 Shared 10000 0 0
5 0 Shared 10000 0 0
6 0 Shared 10000 0 0
7 0 Shared 10000 0 0
Port Port Port Port
Priority Shaped/shared weight shaping_step
-------- ------------- ------ ------------
2 Shaped 254 255

Weight0 Max_Th0 Min_Th0 Weigth1 Max_Th1 Min_Th1 Weight2 Max_Th2 Min_Th2
------- ------- ------- ------- ------- ------- ------- ------- ------
0 0 4781 0 0 5343 0 0 6000 0
1 0 5737 0 0 6412 0 0 7200 0
2 0 0 0 0 0 0 0 0 0
3 0 0 0 0 0 0 0 0 0
4 0 0 0 0 0 0 0 0 0
5 0 0 0 0 0 0 0 0 0
6 0 0 0 0 0 0 0 0 0
7 0 0 0 0 0 0 0 0 0

[MHM Cisco World]

Priority Shaped/shared weight shaping_step sharpedWeight
-------- ------------- ------ ------------ -------------
0 0 Shared 50 0 0
1 0 Shared 75 0 0
2 0 Shared 10000 0 0
3 0 Shared 10000 0 0
4 0 Shared 10000 0 0
5 0 Shared 10000 0 0
6 0 Shared 10000 0 0
7 0 Shared 10000 0 0
Port Port Port Port
Priority Shaped/shared weight shaping_step
-------- ------------- ------ ------------
2 Shaped 254 255

Weight0 Max_Th0 Min_Th0 Weigth1 Max_Th1 Min_Th1 Weight2 Max_Th2 Min_Th2
------- ------- ------- ------- ------- ------- ------- ------- ------
0 0 4781(drop) 0 0 5343(drop) 0 0 6000(drop) 0
1 0 5737(drop) 0 0 6412(drop) 0 0 7200(drop) 0
2 0 0 0 0 0 0 0 0 0
3 0 0 0 0 0 0 0 0 0
4 0 0 0 0 0 0 0 0 0
5 0 0 0 0 0 0 0 0 0
6 0 0 0 0 0 0 0 0 0
7 0 0 0 0 0 0 0 0 0

[paul.driver]

Hello
If they are two cisco devcies then why dont you use PAGP instead?

L2 etherchannel
1) default physical interfaces (if possible)
2) configure port-channel in physical interfaces

-- port-channel will be created automatically

3)create trunking encapsulation or access port mode directly in port-channel interface
4)enable physical interfaces "no shut"

conf t
default int ran ten1/0/14-15 ( if applicable)

int ran ten1/0/14-15
shut ( if applicable)
channel-group 1 mode desirable


int port-channel 1
switchport mode trunk
switchport nonegotiate


int ran ten1/0/14-15
no shut ( if applicable)

[paul driver]

Hello
If they are two cisco devcies then and use PAGP instead also do not append any BW and test?

L2 etherchannel
1) default physical interfaces (if possible)
2) configure port-channel in physical interfaces

-- port-channel will be created automatically

3)create trunking encapsulation or access port mode directly in port-channel interface
4)enable physical interfaces "no shut"

conf t
default int ran ten1/0/14-15 ( if applicable)

int ran ten1/0/14-15
shut ( if applicable)
channel-group 1 mode desirable


int port-channel 1
switchport mode trunk
switchport nonegotiate


int ran ten1/0/14-15
no shut ( if applicable)

[Damon2021]

I followed this process and pagp is still showing standalone.

1 Po1(SD) PAgP Te1/0/14(I) Te1/0/15(I)




!
interface Port-channel1
switchport mode trunk
switchport nonegotiate
end




interface TenGigabitEthernet1/0/14
switchport mode trunk
switchport nonegotiate
channel-group 1 mode desirable
end




interface TenGigabitEthernet1/0/15
switchport mode trunk
switchport nonegotiate
channel-group 1 mode desirable
end

[MHM Cisco World]

Te1/0/14 suspended trunk full 10G SFP-10GBase-LR
Te1/0/15 notconnect trunk full 10G SFP-10GBase-LR

last days I analysis the issue many times, the LACP is L2 not L1 but here I see one side show NONCONNECT <<<
so I think that SFP is not work in your SW

https://www.youtube.com/watch?v=s37Nr2VGfhY

this video can you make review and check the SFP.

show interface transceiver detail <<- check the L1 health of SFP.

[Damon2021]

Here is the debug of pagp from switch2:

Jun 27 18:12:22: PAgP: pagp_h(Te1/0/15) expired
Jun 27 18:12:22: FEC: pagp_switch_groupinfo - group 1
Jun 27 18:12:22: PAgP: Send information packet via Te1/0/15, packet size: 98
Jun 27 18:12:22: flags: 0, my device ID: 0001.0202.aabb, learn-cap: 2, port-priority: 128,
sent-port-ifindex: 17, group-cap: 10001, group-ifindex: 0
Jun 27 18:12:22: your device ID: 0000.0000.0000, learn-cap: 0, port-priority: 0,
sent-port-ifindex: 0, group-cap: 0, group-ifindex: 0
Jun 27 18:12:22: partner count: 0, num-tlvs: 2
Jun 27 18:12:22: device name TLV: Switch2
Jun 27 18:12:22: port name TLV: Te1/0/15
Jun 27 18:12:22: PAgP: 98 bytes out Te1/0/15
Jun 27 18:12:22: PAgP: Te1/0/15 Transmitting information packet
Jun 27 18:12:22: PAgP: timer pagp_h(Te1/0/15) started with interval 1000.
Jun 27 18:12:22: PAgP: Receive information packet via Te1/0/14, packet size: 97
Jun 27 18:12:22: flags: 0, my device ID: 0001.0202.aabb, learn-cap: 2, port-priority: 128,
sent-port-ifindex: 16, group-cap: 10001, group-ifindex: 0
Jun 27 18:12:22: your device ID: 0000.0000.0000, learn-cap: 0, port-priority: 0,
sent-port-ifindex: 0, group-cap: 0, group-ifindex: 0
Jun 27 18:12:22: partner count: 0, num-tlvs: 2
Jun 27 18:12:22: device name TLV: Switch1
Jun 27 18:12:22: port name TLV: Te1/0/14
Jun 27 18:12:22: PAgP: Te1/0/14 PAgP packet received, processing
Jun 27 18:12:22: PAgP: reflected pkt dropping: Te1/0/14 came on Te1/0/14
Jun 27 18:12:22: PAgP: Receive information packet via Te1/0/15, packet size: 97
Jun 27 18:12:22: flags: 0, my device ID: 0001.0202.aabb, learn-cap: 2, port-priority: 128,
sent-port-ifindex: 17, group-cap: 10001, group-ifindex: 0
Jun 27 18:12:22: your device ID: 0000.0000.0000, learn-cap: 0, port-priority: 0,
sent-port-ifindex: 0, group-cap: 0, group-ifindex: 0
Jun 27 18:12:22: partner count: 0, num-tlvs: 2
Jun 27 18:12:22: device name TLV: Switch1
Jun 27 18:12:22: port name TLV: Te1/0/15
Jun 27 18:12:22: PAgP: Te1/0/15 PAgP packet received, processing
Jun 27 18:12:22: PAgP: reflected pkt dropping: Te1/0/15 came on Te1/0/15
Jun 27 18:12:23: PAgP: pagp_h(Te1/0/14) expired
Jun 27 18:12:23: FEC: pagp_switch_groupinfo - group 1
Jun 27 18:12:23: PAgP: Send information packet via Te1/0/14, packet size: 98
Jun 27 18:12:23: flags: 0, my device ID: 0001.0202.aabb, learn-cap: 2, port-priority: 128,
sent-port-ifindex: 16, group-cap: 10001, group-ifindex: 0
Jun 27 18:12:23: your device ID: 0000.0000.0000, learn-cap: 0, port-priority: 0,
sent-port-ifindex: 0, group-cap: 0, group-ifindex: 0
Jun 27 18:12:23: partner count: 0, num-tlvs: 2
Jun 27 18:12:23: device name TLV: Switch2
Jun 27 18:12:23: port name TLV: Te1/0/14
Jun 27 18:12:23: PAgP: 98 bytes out Te1/0/14
Jun 27 18:12:23: PAgP: Te1/0/14 Transmitting information packet
Jun 27 18:12:23: PAgP: timer pagp_h(Te1/0/14) started with interval 30000.
Jun 27 18:12:23: PAgP: pagp_s(Te1/0/15) expired
Jun 27 18:12:23: PAgP: Te1/0/15 action_b7 is entered
Jun 27 18:12:23: PAgP: pagp_s(Te1/0/15) timer stopped
Jun 27 18:12:23: PAgP: set hello interval from 1000 to 30000 for port Te1/0/15
Jun 27 18:12:23: PAgP: Te1/0/15 Input = Transmission State, V9 Old State = U3 New State = U4
Jun 27 18:12:23: PAgP: pagp_h(Te1/0/15) expired
Jun 27 18:12:23: FEC: pagp_switch_groupinfo - group 1
Jun 27 18:12:23: PAgP: Send information packet via Te1/0/15, packet size: 98
Jun 27 18:12:23: flags: 0, my device ID: 0001.0202.aabb, learn-cap: 2, port-priority: 128,
sent-port-ifindex: 17, group-cap: 10001, group-ifindex: 0
Jun 27 18:12:23: your device ID: 0000.0000.0000, learn-cap: 0, port-priority: 0,
sent-port-ifindex: 0, group-cap: 0, group-ifindex: 0
Jun 27 18:12:23: partner count: 0, num-tlvs: 2
Jun 27 18:12:23: device name TLV: Switch2
Jun 27 18:12:23: port name TLV: Te1/0/15
Jun 27 18:12:23: PAgP: 98 bytes out Te1/0/15
Jun 27 18:12:23: PAgP: Te1/0/15 Transmitting information packet
Jun 27 18:12:23: PAgP: timer pagp_h(Te1/0/15) started with interval 30000.
Jun 27 18:12:24: PAgP: pagp_i(Te1/0/15) expired
Jun 27 18:12:24: PAgP: Te1/0/15 action_a11 is entered
Jun 27 18:12:24: FEC: fec_dontbundle: Te1/0/15
Jun 27 18:12:24: FEC: pagp_switch_groupinfo - group 1
Jun 27 18:12:24: FEC: pagp_switch_independent_port: Te1/0/15
Jun 27 18:12:24: FEC: pagp_switch_reset_load_index: reading load-index for port Te1/0/15
Jun 27 18:12:24: PAgP: pagp_i(Te1/0/15) timer stopped
Jun 27 18:12:24: PAgP: Te1/0/15 Input = Port State, E3 Old State = S2 New State = S4
Jun 27 18:12:25: PAgP: pagp_i(Te1/0/14) expired
Jun 27 18:12:25: PAgP: Te1/0/14 action_a11 is entered
Jun 27 18:12:25: FEC: fec_dontbundle: Te1/0/14
Jun 27 18:12:25: FEC: pagp_switch_groupinfo - group 1
Jun 27 18:12:25: FEC: pagp_switch_independent_port: Te1/0/14
Jun 27 18:12:25: FEC: pagp_switch_reset_load_index: reading load-index for port Te1/0/14
Jun 27 18:12:25: PAgP: pagp_i(Te1/0/14) timer stopped
Jun 27 18:12:25: PAgP: Te1/0/14 Input = Port State, E3 Old State = S2 New State = S4
Jun 27 18:12:25: %LINEPROTO-5-UPDOWN: Line protocol on Interface TenGigabitEthernet1/0/15, changed state to up
Jun 27 18:12:25: %SYS-5-CONFIG_I: Configured from console by admin on vty0 (10.7.11.47)
Jun 27 18:12:26: FEC: pagp_switch_groupinfo - group 1
Jun 27 18:12:26: %LINEPROTO-5-UPDOWN: Line protocol on Interface TenGigabitEthernet1/0/14, changed state to up
Jun 27 18:12:32: FEC: pagp_switch_groupinfo - group 1
Jun 27 18:12:32: FEC: pagp_switch_groupinfo - group 1
Jun 27 18:12:32: FEC: pagp_switch_groupinfo - group 1

[Damon2021]

Is this normal for both switches to have same MAC address? Is this somehow causing the issue?

L3-Sw1#sh switch 
Switch/Stack Mac Address : 0001.0202.aabb - Local Mac Address
Mac persistency wait time: Indefinite
H/W Current
Switch# Role Mac Address Priority Version State 
-------------------------------------------------------------------------------------
*1 Active 0001.0202.aabb 1 V01 Ready







L3-Sw2#sh switch
Switch/Stack Mac Address : 0001.0202.aabb - Local Mac Address
Mac persistency wait time: Indefinite
H/W Current
Switch# Role Mac Address Priority Version State
-------------------------------------------------------------------------------------
*1 Active 0001.0202.aabb 1 V01 Ready 

[David Ruess]

The switches should not have the same MAC address. Is this a virtual lab/setup, I didnt go back to check if it was or not?

Issue the:

sh int port-channel 1

command. If they are also the same, that's plikely the problem.

-Daivd

[Damon2021]

Here is the output:

L3-Sw1#sh int port-channel 1
Port-channel1 is down, line protocol is down (notconnect) 
Hardware is EtherChannel, address is 0000.0000.0000 (bia 0000.0000.0000)
MTU 1500 bytes, BW 10000000 Kbit/sec, DLY 100 usec, 
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set







L3-Sw2#sh int port-channel 1

Port-channel1 is down, line protocol is down (notconnect)
Hardware is EtherChannel, address is 0000.0000.0000 (bia 0000.0000.0000)
MTU 1500 bytes, BW 10000000 Kbit/sec, DLY 100 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set

[MHM Cisco World · Accepted solution]

First You are so so do great job
this is bug I think and that explain a lot about this issue.
https://bst.cloudapps.cisco.com/bugsearch/bug/CSCvx58338

https://community.cisco.com/t5/discussões-routing-switching/problem-for-disable-stack-default-switch-cisco-9500-40x-a/td-p/4388424

Very good job man