LACP Between ASR9010 and Nexus 7000

[Aceso]

I cannot for a life of me seem to get the bundle to come up between an ASR9010 and a Nexus 7000.

I'm getting the same error on either l2 or l3 port channels and trunk/access on l2.

Simple config for testing:

Nexus: 

interface port-channel1 
switchport mode trunk 

interface Ethernet4/25 
channel-group 1 mode active 

interface Ethernet7/25 
channel-group 1 mode active 

ASR: 

interface Bundle-Ether1 
! 
interface TenGigE0/0/0/2 
bundle id 1 mode active 
! 
interface TenGigE0/1/0/2 
bundle id 1 mode active 

On the Nexus the ports go into suspend and on the ASR I get the following when looking at the bundle:

Partner System ID/Key do not match that of the Selected links

[nazimkha]

You can try configuring the LACP system priority.
https://www.cisco.com/c/en/us/td/docs/switches/datacenter/sw/5_x/nx-os/interfaces/configuration/guide/if_cli/if_portchannel.html#54506

Also you can try enabling debugs, verifying correct configuration, changing active to passive on one side, trying with static port-channel,etc

[Aceso]

I've tried active/passive both ways on each side.

I've also tried: no lacp suspend-individual and no graceful-convergence on the Nexus side.

[ADP_89]

Hello,

Are you sure that cabling is don properly? Can you enable cdp an check if actually everthing looks ok?

Additionally can you paste the following command:

From the ASR:

show bundle bundle-e 1

show lacp port Te0/0/0/0

show lacp port Te0/0/0/1

From the Nexus:

show lacp interface Et1/1

show lacp interface Et1/2

Thanks,

ADP

[Aceso]

Yes, both sets of ports will come up and pass traffic if they are not in the port-channel/bundle.

show bundle bundle-ether 1

Tue Sep 18 09:45:26.701 MDT

Bundle-Ether1
Status: Down
Local links <active/standby/configured>: 0 / 0 / 2
Local bandwidth <effective/available>: 0 (0) kbps
MAC address (source): 4055.3941.71db (Chassis pool)
Inter-chassis link: No
Minimum active links / bandwidth: 1 / 1 kbps
Maximum active links: 64
Wait while timer: 2000 ms
Load balancing: Default
LACP: Operational
Flap suppression timer: Off
Cisco extensions: Disabled
Non-revertive: Disabled
mLACP: Not configured
IPv4 BFD: Not configured

Port Device State Port ID B/W, kbps
-------------------- --------------- ----------- -------------- ----------
Te0/0/0/2 Local Configured 0x8000, 0x0001 10000000
Partner System ID/Key do not match that of the Selected links
Te0/1/0/2 Local Configured 0x8000, 0x0002 10000000
Partner System ID/Key do not match that of the Selected links

show lacp tenGigE 0/0/0/2
Tue Sep 18 09:47:14.408 MDT
State: a - Port is marked as Aggregatable.
s - Port is Synchronized with peer.
c - Port is marked as Collecting.
d - Port is marked as Distributing.
A - Device is in Active mode.
F - Device requests PDUs from the peer at fast rate.

show lacp tenGigE 0/1/0/2
Tue Sep 18 09:47:45.578 MDT
State: a - Port is marked as Aggregatable.
s - Port is Synchronized with peer.
c - Port is marked as Collecting.
d - Port is marked as Distributing.
A - Device is in Active mode.
F - Device requests PDUs from the peer at fast rate.
D - Port is using default values for partner information.
E - Information about partner has expired.

Bundle-Ether1

Port (rate) State Port ID Key System ID
-------------------- -------- ------------- ------ ------------------------
Local
Te0/1/0/2 30s a---A--- 0x8000,0x0002 0x0001 0x8000,40-55-39-41-71-dc
Partner 30s as--A--- 0x8000,0x0719 0x0000 0x8000,00-24-f7-1a-9c-41

Port Receive Period Selection Mux A Churn P Churn
-------------------- ---------- ------ ---------- --------- ------- -------
Local
Te0/1/0/2 Current Slow Unselect Detached Churn None

D - Port is using default values for partner information.
E - Information about partner has expired.

Bundle-Ether1

Port (rate) State Port ID Key System ID
-------------------- -------- ------------- ------ ------------------------
Local
Te0/0/0/2 30s a---A--- 0x8000,0x0001 0x0001 0x8000,40-55-39-41-71-dc
Partner 30s as--A--- 0x8000,0x0419 0x0000 0x8000,00-24-f7-1a-9c-41

Port Receive Period Selection Mux A Churn P Churn
-------------------- ---------- ------ ---------- --------- ------- -------
Local
Te0/0/0/2 Current Slow Unselect Detached Churn None

show lacp interface ethernet 4/25
Interface Ethernet4/25 is suspended
Channel group is 1 port channel is Po1
PDUs sent: 3471
PDUs rcvd: 3629
Markers sent: 0
Markers rcvd: 0
Marker response sent: 0
Marker response rcvd: 0
Unknown packets rcvd: 0
Illegal packets rcvd: 0
Lag Id: [ [(8000, 0-24-f7-1a-9c-41, 0, 8000, 419), (8000, 40-55-39-41-71-dc, 1, 8000, 1)] ]
Operational as aggregated link since Wed Dec 31 17:00:00 1969

Local Port: Eth4/25 MAC Address= 0-24-f7-1a-9c-41
System Identifier=0x8000,0-24-f7-1a-9c-41
Port Identifier=0x8000,0x419
Operational key=0
LACP_Activity=active
LACP_Timeout=Long Timeout (30s)
Synchronization=IN_SYNC
Collecting=false
Distributing=false
Partner information refresh timeout=Long Timeout (90s)
Actor Admin State=13
Actor Oper State=13
Neighbor: 0x1
MAC Address= 40-55-39-41-71-dc
System Identifier=0x8000,40-55-39-41-71-dc
Port Identifier=0x8000,0x1
Operational key=1
LACP_Activity=unknown
LACP_Timeout=Long Timeout (30s)
Synchronization=NOT_IN_SYNC
Collecting=false
Distributing=false
Partner Admin State=5
Partner Oper State=5
Aggregate or Individual(True=1)= 2

show lacp interface ethernet 7/25
Interface Ethernet7/25 is suspended
Channel group is 1 port channel is Po1
PDUs sent: 3315
PDUs rcvd: 3310
Markers sent: 0
Markers rcvd: 0
Marker response sent: 0
Marker response rcvd: 0
Unknown packets rcvd: 0
Illegal packets rcvd: 0
Lag Id: [ [(8000, 0-24-f7-1a-9c-41, 0, 8000, 719), (8000, 40-55-39-41-71-dc, 1, 8000, 2)] ]
Operational as aggregated link since Wed Dec 31 17:00:00 1969

Local Port: Eth7/25 MAC Address= 0-24-f7-1a-9c-41
System Identifier=0x8000,0-24-f7-1a-9c-41
Port Identifier=0x8000,0x719
Operational key=0
LACP_Activity=active
LACP_Timeout=Long Timeout (30s)
Synchronization=IN_SYNC
Collecting=false
Distributing=false
Partner information refresh timeout=Long Timeout (90s)
Actor Admin State=13
Actor Oper State=13
Neighbor: 0x2
MAC Address= 40-55-39-41-71-dc
System Identifier=0x8000,40-55-39-41-71-dc
Port Identifier=0x8000,0x2
Operational key=1
LACP_Activity=unknown
LACP_Timeout=Long Timeout (30s)
Synchronization=NOT_IN_SYNC
Collecting=false
Distributing=false
Partner Admin State=5
Partner Oper State=5
Aggregate or Individual(True=1)= 2

[nazimkha]

Try configuring 'LACP system priority' on nexus

https://www.cisco.com/c/en/us/td/docs/switches/datacenter/sw/5_x/nx-os/interfaces/configuration/guide/if_cli/if_portchannel.html#54506

[Aceso]

I've tried setting the system priority and the port priority to non default values, same results, the interfaces reset and go back to suspend.

[ADP_89 · Accepted solution]

This is quite weird to my eyes to be honest, the values sys and port values that you posted are matching all around. Have you tried to change port-channel id on both side? (that shouldn't be a problem.. but just for test)

Thanks,

ADP

[Aceso]

I know, it's crazy! We do a lot of port-channels and bundles, never had this happen.

ADP - check this out, set the ID to 2, still didn't work. Said why not 2000, works at 2000.

How weird!

[ADP_89]

Wow, that is weird.

But just out of curiosity, have you tried changing it only on the Nexus and that made the trick or have you changed it on both sides?

Thanks for updating us.

ADP

[Aceso]

I haven't tried changing only one side, I changed them both.