Cisco-9200L LACP with Partner Switch

[jakkrit.m]

I need run LACP with Partner switch from two interface with Ether-Channel from CiscoA and CiscoB which running IRF but when plugged the cable found one interface goes down with error message :

*Nov 22 07:08:19.410: FEC: pagp_switch_hotstandby: for agport Po1
*Nov 22 07:08:19.410: FEC: pagp_switch_hotstandby: PAgP not enabled on agport Po1
*Nov 22 07:08:19.411: FEC: pagp_switch_ha_sync_complete: syncing bundled LACP data on Te1/1/1
*Nov 22 07:08:19.411: FEC: pagp_switch_send_lacp_ha_sync_data: pagp_status data on Te1/1/1 is 5
*Nov 22 07:08:19.411: FEC: pagp_switch_send_lacp_ha_sync_data: lacp sync data on Te1/1/1 flag: A00120 indx 0 gc 0
*Nov 22 07:08:19.411: FEC: pagp_switch_ha_sync_bundled: synced lacp data on Te1/1/1
*Nov 22 07:08:19.412: FEC: pagp_switch_port_down: Te1/1/1 Inform yes
*Nov 22 07:08:19.412: FEC: pagp_switch_invoke_port_down: Te1/1/1
*Nov 22 07:08:19.412: FEC: lacp_fec_unbundle_internal: Te1/1/1
*Nov 22 07:08:19.412: FEC: Un-Bndl msg NOT send to PM for port Te1/1/1 from Po1
*Nov 22 07:08:19.412: FEC: pagp_switch_reset_load_index: reading load-index for port Po1
*Nov 22 07:08:19.412: FEC: lacp_switch_delete_port_from_agport_internal: removing Te1/1/1 from Po1
*Nov 22 07:08:19.412: FEC: delete port (Te1/1/1) from agport (Po1)
*Nov 22 07:08:19.413: FEC: pagp_switch_delete_port_from_agport_list: afb->nports-- = 1 [Te1/1/1]
*Nov 22 07:08:19.413: FEC: lacp_switch_remove_port_from_associated_list_internal: Te1/1/1 deleted from the associated list for Po1
*Nov 22 07:08:19.413: FEC: lacp_switch_is_aggregator_valid: aggregator Po1 is still valid
*Nov 22 07:08:19.413: FEC: pagp_switch_reset_load_index: reading load-index for port Po1
*Nov 22 07:08:19.413: FEC: lacp_switch_is_aggregator_valid: aggregator Po1 is still valid
*Nov 22 07:08:19.413: FEC: lacp_switch_get_first_associated_port_from_agg_id: found port Te2/1/1 associated to Po1
*Nov 22 07:08:19.413: FEC: lacp_switch_is_port_in_associate_list: port Te2/1/1 is present in the associate list
*Nov 22 07:08:19.413: FEC: lacp_switch_get_next_associated_port_from_agg_id: no associated port next to Te2/1/1 in aggregator Po1
*Nov 22 14:08:20.407: %LINEPROTO-5-UPDOWN: Line protocol on Interface TenGigabitEthernet1/1/1, changed state to down
*Nov 22 14:08:21.414: %LINK-3-UPDOWN: Interface TenGigabitEthernet1/1/1, changed state to down
*Nov 22 07:08:21.415: FEC: lacp_switch_get_prot_enabled: returning [2] for Te1/1/1
*Nov 22 07:08:31.465: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po1 for admin_key [0x1] and oper_key [0x1]
*Nov 22 07:09:01.468: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po1 for admin_key [0x1] and oper_key [0x1]
*Nov 22 07:09:31.472: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po1 for admin_key [0x1] and oper_key [0x1]
*Nov 22 07:10:01.475: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po1 for admin_key [0x1] and oper_key [0x1]
*Nov 22 07:10:31.467: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po1 for admin_key [0x1] and oper_key [0x1]
*Nov 22 07:11:01.472: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po1 for admin_key [0x1] and oper_key [0x1]
*Nov 22 07:11:31.474: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po1 for admin_key [0x1] and oper_key [0x1]
*Nov 22 07:12:01.467: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po1 for admin_key [0x1] and oper_key [0x1]
*Nov 22 07:12:31.470: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po1 for admin_key [0x1] and oper_key [0x1]

From my configuration :

#interface Port-channel1
#description T-LACP-VAS-STACK
#switchport trunk allowed vlan 660-662
#switchport mode trunk

#interface TenGigabitEthernet1/1/1
#description T-VAS-STACK Te0/0/39
#switchport trunk allowed vlan 660-662
#switchport mode trunk
#channel-group 1 mode active

#interface TenGigabitEthernet2/1/1
#description T-VAS-STACK Te1/0/39
#switchport trunk allowed vlan 660-662
#switchport mode trunk
#channel-group 1 mode active

[marce1000]

 - Make sure that that  channel numbers are not the same on both devices, actually what do the logs of the device at the other end have to say and what model is this device ?

 M.

[jakkrit.m]

Thank you for your advise. I have LACP configure on Huawei Switch as below.

interface Eth-Trunk9
description TO-VAS-Cisco-9200L
port link-type trunk
port trunk allow-pass vlan 660 to 662
mode lacp

interface XGigabitEthernet0/0/39
description TO-Cisco9200L-G0/1/1
eth-trunk 9

interface XGigabitEthernet1/0/39
description TO-Cisco9200L-G1/1/1
eth-trunk 9

[marce1000]

 >...interface XGigabitEthernet0/0/39
 description TO-Cisco9200L-G0/1/1
 eth-trunk 9

   - Can you try to change the channel group to number 9 also on the 9200 with :  (on both interfaces)

             #interface TenGigabitEthernet1/1/1
             #description T-VAS-STACK Te0/0/39
             #switchport trunk allowed vlan 660-662
             #switchport mode trunk
             #channel-group 9 mode active

 M.

[jakkrit.m]

Now we have changed channel group 9 but the issue still exist interface is up/down. And I had try to change LACP mode to auto then show LACP summary, found status protocol is pAgp but when change LACP mode on and show LACP summary protocol is none.

*Nov 23 04:38:37.805: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po9 for admin_key [0x9] and oper_key [0x9]
*Nov 23 04:38:40.896: FEC: pagp_switch_hotstandby: for agport Po9
*Nov 23 04:38:40.896: FEC: pagp_switch_hotstandby: PAgP not enabled on agport Po9
*Nov 23 04:38:40.898: FEC: pagp_switch_ha_sync_complete: syncing bundled LACP data on Te2/1/1
*Nov 23 04:38:40.898: FEC: pagp_switch_send_lacp_ha_sync_data: pagp_status data on Te2/1/1 is 5
*Nov 23 04:38:40.898: FEC: pagp_switch_send_lacp_ha_sync_data: lacp sync data on Te2/1/1 flag: A00120 indx 0 gc 0
*Nov 23 04:38:40.898: FEC: pagp_switch_ha_sync_bundled: synced lacp data on Te2/1/1
*Nov 23 04:38:40.898: FEC: pagp_switch_port_down: Te2/1/1 Inform yes
*Nov 23 04:38:40.898: FEC: pagp_switch_invoke_port_down: Te2/1/1
*Nov 23 04:38:40.899: FEC: lacp_fec_unbundle_internal: Te2/1/1
*Nov 23 04:38:40.899: FEC: Un-Bndl msg NOT send to PM for port Te2/1/1 from Po9
*Nov 23 04:38:40.899: FEC: pagp_switch_reset_load_index: reading load-index for port Po9
*Nov 23 04:38:40.900: FEC: lacp_switch_delete_port_from_agport_internal: removing Te2/1/1 from Po9
*Nov 23 04:38:40.900: FEC: delete port (Te2/1/1) from agport (Po9)
*Nov 23 04:38:40.900: FEC: pagp_switch_delete_port_from_agport_list: afb->nports-- = 1 [Te2/1/1]
*Nov 23 04:38:40.900: FEC: lacp_switch_remove_port_from_associated_list_internal: Te2/1/1 deleted from the associated list for Po9
*Nov 23 04:38:40.900: FEC: lacp_switch_is_aggregator_valid: aggregator Po9 is still valid
*Nov 23 04:38:40.900: FEC: pagp_switch_reset_load_index: reading load-index for port Po9
*Nov 23 04:38:40.900: FEC: lacp_switch_is_aggregator_valid: aggregator Po9 is still valid
*Nov 23 04:38:40.900: FEC: lacp_switch_get_first_associated_port_from_agg_id: found port Te1/1/1 associated to Po9
*Nov 23 04:38:40.900: FEC: lacp_switch_is_port_in_associate_list: port Te1/1/1 is present in the associate list
*Nov 23 04:38:40.900: FEC: lacp_switch_get_next_associated_port_from_agg_id: no associated port next to Te1/1/1 in aggregator Po9
*Nov 23 11:38:41.894: %LINEPROTO-5-UPDOWN: Line protocol on Interface TenGigabitEthernet2/1/1, changed state to down
*Nov 23 04:38:42.902: FEC: lacp_switch_get_prot_enabled: returning [2] for Te2/1/1
*Nov 23 04:38:44.746: FEC: pagp_switch_port_up: Te2/1/1
*Nov 23 04:38:44.746: FEC: pagp_switch_invoke_port_up: Te2/1/1
*Nov 23 04:38:44.747: FEC: pagp_switch_agc_compatable: comparing GC values of Te2/1/1 Te1/1/1 flag = 1 1
*Nov 23 04:38:44.747: FEC: pagp_switch_port_attrib_diff: compare LACP modes for Te2/1/1
*Nov 23 04:38:44.747: FEC: pagp_switch_port_attrib_diff: Te2/1/1 Te1/1/1 same
*Nov 23 04:38:44.747: FEC: pagp_switch_agc_compatable: GC values are compatable
*Nov 23 04:38:44.747: FEC: lacp_switch_calculate_oper_key: oper_key for port Te2/1/1 is 0x9
*Nov 23 04:38:45.090: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po9 for admin_key [0x9] and oper_key [0x9]
*Nov 23 04:38:45.090: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po9 for admin_key [0x9] and oper_key [0x9]
*Nov 23 04:38:45.090: FEC: lacp_switch_is_aggregator_valid: aggregator Po9 is still valid
*Nov 23 04:38:45.090: FEC: lacp_switch_get_first_associated_port_from_agg_id: found port Te1/1/1 associated to Po9
*Nov 23 04:38:45.090: FEC: lacp_switch_is_aggregator_valid: aggregator Po9 is still valid
*Nov 23 04:38:45.091: FEC: lacp_switch_add_port_to_associated_list_internal: Te2/1/1 added to list for Po9
*Nov 23 04:38:45.091: FEC: lacp_switch_check_hw_sw_constraints_internal: port Te2/1/1 can be bundled in the aggregator Po9, new afb->nports [1]
*Nov 23 04:38:45.091: FEC: lacp_switch_agport_fast_switchover_enabled: Te2/1/1 lacp fast switchover disabled
*Nov 23 04:38:45.124: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po9 for admin_key [0x9] and oper_key [0x9]
*Nov 23 04:38:45.127: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po9 for admin_key [0x9] and oper_key [0x9]
*Nov 23 04:38:46.570: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po9 for admin_key [0x9] and oper_key [0x9]
*Nov 23 04:38:47.065: FEC: lacp_switch_is_aggregator_valid: aggregator Po9 is still valid
*Nov 23 04:38:47.065: FEC: lacp_switch_check_hw_sw_constraints_internal: port Te2/1/1 can be bundled in the aggregator Po9, new afb->nports [1]
*Nov 23 04:38:47.065: FEC: lacp_switch_is_aggregator_valid: aggregator Po9 is still valid
*Nov 23 04:38:47.065: FEC: add port (Te2/1/1) to agport (Po9)
*Nov 23 04:38:47.065: FEC: pagp_switch_add_port_to_agport_list: afb->nports++ = 2 [Te2/1/1]
*Nov 23 04:38:47.065: FEC: lacp_switch_add_port_to_agport_internal: Te2/1/1 added to aggregator Po9 list
*Nov 23 04:38:47.066: FEC: lacp_fec_bundle_internal: Determine if msg to PM to bundle port Te2/1/1 with Po9 is needed
*Nov 23 04:38:47.066: FEC: pagp_switch_want_to_bundle: Bndl msg to PM for port Te2/1/1 to Agport Po9
*Nov 23 04:38:47.068: FEC: pagp_switch_hotstandby: for agport Po9
*Nov 23 04:38:47.068: FEC: pagp_switch_hotstandby: PAgP not enabled on agport Po9
*Nov 23 04:38:47.069: FEC: lacp_switch_fast_swover_timer_is_running: Po9 lacp fast timer is not running
*Nov 23 04:38:47.069: FEC: lacp_switch_port_bndl_stayup_cleanup_needed: Po9 lacp fast timer is not running
*Nov 23 04:38:47.070: FEC: pagp_switch_ha_sync_complete: syncing bundled LACP data on Te2/1/1
*Nov 23 04:38:47.070: FEC: pagp_switch_send_lacp_ha_sync_data: pagp_status data on Te2/1/1 is 2
*Nov 23 04:38:47.070: FEC: pagp_switch_send_lacp_ha_sync_data: lacp sync data on Te2/1/1 flag: A00120 indx 0 gc 0
*Nov 23 04:38:47.071: FEC: pagp_switch_ha_sync_bundled: synced lacp data on Te2/1/1
*Nov 23 04:38:47.071: FEC: pagp_switch_reset_load_index: reading load-index for port Po9
*Nov 23 04:38:47.071: FEC: lacp_switch_is_aggregator_valid: aggregator Po9 is still valid
*Nov 23 04:38:47.071: FEC: lacp_switch_get_first_associated_port_from_agg_id: found port Te1/1/1 associated to Po9
*Nov 23 04:38:47.071: FEC: lacp_switch_is_port_in_associate_list: port Te1/1/1 is present in the associate list
*Nov 23 04:38:47.071: FEC: lacp_switch_get_next_associated_port_from_agg_id: found port Te2/1/1 next to Te1/1/1 and associated to Po9
*Nov 23 04:38:47.071: FEC: lacp_switch_is_port_in_associate_list: port Te2/1/1 is present in the associate list
*Nov 23 04:38:47.072: FEC: lacp_switch_get_next_associated_port_from_agg_id: no associated port next to Te2/1/1 in aggregator Po9
*Nov 23 04:38:47.072: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po9 for admin_key [0x9] and oper_key [0x9]
*Nov 23 04:38:47.094: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po9 for admin_key [0x9] and oper_key [0x9]
*Nov 23 04:38:47.097: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po9 for admin_key [0x9] and oper_key [0x9]
*Nov 23 04:38:47.099: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po9 for admin_key [0x9] and oper_key [0x9]
*Nov 23 04:38:47.936: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po9 for admin_key [0x9] and oper_key [0x9]
*Nov 23 11:38:48.069: %LINEPROTO-5-UPDOWN: Line protocol on Interface TenGigabitEthernet2/1/1, changed state to up
*Nov 23 04:38:57.347: FEC: pagp_switch_hotstandby: for agport Po9
*Nov 23 04:38:57.347: FEC: pagp_switch_hotstandby: PAgP not enabled on agport Po9
*Nov 23 04:38:57.351: FEC: pagp_switch_ha_sync_complete: syncing bundled LACP data on Te2/1/1
*Nov 23 04:38:57.351: FEC: pagp_switch_send_lacp_ha_sync_data: pagp_status data on Te2/1/1 is 5
*Nov 23 04:38:57.351: FEC: pagp_switch_send_lacp_ha_sync_data: lacp sync data on Te2/1/1 flag: A00120 indx 0 gc 0
*Nov 23 04:38:57.351: FEC: pagp_switch_ha_sync_bundled: synced lacp data on Te2/1/1
*Nov 23 04:38:57.351: FEC: pagp_switch_port_down: Te2/1/1 Inform yes
*Nov 23 04:38:57.352: FEC: pagp_switch_invoke_port_down: Te2/1/1
*Nov 23 04:38:57.352: FEC: lacp_fec_unbundle_internal: Te2/1/1
*Nov 23 04:38:57.352: FEC: Un-Bndl msg NOT send to PM for port Te2/1/1 from Po9
*Nov 23 04:38:57.352: FEC: pagp_switch_reset_load_index: reading load-index for port Po9
*Nov 23 04:38:57.352: FEC: lacp_switch_delete_port_from_agport_internal: removing Te2/1/1 from Po9
*Nov 23 04:38:57.352: FEC: delete port (Te2/1/1) from agport (Po9)
*Nov 23 04:38:57.352: FEC: pagp_switch_delete_port_from_agport_list: afb->nports-- = 1 [Te2/1/1]
*Nov 23 04:38:57.353: FEC: lacp_switch_remove_port_from_associated_list_internal: Te2/1/1 deleted from the associated list for Po9
*Nov 23 04:38:57.353: FEC: lacp_switch_is_aggregator_valid: aggregator Po9 is still valid
*Nov 23 04:38:57.353: FEC: pagp_switch_reset_load_index: reading load-index for port Po9
*Nov 23 04:38:57.353: FEC: lacp_switch_is_aggregator_valid: aggregator Po9 is still valid
*Nov 23 04:38:57.353: FEC: lacp_switch_get_first_associated_port_from_agg_id: found port Te1/1/1 associated to Po9
*Nov 23 04:38:57.353: FEC: lacp_switch_is_port_in_associate_list: port Te1/1/1 is present in the associate list
*Nov 23 04:38:57.353: FEC: lacp_switch_get_next_associated_port_from_agg_id: no associated port next to Te1/1/1 in aggregator Po9
*Nov 23 11:38:58.346: %LINEPROTO-5-UPDOWN: Line protocol on Interface TenGigabitEthernet2/1/1, changed state to down
*Nov 23 04:38:59.352: FEC: lacp_switch_get_prot_enabled: returning [2] for Te2/1/1
*Nov 23 04:39:01.919: FEC: pagp_switch_port_up: Te2/1/1
*Nov 23 04:39:01.919: FEC: pagp_switch_invoke_port_up: Te2/1/1
*Nov 23 04:39:01.919: FEC: pagp_switch_agc_compatable: comparing GC values of Te2/1/1 Te1/1/1 flag = 1 1
*Nov 23 04:39:01.919: FEC: pagp_switch_port_attrib_diff: compare LACP modes for Te2/1/1
*Nov 23 04:39:01.920: FEC: pagp_switch_port_attrib_diff: Te2/1/1 Te1/1/1 same
*Nov 23 04:39:01.920: FEC: pagp_switch_agc_compatable: GC values are compatable
*Nov 23 04:39:01.920: FEC: lacp_switch_calculate_oper_key: oper_key for port Te2/1/1 is 0x9
*Nov 23 04:39 

[jakkrit.m]

I did changed channel group 9 but link still up/down.

[marce1000]

    - Correction that should have been : Make sure that that  channel numbers are  the same ....

M.

[jakkrit.m]

Now the current alarm detect "lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po9 for admin_key [0x9] and oper_key [0x9]" and it up/down again.

interface Port-channel9
description T-LACP-VAS-STACK
switchport trunk allowed vlan 660-662
switchport mode trunk
!

!
interface TenGigabitEthernet1/1/1
description To-VAS-STACK Te1/0/39
switchport trunk allowed vlan 660-662
switchport mode trunk
channel-group 9 mode active
lacp port-priority 62535

!
interface TenGigabitEthernet2/1/1
description To-VAS-STACK Te0/0/39
switchport trunk allowed vlan 660-662
switchport mode trunk
channel-group 9 mode active
lacp port-priority 62535

*Nov 23 05:05:53.821: FEC: lacp_switch_get_first_agg_id_from_admin_oper_keys: found aggregator Po9 for admin_key [0x9] and oper_key [0x9]

[marce1000]

 - Is that the only log-entry  if not post the complete sequence, why are you using the lacp port-priority 62535 command, what is in the logs of the Huawei switch ? Also look at the software version of the 9200 , use the latest advisory release. Check if that can help ?

 M.

[jakkrit.m]

My software version is Version 17.03.04

SW-Cisco-9200L-Stack#show version
Cisco IOS XE Software, Version 17.03.04

For : lacp port-priority 62535

Because I need use LACP mode active/active

[marce1000]

          >My software version is Version 17.03.04

  Latest advisory release seems 17.0.04b, 

     >lacp port-priority 62535

 I don't think that relates to active/active mode , currently advising to remove that again

  These questions are  still pending : what is in the logs of the Huawei, was that last observed message in the logs of the Cisco the only line seen , or where there other messages too?

                   Last but not least have a look at this article :

 https://forum.huawei.com/enterprise/en/lacp-between-cisco-and-huawei/thread/394517-861

  Whilst the cisco side seems to fit your config , scrutinize the huwaei settings in the article , compare and set accordingly. Also I would advise, as in the article, to fall back again to the default channel port number being 1 (eliminate all things that can complicate)

 M.