Etherchannel suspended between Catalyst 4948 and VSS 6506E

Sindibade 78 · ‎12-24-2012

Hello,

I describe an issue when i need to performe an L2 or L3 Etherchannel from a Catalyst 4948 IOS Enterprise and 2 xCatalyst 6506E bandled with VSS.

From the VSS Side when i plug cables i see on the physicals and Etherchannel that Physical and protocole layer are up. On the 4948 side,

I see that physical layer is up and protocol and Etherchannel interfaces are down.

On the Etherchannel port summary i see that the port state is supended.

On the first attempt, i have test with a L3 etherchannel on both side using no switchport with two IP addresses one at each side on etherchannel interfaces.

The etherchannel are bundled with LACP mode active and on the second attempt with PAGP mode ON.

The same configured on VSS 6506E work fine with Catalyst 3560E.

Please do you have any idea?

glen.grant · ‎12-24-2012

Check in your logs it will sometime tell why it is not bundling the two together. Each side config should match exactly for any negotiated (pagp or lacp ) etherchannels. A 4948 should not be any different than a 3560 as far the way it is setup.

NUMAN FARUK KARAKAS · ‎02-26-2015

Hi,

I have this problem to in VSS (two 6509).

my etherchannel config and log outputs are as follows:

interface GigabitEthernet2/2/44
description WLC-2504_2
switchport
switchport trunk encapsulation dot1q
switchport mode trunk
channel-group 38 mode on

interface GigabitEthernet1/1/44
description WLC_2504
switchport
switchport trunk encapsulation dot1q
switchport mode trunk
channel-group 38 mode on

interface Port-channel38
description WLC_2504_AGGREGATION
switchport
switchport trunk encapsulation dot1q
switchport mode trunk
end

Feb 26 07:40:56.862: %EC-SW2_SP-5-CANNOT_BUNDLE2: Gi1/1/44
is not compatible with Gi2/2/44 and will
be suspended (qos-card types of Gi1/1/44 do not match Gi2/2/44)

What reason may cause this ? Please help :)

David Kosich · ‎02-26-2015

You can not bundle ports in a port-channel that have different QoS queuing structures, which is what the log message is telling you. Depending on the linecard, there are a designated # of hardware queues

So for instance, the 6800 10 port card has the following --

- Receive: 1p7q2t per port
- Transmit: 1p7q4t per port group

If you bundle a port from a different module, the above structure would need to match.

If you bundle ports together on the same type/model lineard, you will not see this problem.

NUMAN FARUK KARAKAS · ‎02-26-2015

Thanks for interesting David.

So ı need to buy new module in this case, am ı right ?

David Kosich · ‎02-26-2015

What are the two modules you are trying to bundle together? Can you post a 'show module switch all' output?

NUMAN FARUK KARAKAS · ‎02-26-2015

Hi David, when ı type "no mls qos channel-consistency" under port-channel

the issue was solved. But ı am not comfortable with that, Because ı want to use Qos feature

here the "show module all"

GedizCore#show module switch all
Switch Number: 1 Role: Virtual Switch Standby
---------------------- -----------------------------
Mod Ports Card Type Model Serial No.
--- ----- -------------------------------------- ------------------ -----------
1 48 CEF720 48 port 10/100/1000mb Ethernet WS-X6748-GE-TX SAL10478XGB
4 16 CEF720 16 port 10GE WS-X6716-10GE SAL17204RU1
5 5 Supervisor Engine 720 10GE (Hot) VS-S720-10G SAL1833YQER
8 16 CEF720 16 port 10GE WS-X6716-10GE SAL16010BSU

Mod MAC addresses Hw Fw Sw Status
--- ---------------------------------- ------ ------------ ------------ -------
1 001a.2f08.6930 to 001a.2f08.695f 2.11 12.2(18r)S1 15.1(1)SY1 Ok
4 4c4e.3591.2378 to 4c4e.3591.2387 2.0 12.2(18r)S1 15.1(1)SY1 Ok
5 bc16.655b.a27c to bc16.655b.a283 4.3 8.5(4) 15.1(1)SY1 Ok
8 7081.055f.91c0 to 7081.055f.91cf 1.2 12.2(18r)S1 15.1(1)SY1 Ok

Mod Sub-Module Model Serial Hw Status
---- --------------------------- ------------------ ----------- ------- -------
1 Centralized Forwarding Card WS-F6700-CFC SAL10478RZ7 2.1 Ok
4 Distributed Forwarding Card WS-F6700-DFC3C SAL172052B2 1.6 Ok
5 Policy Feature Card 3 VS-F6K-PFC3C SAL1834Z3M7 1.3 Ok
5 MSFC3 Daughterboard VS-F6K-MSFC3 SAL1827VVKQ 5.2 Ok
8 Distributed Forwarding Card WS-F6700-DFC3C SAL160315JW 1.6 Ok

Mod Online Diag Status
---- -------------------
1 Pass
4 Pass
5 Pass
8 Pass

Switch Number: 2 Role: Virtual Switch Active
---------------------- -----------------------------
Mod Ports Card Type Model Serial No.
--- ----- -------------------------------------- ------------------ -----------
2 48 CEF720 48 port 10/100/1000mb Ethernet WS-X6748-GE-TX SAL1442WG3X
3 16 CEF720 16 port 10GE WS-X6716-10GE SAL1441WAPL
5 5 Supervisor Engine 720 10GE (Active) VS-S720-10G SAL1441VWRG

Mod MAC addresses Hw Fw Sw Status
--- ---------------------------------- ------ ------------ ------------ -------
2 1cdf.0f90.89e8 to 1cdf.0f90.8a17 3.4 12.2(18r)S1 15.1(1)SY1 Ok
3 f866.f220.3258 to f866.f220.3267 1.0 12.2(18r)S1 15.1(1)SY1 Ok
5 c47d.4ffe.40b0 to c47d.4ffe.40b7 3.2 8.5(4) 15.1(1)SY1 Ok

Mod Sub-Module Model Serial Hw Status
---- --------------------------- ------------------ ----------- ------- -------
2 Distributed Forwarding Card WS-F6700-DFC3C SAL1442WFR0 1.4 Ok
3 Distributed Forwarding Card WS-F6700-DFC3C SAL1441W1B8 1.4 Ok
5 Policy Feature Card 3 VS-F6K-PFC3C SAL1440VPD4 1.1 Ok
5 MSFC3 Daughterboard VS-F6K-MSFC3 SAL1441VWZG 5.1 Ok

Mod Online Diag Status
---- -------------------
2 Pass
3 Pass
5 Pass

David Kosich · ‎02-26-2015

Numan Faruk -- Yes, that command disables the check.

So it looks like you are trying to bundle a port from WS-X6716-10GE (switch 2, module 2) & WS-X6748-GE-TX (switch 1, module 1). That won't work unless you disable the QoS check as you saw.

Can you bundle ports from the same type of linecard? That is the better approach here.

So bundle ports from 6716 with ports from the other switch's 6716. Or ports from 6748 with ports on the other switches' 6748.

For example, 1/1/1 & 2/1/1 bundled together

And ports from switch 1, module 8 or Switch 1 module 4, bundled with ports from Switch 2, module 3

Surat Teknoloji · ‎03-12-2015

a

NUMAN FARUK KARAKAS · ‎03-12-2015

Dear David, Sorry for late respond,

The Issue is solved.

I was triying to build port-channel on cards WS-X6748-GE-TX with Sub-Module WS-F6700-CFC and WS-X6748-GE-TX with sup module WS-F6700-DFC3C . These two sup modules have different qos capabilities and this causes the problem in configuration of the etherchannel ..

We could see the following log generated:

2 13:17:21.590: %EC-SW2_SP-5-CANNOT_BUNDLE2: Gi2/2/44 is not compatible with Gi1/2/44 and will be suspended (qos-card types of Gi2/2/44 do not match Gi1/2/44)

The 6748 in switch 2 has a receive queue of type 1q8t (with CFC) while switch 1 has a receive queue of 2q8t (with DFC3) .to confirm this issue the following commands

on the switch and you find the same result :

show int g1/2/44 cap | i QOS

show int g2/2/44 cap | i QOS

This explains the inconsistency and is due to the fact that one module has a CFC while the other has a DFC :

http://www.cisco.com/en/US/prod/collateral/switches/ps5718/ps708/prod_white_paper09186a0080131086.html

There are two workarounds:

1) Ensure the line cards have matching daughter cards (both CFC or DFC)

- if you change the daughter card on the linecard, you may lose the configurations for the corresponding interfaces due to a mismatch incard type. Ensure that you back up the configurations for the module.

2) You can disable the qos consistency check on a per-port-channel

basis:

VSS(config)# interface port-channel 400

VSS(config-if)# no mls qos channel-consistency

I changed Centralized Forwarding Card(WS-F6700-CFC) with Distributed Forwarding Card( WS-F6700-DFC3C)

Thank you for your help .

David Kosich · ‎12-24-2012

I agree with Glen, checking the logs should be your first step. It's likely a misconfig. If you are using LACP, you can use active on one side and active on the other, OR, active on one side, and passive on the other.

Also, check your cabling/check CDP. If it's going suspended, it maybe because you are configuring the wrong port (and the port that is the actually connected on the remote side isn't configured for an etherchannel.)

If you are still having trouble, paste your configs and logs, we should be able to take a quick look and tell you what's wrong.

Dave Kosich

Cisco TAC

dlatorre · ‎12-24-2012

Post the show etherchannel summary and sh int (interface) switchport output. Most of the time you can delete all of the configuration of the etherchannel reanable it with on again it will work.