Etherchannel suspended between Catalyst 4948 and VSS 6506E

[Sindibade 78]

Hello,

I describe an issue when i need to performe an L2 or L3 Etherchannel from a Catalyst 4948 IOS Enterprise and 2 xCatalyst 6506E bandled with VSS.

From the VSS Side when i plug cables i see on the physicals and Etherchannel that Physical and protocole layer are up. On the 4948 side,

I see that physical layer is up and protocol and Etherchannel interfaces are down.

On the Etherchannel port summary i see that the port state is supended.

On the first attempt, i have test with a L3 etherchannel on both side using no switchport with two IP addresses one at each side on etherchannel interfaces.

The etherchannel are bundled with LACP mode active and on the second attempt with PAGP mode ON.

The same configured on VSS 6506E work fine with Catalyst 3560E.

Please do you have any idea?

[glen.grant]

   Check in your logs it will sometime tell why it is not bundling the two together.  Each side config should match exactly for any negotiated (pagp or lacp ) etherchannels.   A 4948 should not be any different than a 3560 as far the way it is setup.

[NUMAN FARUK KARAKAS]

Hi, 

I have this problem to in VSS (two 6509).

my etherchannel config and log outputs are as follows:

interface GigabitEthernet2/2/44
 description WLC-2504_2
 switchport
 switchport trunk encapsulation dot1q
 switchport mode trunk
 channel-group 38 mode on

interface GigabitEthernet1/1/44
 description WLC_2504
 switchport
 switchport trunk encapsulation dot1q
 switchport mode trunk
 channel-group 38 mode on

interface Port-channel38
 description WLC_2504_AGGREGATION
 switchport
 switchport trunk encapsulation dot1q
 switchport mode trunk
end

Feb 26 07:40:56.862: %EC-SW2_SP-5-CANNOT_BUNDLE2: Gi1/1/44
 is not compatible with Gi2/2/44 and will
 be suspended (qos-card types of Gi1/1/44 do not match Gi2/2/44)

What reason may cause this ? Please help :)

[David Kosich]

You can not bundle ports in a port-channel that have different QoS queuing structures, which is what the log message is telling you. Depending on the linecard, there are a designated # of hardware queues

So for instance, the 6800 10 port card has the following -- 

- Receive: 1p7q2t per port
- Transmit: 1p7q4t per port group

If you bundle a port from a different module, the above structure would need to match.

 If you bundle ports together on the same type/model lineard, you will not see this problem.

[NUMAN FARUK KARAKAS]

Thanks for interesting David.

So ı need to buy new module in this case, am ı right ? 

[David Kosich]

What are the two modules you are trying to bundle together? Can you post a 'show module switch all' output?

[NUMAN FARUK KARAKAS]

Hi David, when ı type "no mls qos channel-consistency" under port-channel

the issue was solved. But ı am not comfortable with that, Because ı want to use Qos feature

here the "show module all"

GedizCore#show module switch all 
 Switch Number:     1   Role:  Virtual Switch Standby
----------------------  -----------------------------
Mod Ports Card Type                              Model              Serial No.
--- ----- -------------------------------------- ------------------ -----------
  1   48  CEF720 48 port 10/100/1000mb Ethernet  WS-X6748-GE-TX     SAL10478XGB
  4   16  CEF720 16 port 10GE                    WS-X6716-10GE      SAL17204RU1
  5    5  Supervisor Engine 720 10GE (Hot)       VS-S720-10G        SAL1833YQER
  8   16  CEF720 16 port 10GE                    WS-X6716-10GE      SAL16010BSU

Mod MAC addresses                       Hw    Fw           Sw           Status
--- ---------------------------------- ------ ------------ ------------ -------
  1  001a.2f08.6930 to 001a.2f08.695f   2.11  12.2(18r)S1  15.1(1)SY1   Ok
  4  4c4e.3591.2378 to 4c4e.3591.2387   2.0   12.2(18r)S1  15.1(1)SY1   Ok
  5  bc16.655b.a27c to bc16.655b.a283   4.3   8.5(4)       15.1(1)SY1   Ok
  8  7081.055f.91c0 to 7081.055f.91cf   1.2   12.2(18r)S1  15.1(1)SY1   Ok

Mod  Sub-Module                  Model              Serial       Hw     Status 
---- --------------------------- ------------------ ----------- ------- -------
  1  Centralized Forwarding Card WS-F6700-CFC       SAL10478RZ7  2.1    Ok
  4  Distributed Forwarding Card WS-F6700-DFC3C     SAL172052B2  1.6    Ok
  5  Policy Feature Card 3       VS-F6K-PFC3C       SAL1834Z3M7  1.3    Ok
  5  MSFC3 Daughterboard         VS-F6K-MSFC3       SAL1827VVKQ  5.2    Ok
  8  Distributed Forwarding Card WS-F6700-DFC3C     SAL160315JW  1.6    Ok

Mod  Online Diag Status 
---- -------------------
  1  Pass
  4  Pass
  5  Pass
  8  Pass

 Switch Number:     2   Role:   Virtual Switch Active
----------------------  -----------------------------
Mod Ports Card Type                              Model              Serial No.
--- ----- -------------------------------------- ------------------ -----------
  2   48  CEF720 48 port 10/100/1000mb Ethernet  WS-X6748-GE-TX     SAL1442WG3X
  3   16  CEF720 16 port 10GE                    WS-X6716-10GE      SAL1441WAPL
  5    5  Supervisor Engine 720 10GE (Active)    VS-S720-10G        SAL1441VWRG

Mod MAC addresses                       Hw    Fw           Sw           Status
--- ---------------------------------- ------ ------------ ------------ -------
  2  1cdf.0f90.89e8 to 1cdf.0f90.8a17   3.4   12.2(18r)S1  15.1(1)SY1   Ok
  3  f866.f220.3258 to f866.f220.3267   1.0   12.2(18r)S1  15.1(1)SY1   Ok
  5  c47d.4ffe.40b0 to c47d.4ffe.40b7   3.2   8.5(4)       15.1(1)SY1   Ok

Mod  Sub-Module                  Model              Serial       Hw     Status 
---- --------------------------- ------------------ ----------- ------- -------
  2  Distributed Forwarding Card WS-F6700-DFC3C     SAL1442WFR0  1.4    Ok
  3  Distributed Forwarding Card WS-F6700-DFC3C     SAL1441W1B8  1.4    Ok
  5  Policy Feature Card 3       VS-F6K-PFC3C       SAL1440VPD4  1.1    Ok
  5  MSFC3 Daughterboard         VS-F6K-MSFC3       SAL1441VWZG  5.1    Ok

Mod  Online Diag Status 
---- -------------------
  2  Pass
  3  Pass
  5  Pass

[David Kosich]

Numan Faruk -- Yes, that command disables the check.

So it looks like you are trying to bundle a port from WS-X6716-10GE (switch 2, module 2) &  WS-X6748-GE-TX  (switch 1, module 1). That won't work unless you disable the QoS check as you saw.

Can you bundle ports from the same type of linecard? That is the better approach here.

So bundle ports from 6716 with ports from the other switch's  6716. Or ports from 6748 with ports on the other switches' 6748.

For example, 1/1/1 & 2/1/1 bundled together

And ports from switch 1, module 8 or Switch 1 module 4, bundled with ports from Switch 2, module 3

[Surat Teknoloji]

a

[NUMAN FARUK KARAKAS]

Dear David, Sorry for late respond,

The Issue is solved. 

I was triying  to build port-channel on cards WS-X6748-GE-TX with Sub-Module WS-F6700-CFC  and WS-X6748-GE-TX with sup module WS-F6700-DFC3C . These two sup modules have different qos capabilities and this causes the  problem in configuration of the  etherchannel ..

We could see the following log generated:

2 13:17:21.590: %EC-SW2_SP-5-CANNOT_BUNDLE2: Gi2/2/44 is not compatible with Gi1/2/44 and will be suspended (qos-card types of Gi2/2/44 do not match Gi1/2/44)

The 6748 in switch 2 has a receive queue of type 1q8t (with CFC)  while switch 1 has a receive queue of 2q8t (with DFC3) .to confirm this issue the following commands

on the switch and you find the same result :

show int g1/2/44 cap | i QOS

show int g2/2/44 cap | i QOS

This explains the inconsistency and is due to the fact that one module has a CFC while the other has a DFC  :

http://www.cisco.com/en/US/prod/collateral/switches/ps5718/ps708/prod_white_paper09186a0080131086.html

There are two workarounds:

1) Ensure the line cards have matching daughter cards (both CFC or DFC)

- if you change the daughter card on the linecard, you may lose the configurations for the corresponding interfaces due to a mismatch incard type.  Ensure that you back up the configurations for the module.

2) You can disable the qos consistency check on a per-port-channel

basis:

            VSS(config)# interface port-channel 400

            VSS(config-if)# no mls qos channel-consistency

I changed Centralized Forwarding Card(WS-F6700-CFC) with Distributed Forwarding Card( WS-F6700-DFC3C)

Thank you for your help .

[David Kosich]

I agree with Glen, checking the logs should be your first step. It's likely a misconfig. If you are using LACP, you can use active on one side and active on the other, OR, active on one side, and passive on the other.

Also, check your cabling/check CDP. If it's going suspended, it maybe because you are configuring the wrong port (and the port that is the actually connected on the remote side isn't configured for an etherchannel.)

If you are still  having trouble, paste your configs and logs, we should be able to take a quick look and tell you what's wrong.

Dave Kosich

Cisco TAC

[dlatorre]

Post the show etherchannel summary  and sh int (interface) switchport output. Most of the time you can delete all of the configuration of the etherchannel reanable it with on again it will work.