port-channel, sfp issue?

[Jeremy Patrick]

Hello,

Wanting to ask the great wisdom of this group regarding an port-channel question.

Have 2 3750x switches I'm trying to create a port channel between.  

interface GigabitEthernet1/1/1
 switchport trunk encapsulation dot1q
 switchport mode trunk
 switchport nonegotiate
 channel-protocol lacp
 channel-group 1 mode active

interface Port-channel1
 switchport trunk encapsulation dot1q
 switchport mode trunk
 switchport nonegotiate

I've tried using GLC-T copper SFPs on a 10G expansion module (both switches have a module).  first with just the 1 and 3 gig ports then with all.  Every try, whether it's with just the 1 and 3 ports, all 4, doesn't seem to matter.  I can the error Gi1/x/x suspended: LACP currently not enabled on the remote port.

Pretty obvious it's enabled.  have defaulted and re-configured the ports and the port channel multiple times.  

Last try was to move one end of the connections to non sfp ports, so in this case gig1/0/1-4.  

I finally got 1 port to come up in the channel

1      Po1(SU)         LACP      Gi1/1/1(P)  Gi1/1/2(s)  Gi1/1/3(s)  Gi1/1/4(D) 

but I still get the LACP errors in the log.

The end goal is to have this with a dual fiber link but it's really making me wonder what its going on if when I get the fiber sfps and cable if I'll run into the same issue. copper sfps are causing the issue?

Kinda of future fact searching for the moment, but if anyone could share some insight.

----

forgot to mention, I haven't migrated the 4 connections to regular gig ports on the other switch.  will try and get that this evening. 

[MHM Cisco World]

please share the below
show lacp counter 
show lacp internal 
show lacp neighbor detail 

[Jeremy Patrick]

I ran the commands you listed on both switches.  uploaded the results as text files so I'm not creating a 10 page reply.

Also, in comparison to what Reza asked in just doing a 1/0/x connection and not messing with the sfp modules, that was slick as it should be. Any ideas come to mind on why a SFP-GE-T (all modules are listed as that when doing sh inv) would give this kind of result/problem?

with the sfp modules, and only dropping the last 1/1/4 on both sides, I'm still seeing this:

SW1 - 1 Po1(SU) LACP Gi1/1/1(P) Gi1/1/2(D) Gi1/1/3(w)

SW2 - 1 Po1(SU) LACP Gi1/1/1(D) Gi1/1/2(P) Gi1/1/3(D)

log doesn't show any errors about LACP this time, but it also doesn't want to play with the other two connections (brand new patch cables too)

I know fiber is a whole different beast but unless this is just something isolated to a 1GB copper connection, it's making me nervous the move to the fiber modules may be met with the same issues...

[MHM Cisco World]

Gi1/1/4 <<- is in SW1 PO and I think it connect to SW port (no PO)
so this can form STP loop
please remove the Gi1/1/4 
the issue I think is mess in cable I think

[Jeremy Patrick]

posted late last night so I might have forgot that.  I removed the actual SFP from 1/1/4 on both switches so there is nothing even inserted or plugged in to that port.

[Reza Sharifi]

Hi,

If the switches are less then 100 meters apart, for testing, try using a couple of copper ports e.g., 1/0/1 and 1/0/2 and see if the Portchannel comes up.

HTH

[Jeremy Patrick]

the switch is sitting right next to the 3750x stack it is destined to connect to, so I have 7' patches running to only copper 1/0 ports now.  created another port-channel.  thinking the 4th patch is bad since it appears to be up and running fine now with the other 3 ports. same config as what I posted initially except on Po2.

the distance away is only going to be 30m, so fairly short distance overall assuming I don't run into these shenanigans with the fiber modules.

SW1 - 2 Po2(SU) LACP Gi1/0/39(P) Gi1/0/40(P) Gi1/0/41(P) Gi1/0/42(D)

SW2 - 2 Po2(SU) LACP Gi1/0/1(P) Gi1/0/2(P) Gi1/0/3(P) Gi1/0/4(s) 

[MHM Cisco World]

can you share same output after you add the PO2.
first one make me more confuse 

[Jeremy Patrick]

Are you referring to the lacp info you were asking about, but focused on the Po2?

attached are the same lacp outputs for Po2.

[MHM Cisco World]

I think you attach output for same SW

[Jeremy Patrick]

yeah I can see that now.  other file must have overwritten.

uploaded just the SW1 file for this now.

[MHM Cisco World]

please use any odd port number dont use even number, I want to check if you hit specific bug or not.

[Jeremy Patrick]

Will do. 
Pretty sure when I first tried setting this up I used 1/1 and 1/3 since those were the non 10gig ports. But ran into the same exact scenario so then I extended it to all 4 sfp slots to widen the test base. 

i just got in the 10gig fiber sfp modules, waiting on the fiber cable. But I can pop the copper sfps back in to 1/1 and 1/3 and give it a try. 

[Jeremy Patrick]

Think I've narrowed this down significantly.

I have 4 SFP-GE-T-E copper SFPs (no clue on brand, not obvious), and 4 LongLine GLC-T-LL copper SFPs

First I discovered that if the fiber 10gig sfps are in, the switch won't even recognize the copper sfp links.  had to pop out the fiber models first.  after popping those out, I saw the blinking amber light on the copper sfp slot.  made me wonder which copper sfp brand was in what slot, so I popped the LL module out and put in the GLC-GE one on both ports 1/1/3 of the switches.  bingo, link came up.  Tried the 1/1/1 slot and replaced it with the GLC-GE module and bingo, that came up too.  

So now with just the GLC-GE modules the port-channel is up and running fine, just like when I created the Po2 with 1/0/1-4 ints.

Makes a bit more sense now looking back though.  I had tried to make sure the GLC-GE modules were matching 1:1 on either side of the patch cable location, so when I saw the etherchannel sum and only one link was up with the others either suspended or down, it was probably because that working port/patch was using the GLC-GE module.

Might have reached this same conclusion myself after a while, but thanks MHM for nudging me to check things like you did.  

Now I just hope the 10gig modules don't give the same issues.

Question on that though, with the current Po1 config as it has been listed, and two 10gig modules in slots 1/1/2 and 1/1/4 with nothing in 1/1/1 and 1/1/3, the link should come up just as fast and easy as I just discovered?  no other config needed for the fiber side vs copper?

[paul driver]

Hello
Try a static PC first and see if that works also to create a L2 PC perform the below steps:

1) default physical interfaces (if possible)
2) configure port-channel in physical interfaces

-- port-channel will be created automatically

3) create trunking encapsulation or access port mode directly in port-channel interface NOT the physical interfaces
4) enable physical interfaces "no shut"

conf t
default int ran gig1/1/1 -2 ( if applicable)

int ran gig1/1/1 -2
shut ( if applicable)
channel-group 1 mode on (static)
or 
channel-group 1 mode active (lacp)

int port-channel 1
switchport trunk encap dot1q
switchport- mode trunk