0 packets input on C9500-48Y4C StackWise Virtual Switch

[fhk-cwempe]

I successfully stacked two C9500-48Y4C.

The Uplink (single 10/100/1000BaseTX SFP) works fine.

Then I tried to connect a C9200 with an LACP port-channel (Twe1/0/6 and Twe2/0/6).

But I only get:

%ETC-5-L3DONTBNDL2: Twe2/0/6 suspended: LACP currently not enabled on the remote port.

To troubleshoot I now wanted to use a single connection without port-channel between the stack and the C9200.

Stack:
interface TwentyFiveGigE2/0/6
 switchport trunk allowed vlan 1-1000
 switchport mode trunk

C9200:
interface TenGigabitEthernet1/1/4
 switchport trunk allowed vlan 1-1000
 switchport mode trunk

The C9200 does receive packets (like cdp and vtp) from the stack.

But there are not packets incoming on the stack.

TwentyFiveGigE2/0/6 is up, line protocol is up (connected)
  Hardware is Twenty Five Gigabit Ethernet, address is 3c8b.7f00.d386 (bia 3c8b.7f00.d386)
  MTU 1500 bytes, BW 10000000 Kbit/sec, DLY 10 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation ARPA, loopback not set
  Keepalive set (10 sec)
  Full-duplex, 10Gb/s, link type is auto, media type is SFP-10GBase-SR
  input flow-control is on, output flow-control is off
  ARP type: ARPA, ARP Timeout 04:00:00
  Last input never, output 00:00:00, output hang never
  Last clearing of "show interface" counters 00:21:46
  Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo
  Output queue: 0/40 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 9000 bits/sec, 13 packets/sec
     0 packets input, 0 bytes, 0 no buffer
     Received 0 broadcasts (0 multicasts)
     0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
     0 watchdog, 0 multicast, 0 pause input
     0 input packets with dribble condition detected
     14882 packets output, 1130522 bytes, 0 underruns
     Output 1300 broadcasts (0 multicasts)
     0 output errors, 0 collisions, 1 interface resets
     0 unknown protocol drops
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier, 0 pause output
     0 output buffer failures, 0 output buffers swapped out

I tried different SFP+-Modules and cables.

Any idea where the issue could be?

[balaji.bandi]

LACP port channel use channel-group mode active

stack - Cat 9500 SVL ?

[fhk-cwempe]

I know.

I used channel-group mode active to create the Port-Channel.

show etherchennel summary showes "LACP" as Protocol.

But like I wrote, the issue seems to be deeper, even without port-channel.

show stackwise

Stackwise Virtual Configuration:
--------------------------------
Stackwise Virtual : Enabled
Domain Number : 1

Switch  Stackwise Virtual Link  Ports
------  ----------------------  ------
1       1                       HundredGigE1/0/51
                                HundredGigE1/0/52
2       1                       HundredGigE2/0/51
                                HundredGigE2/0/52

Chassis Type: C9500-48Y4C

Switch Number 1

Mod Ports Card Type                                   Model          Serial No.
---+-----+--------------------------------------+--------------+--------------
1   52   Cisco Catalyst 9500 Series Router           C9500-48Y4C      FDO26XXXXXX

Mod MAC addresses                    Hw   Fw           Sw                 Status
---+--------------------------------+----+------------+------------------+--------
1   xxxx.yyyy.D4C0 to xxxx.yyyy.D4F3 2.0  17.3.1r[FC2]  17.05.01           ok

Mod Redundancy Role     Operating Redundancy Mode Configured Redundancy Mode
---+-------------------+-------------------------+---------------------------
1   Active              sso                       sso

Switch Number 2

Mod Ports Card Type                                   Model          Serial No.
---+-----+--------------------------------------+--------------+--------------
1   52   Cisco Catalyst 9500 Series Router           C9500-48Y4C      FDO26XXXXXY

Mod MAC addresses                    Hw   Fw           Sw                 Status
---+--------------------------------+----+------------+------------------+--------
1   xxxx.yyyy.D380 to xxxx.yyyy.D3B3 2.0  17.3.1r[FC2]  17.05.01           ok

Mod Redundancy Role     Operating Redundancy Mode Configured Redundancy Mode
---+-------------------+-------------------------+---------------------------
1   Standby             sso                       sso

Chassis 1 MAC address range: 160 addresses from xxxx.yyyy.d4c0 to xxxx.yyyy.d55f

Chassis 2 MAC address range: 160 addresses from xxxx.yyyy.d380 to xxxx.yyyy.d41f

[balaji.bandi]

this is more of SVL config, can you post

both the side :

show run interface port-channel  X ( x is the value using ?)

show interface x/x

show etherchannel X summary

show interface port-channel x switchport

show version

[Reza Sharifi]

interface TwentyFiveGigE2/0/6
 switchport trunk allowed vlan 1-1000
 switchport mode trunk

C9200:
interface TenGigabitEthernet1/1/4
 switchport trunk allowed vlan 1-1000
 switchport mode trunk

 Can you make sure the 2/0/6 is operating as 10Gig and not 25?

HTH

[fhk-cwempe]

@balaji.bandi 

Like I said. I try to simplify the scenario and have not configured the port-channel anymore.

@Reza Sharifi 

The Ports operate at 10G.

C9500 Stack

(I changed the port and hardware chassis in case 2/0/6 was defect)

Port         Name               Status       Vlan       Duplex  Speed Type
Twe1/0/21                       connected    trunk        full    10G SFP-10GBase-SR

C9200

Port         Name               Status       Vlan       Duplex  Speed Type
Te1/1/4                         connected    trunk        full    10G SFP-10GBase-SR

It kinda works now!

I found some threads (3 years old) about compatibility issues with third-party modules

But they should be fixed with newer IOS versions.

I just tried two original Cisco 1G modules and it works.

I already configured

service unsupported-transceiver
no errdisable detect cause gbic-invalid

Maybe an upgrade to 17.6.3 helps...

[Reza Sharifi]

Yeah, Cisco devices don't always work with 3rd party vendor optics. I use one 3rd part vendor's optics that works pretty much with all Cisco devices. So, it's a kind of trial and error process.

HTH

[fhk-cwempe]

But they should be compatible according to this:

https://www.reddit.com/r/networking/comments/c8op1n/3rd_party_optics_cat_9500_highperformance/exvi2ik/?utm_source=reddit&utm_medium=web2x&context=3

(search for "11555/SFP-10GLR-31")

And the sales person asked me about my devices to verify they were compatible.

Maybe I have more luck tomorrow.

[MHM Cisco World]

@Reza Sharifi  mention that not all SFP compatible and even worse cisco not support TAC for 3-rd party SFP. 
https://www.fiberlandtec.com/how-to-check-sfpmodule-optical-signal-strength.html

check this link see if the optical signal is strength is OK (this only one step to check SFP).

[balaji.bandi]

I understand, that is the reason i requeted interface output to see if the interface gone in error disable mode.

Thank you for the clarification.

[Leo Laohoo]

---

@fhk-cwempe wrote:

Maybe an upgrade to 17.6.3 helps...

---

Use 17.3.5 instead. 

NOTE:  Currently suspended testing 17.6.3 because we have already found "0-config" bugs in two test switches.  

[fhk-cwempe · Accepted solution]

After some troubleshooting tipps ("self loop test") from the sales person, I found out the issue was not between sfp module and C9500, but C9200.

It was this bug.

https://bst.cloudapps.cisco.com/bugsearch/bug/CSCwa11962

Update C9200 from 17.03.04b to 17.3.5 solved the issue!

[MHM Cisco World]

Thanks alot friend for sharing solution.