Matrix vervified transceivers not compatible with Cisco line cards

[lcaruso]

Hi,

We have 9606R switches with C9600-LC-24C line cards running 17.09.04a using QSFP-100G-FR-S transceivers connected to the 100G ports and they are giving us these errors and not reporting correctly as the 40G ports:

*Dec 11 22:03:39.474: %TRANSCEIVER-3-NOT_COMPATIBLE: C1/0: iomd: Detected for transceiver module in FortyGigabitEthernet1/0/10, module disabled *Dec 11 22:03:39.474: %IOMD_ETHER_GEIM-4-REMOVE_XCVR: C1/0: iomd: Unplug the transceiver in interface FortyGigabitEthernet1/0/10, keeping transceiver can have impact on other transceiver in the same port-group *Dec 11 22:03:39.474: %TRANSCEIVER-3-NOT_COMPATIBLE: C1/0: iomd: Detected for transceiver module in FortyGigabitEthernet1/0/18, module disabled *Dec 11 22:03:39.474: %IOMD_ETHER_GEIM-4-REMOVE_XCVR: C1/0: iomd: Unplug the transceiver in interface FortyGigabitEthernet1/0/18, keeping transceiver can have impact on other transceiver in the same Technology Package License Information:

I have a TAC case open on this for two days without a word as to the resolution.

Does anybody know the solution? Thanks.

[pieterh · Accepted solution]

I'm not sure if I understand your problem correclty
Interface and Hardware Components Configuration Guide, Cisco IOS XE Amsterdam 17.2.x (Catalyst 9600 Switches) - Configuring Interface Characteristics [Support] - Cisco
By default, all the interfaces on a C9600-LC-24C line card are 40 G or 1 G enabled. You can configure the odd-numbered 40 G or 1 G interface to function as 100 G port using the enable command on the interface. In such a case, the corresponding even-numbered port in the port group is disabled. (A port group constitutes the top and bottom consecutive ports.)

as the port is still reported as FortyGigabitEthernet1/0/10 , did you enable the port as 100G ?

[lcaruso]

Hi pieterh,

Thanks for your reply and information. I have read the manuals before seeking assistance, and I wish this problem was simple as not RTM because this holding up our deployment. The problems are twofold:


1. error messages which state the transceivers are incompatible and imply this could affect operations
2. transceivers reporting on 40g ports when in fact they are 100G transceivers plugged into enabled 100G ports.

A TAC engineer (not on this case) commented:
official SFPs can get their IDPROM corrupted after suffering power outages or software upgrades

Other than that, the only thing I can think of is these Cisco Partner provided SFPs are counterfeit.

Thanks.

[lcaruso]

n another interesting twist, RTM does not match up with hardware as shipped:

manual:
100G ports on 9600-LC-24C, figure 5:
odd numbered ports are 100G enabled
even numbered ports are skipped

Hardware as shipped:
100G ports on 9600-LC-24C
even numbered ports are 100G enabled
even numbered ports cannot be disabled
odd numbered ports are skipped

interface FortyGigabitEthernet1/0/1
 shutdown
!
interface FortyGigabitEthernet1/0/2
 shutdown
!
interface FortyGigabitEthernet1/0/3
 shutdown
!        
interface FortyGigabitEthernet1/0/4
 shutdown
!
interface FortyGigabitEthernet1/0/5
 shutdown
!
interface FortyGigabitEthernet1/0/6
 shutdown
!
interface FortyGigabitEthernet1/0/7
 shutdown
!
interface FortyGigabitEthernet1/0/8
 shutdown
!
interface FortyGigabitEthernet1/0/9
 shutdown
!
interface FortyGigabitEthernet1/0/10
 shutdown
!
interface FortyGigabitEthernet1/0/11
 shutdown
!
interface FortyGigabitEthernet1/0/12
 shutdown
!
interface FortyGigabitEthernet1/0/13
 shutdown
!
interface FortyGigabitEthernet1/0/14
 shutdown
!
interface FortyGigabitEthernet1/0/15
 shutdown
!
interface FortyGigabitEthernet1/0/16
 shutdown
!
interface FortyGigabitEthernet1/0/17
 shutdown
!
interface FortyGigabitEthernet1/0/18
 shutdown
!
interface FortyGigabitEthernet1/0/19
 shutdown
!
interface FortyGigabitEthernet1/0/20
 shutdown
!
interface FortyGigabitEthernet1/0/21
 shutdown
!
interface FortyGigabitEthernet1/0/22
 shutdown
!
interface FortyGigabitEthernet1/0/23
 shutdown
!
interface FortyGigabitEthernet1/0/24
 shutdown
!
interface HundredGigE1/0/25
 shutdown
 no enable
!
interface HundredGigE1/0/26
 shutdown
!
interface HundredGigE1/0/27
 shutdown
 no enable
!
interface HundredGigE1/0/28
 shutdown
!
interface HundredGigE1/0/29
 shutdown
 no enable
!
interface HundredGigE1/0/30
 shutdown
!
interface HundredGigE1/0/31
 shutdown
 no enable
!
interface HundredGigE1/0/32
 shutdown
!
interface HundredGigE1/0/33
 shutdown
 no enable
!
interface HundredGigE1/0/34
 shutdown
!
interface HundredGigE1/0/35
 shutdown
 no enable
!
interface HundredGigE1/0/36
 shutdown
!
interface HundredGigE1/0/37
 shutdown
 no enable
!
interface HundredGigE1/0/38
 shutdown
!
interface HundredGigE1/0/39
 shutdown
 no enable
!
interface HundredGigE1/0/40
 shutdown
!
interface HundredGigE1/0/41
 shutdown
 no enable
!
interface HundredGigE1/0/42
 shutdown
!
interface HundredGigE1/0/43
 shutdown
 no enable
!
interface HundredGigE1/0/44
 shutdown
!
interface HundredGigE1/0/45
 shutdown
 no enable
!
interface HundredGigE1/0/46
 shutdown
!
interface HundredGigE1/0/47
 shutdown
 no enable
!
interface HundredGigE1/0/48
 shutdown

int range HundredGigE1/0/25-48
Switch(config-if-range)#no enable
%Hu1/0/26 port is not 100G convertible port, Skipping disable configuration
%Hu1/0/28 port is not 100G convertible port, Skipping disable configuration
%Hu1/0/30 port is not 100G convertible port, Skipping disable configuration
%Hu1/0/32 port is not 100G convertible port, Skipping disable configuration
%Hu1/0/34 port is not 100G convertible port, Skipping disable configuration
%Hu1/0/36 port is not 100G convertible port, Skipping disable configuration
%Hu1/0/38 port is not 100G convertible port, Skipping disable configuration
%Hu1/0/40 port is not 100G convertible port, Skipping disable configuration
%Hu1/0/42 port is not 100G convertible port, Skipping disable configuration
%Hu1/0/44 port is not 100G convertible port, Skipping disable configuration
%Hu1/0/46 port is not 100G convertible port, Skipping disable configuration
%Hu1/0/48 port is not 100G convertible port, Skipping disable configuration

[lcaruso]

Sorry, I do not see where this card provides 1G ports in the specifications:

C9600-LC-24C

Cisco Catalyst 9600 Series 24-Port 40GE/12-Port 100GE Line Card (C9600-LC-24C)

Highlights of the C9600-LC-24C

●      Paired with C9600-SUP-1, this line card provides up to 24 ports of 40 GE or 12 ports of 100 GE nonblocking.

●      Paired with C9600X-SUP-2, this line card provides up to 24 ports of 100/40 GE nonblocking.

●      40 GE, 100 GE QSFP28 ports.

●      IPv6 support on the UADP Application-Specific Integrated Circuit (ASIC)*, providing wire-rate forwarding for IPv6 networks.

●      Advanced Encryption Standard 256 (AES-256) support with the powerful MACsec-256 encryption algorithm is available on the UADP ASIC1.

[lcaruso]

The issue is the as shipped configuration of the 100G line card is the opposite of the documentation. The documentation states one must use the odd numbered ports for 100G. The as shipped configuration disables those ports and enables the even numbered ports. Further, if you try to disable the even numbered ports, it sends an error message stating they cannot be disabled. All of the above led me to believe the even number ports were supposed to employed as 100G. So I was making an incorrect assumption and advice was correct. Thanks.

[pieterh]

interface FortyGigabitEthernet1/0/1
shutdown
!
interface FortyGigabitEthernet1/0/2
shutdown

interface HundredGigE1/0/25
shutdown
no enable
!
interface HundredGigE1/0/26
shutdown

=> this is is the shipped config ?
this looks a little confusing, but DOES match the expected config
HundredGigE1/0/25 is not enabled -> first two ports are set to 40Gig
and are referenced by FortyGigabitEthernet1/0/1 and 1/0/2

HundredGigE1/0/26 can never be enabled/ used for 100Gig

[lcaruso]

Yes, that was my problem insomuch if it was stated explicitly this was the as shipped configuration, I did not find this info. I asked TAC about this, and they said it was done that way because 40G outsells 100G. I said that's interesting since the 40G SFPs were four times more expensive than 100G SFPs. It would be nice if the firmware programmers could be more specific or accurate throwing exception messages. The transceiver was compatible, but the port configuration was wrong to support 100G in sup1 out of the box. Thanks again.