ACI - QSFP 40Gbps - Very high Temperature inside a N9K-C93108TC-EX

[ju.mahieu]

Hi,

My DC Ops team are reporting that our QSFP-40G-SR-BD inside Nexus 9000 C93108TC-EX are very hot. Too hot to take by hand longer than 6 seconds. The OS version running is n9000-12.1(1h).

The temperature is normal if we put the same SFP inside a N9K-C93180YC-EX.

Could we consider this temperature level as normal state ? Do you have the same behaviour in your own devices ?

Thank you

Regards

Ju

==============

leaf103# show environment temperature
Temperature:
-----------------------------------------------------------------------------------
Module   Sensor                       MajorThresh   MinorThres   CurTemp     Status
                                      (Celsius)     (Celsius)    (Celsius)
-----------------------------------------------------------------------------------
1        Inlet(1)                      70            42           30         normal
1        outlet(2)                     80            70           36         normal
1        x86 processor(3)              90            80           53         normal
1        Sugarbowl(4)                  110           90           58         normal
1        Sugarbowl vrm(5)              120           110          58         normal
1        10G PHY 1(6)                  110           110          46         normal
1        10G PHY 2(7)                  110           100          44         normal
1        10G PHY 3(8)                  110           100          42         normal
1        10G PHY 4(9)                  110           100          43         normal
1        10G PHY 5(10)                 110           100          43         normal
1        10G PHY 6(11)                 110           100          41         normal
1        10G PHY 7(12)                 110           100          41         normal
1        10G PHY 8(13)                 110           100          41         normal
1        10G PHY 9(14)                 110           100          40         normal
1        10G PHY 10(15)                110           100          46         normal
1        10G PHY 11(16)                110           100          49         normal
1        10G PHY 12(17)                110           100          54         normal

leaf103# show interface  Ethernet1/49 transceiver sprom
Ethernet1/49
    transceiver is present
    type is QSFP-40G-SR-BD
    name is CISCO-AVAGO
    part number is AFBR-79EBPZ-CS2
    revision is 01Bh
    serial number is AVM2025U0TV
    nominal bitrate is 20600 MBit/sec per channel
    Link length supported for 50/125um OM3 fiber is 100 m
    cisco id is -- 13
    cisco extended id number is 220

DOM is Disabled
  Identifier                      : 0x0d (QSFP+)
  Ext_Identifier                  : 0xdc
  Connector                       : 0x07 (LC)
  Infiniband Compliance Code      : 0x00 (None)
  Sonet Compliance Code           : 0x0000
  Gigabit Ethernet Compliance Code: 0x00 (None)
  Encoding                        : 0x05 (64B/66B)
  BR_Nominal                      : 0xce  [20600]
  Reserved1                       : 0x00
  Length_SMF                      : 0x00  0 KM
  Length_OM3                      : 0x32  100 Meters
  Length_OM2                      : 0x00  0 Meters
  Length_OM1                      : 0x00  0 Meters
  Length_Copper                   : 0x00  0 Meters
  Reserved2                       : 0x00
  Vendor Name                     : CISCO-AVAGO
  Reserved3                       : 0x00
  Vendor OUI                      : 0x00176a
  Vendor Part No                  : AFBR-79EBPZ-CS2
  Vendor Revision                 : 01Bh
  Reserved4                       : 0x07d046
  Check Code ID                   : 0x48 (OK)
  Options                         : 0x0000
  BR Max                          : 0x0f
  BR Min                          : 0xde
  Vendor Serial No                : AVM2025U0TV
  Date Code                       : 160620
  Diagnostic Monitoring Type      : 0x08
  enchancedOptions                : 0x00
  SFF8472Compliance               : 0xf5
  Check Code EXT                  : 0xd5 (OK)
  Vendor Specific ID Data         : 0xf50006e8f42971c5579ca988e5020898
                                  : 0x2e52430000000000000000008a1c5861

[Manish Gogna]

Hi Ju,

It looks to be within normal range as per the following

http://www.cisco.com/c/en/us/products/collateral/interfaces-modules/transceiver-modules/data_sheet_c78-660083.html

Environmental Conditions

Operating temperature range:

●   Commercial temperature range: 0 to 70°C (32 to 158°F). Exceptions are

◦     QSFP BiDi (QSFP-40G-SR-BD): +10 to 70°C (50 to 158°F)

◦     QSFP BiDi Monitor (QSFP-40G-BD-RX): +10 to 70°C (50 to 158°F)

◦     QSFP LR4 Lite (WSP-Q40GLR4L): +10 to 60°C (50 to 140°F)

HTH

Manish

[ju.mahieu]

Thank you Manish for your answer.

Regards,

Ju

[amit.fernandes]

Ju,

I've noticed the same issue with two similar models with one variant- specific to the airflow direction

The QSFPs are:
1) Too hot on my Nexus 9000 C93108TC-EX *** with Port side exhaust ***
2) Normal (warm) on my Nexus 9000 C93108TC-EX *** with Port side intake ***
3) Normal (warm) on my Nexus 9000 C93180TC-EX *** with Port side exhaust ***

What is your airflow ?

Thanks,

Amit

[ju.mahieu]

Hi Amit.

I confirm my nexus are provided with port side exhaust.

Thank you for that clarification.

Regards

Ju

[amit.fernandes]

Hi Ju,

Its strange because on we don't have similar issues on our other 9Ks with PE.

Did you ever escalate to TAC ? I'm curious if this could be related to the PE airflow on this particular switch.

Also, have you ever had any service issues - high temp alarms, or tranceiver failures ? I see that that your original post was from 2017.

-Amit