Fan warning on N5K after upgrading NX-OS from 5.0 to 5.1 or 5.2

[ataranen]

Has anyone seen the following fan warnings after upgrading the OS on 5548UP? I tested on 2 systems with the same result. Reverting back to NX-OS 5.0 stops the warning. The upgrade was done using the command:

install all kickstart bootflash:n5000-uk9-kickstart.5.1.3.N1.1a.bin system bootflash:n5000-uk9.5.1.3.N1.1a.bin

Same problem for n5000-uk9.5.2.1.N1.bin and n5000-uk9.5.1.3.N1.1a.bin images. No problem running n5000-uk9.5.0.3.N2.1.bin

2012 Jul 20 13:51:47 n5k-1 %$ VDC-1 %$ %NOHMS-2-NOHMS_ENV_ERR_FAN_SPEED:  System minor alarm in fan tray 2: fan speed is out of range on fan 3.  12158 to 16211 rpm expected. 11894 rpm read

2012 Jul 20 13:51:47 n5k-1 %$ VDC-1 %$ %NOHMS-2-NOHMS_ENV_ERR_FANS_DOWN:  System major alarm on fans: Multiple fans missing or failed

2012 Jul 20 13:51:47 n5k-1 %$ VDC-1 %$ %PFMA-0-SYS_SHUTDOWN_FAN_REMOVAL:  System shutdown in 60 seconds due to fan removal

2012 Jul 20 13:51:52 n5k-1 %$ VDC-1 %$ %PFMA-0-SYS_SHUTDOWN_FAN_REMOVAL:  System shutdown in 55 seconds due to fan removal

2012 Jul 20 13:51:57 n5k-1 %$ VDC-1 %$ %PFMA-0-SYS_SHUTDOWN_FAN_REMOVAL:  System shutdown in 50 seconds due to fan removal

2012 Jul 20 13:52:02 n5k-1 %$ VDC-1 %$ %PFMA-0-SYS_SHUTDOWN_FAN_REMOVAL:  System shutdown in 45 seconds due to fan removal

2012 Jul 20 13:52:03 n5k-1 %$ VDC-1 %$  %NOHMS-2-NOHMS_ENV_ERR_FAN_RECOVERED: Recovered: System minor alarm in  fan tray 1

2012 Jul 20 13:52:03 n5k-1 %$ VDC-1 %$ %NOHMS-2-NOHMS_ENV_ERR_FANS_UP:  Recovered: System major alarm on fans: Multiple fans missing or failed

2012 Jul 20 13:52:17 n5k-1 %$ VDC-1 %$  %NOHMS-2-NOHMS_ENV_ERR_FAN_RECOVERED: Recovered: System minor alarm in  fan tray 2

2012 Jul 20 13:52:17 n5k-1 %$ VDC-1 %$  %NOHMS-2-NOHMS_ENV_ERR_ALL_FAN_UP: Recovered: System minor alarm on  fans: One fan missing or failed

2012 Jul 20 13:52:33 n5k-1 %$ VDC-1 %$ %NOHMS-2-NOHMS_ENV_ERR_FAN_SPEED:  System minor alarm in fan tray 1: fan speed is out of range on fan 1.  12158 to 16211 rpm expected. 11739 rpm read

2012 Jul 20 13:52:33 n5k-1 %$ VDC-1 %$ %NOHMS-2-NOHMS_ENV_ERR_FAN_SPEED:  System minor alarm in fan tray 1: fan speed is out of range on fan 3.  12158 to 16211 rpm expected. 11816 rpm read

2012 Jul 20 13:52:33 n5k-1 %$ VDC-1 %$ %NOHMS-2-NOHMS_ENV_ERR_FAN_DOWN:  System minor alarm on fans: One fan missing or failed

2012 Jul 20 13:52:47 n5k-1 %$ VDC-1 %$ %NOHMS-2-NOHMS_ENV_ERR_FAN_SPEED:  System minor alarm in fan tray 2: fan speed is out of range on fan 1.  12158 to 16211 rpm expected. 11894 rpm read

2012 Jul 20 13:52:47 n5k-1 %$ VDC-1 %$ %NOHMS-2-NOHMS_ENV_ERR_FAN_SPEED:  System minor alarm in fan tray 2: fan speed is out of range on fan 3.  12158 to 16211 rpm expected. 11894 rpm read

[Prashanth Krishnappa]

If you have downgraded back to get it operational, can you post the following outputs?

show mod

show environment

show inventory

[ataranen]

Here is the output from "show mod" "show environment" and "show inventory" with NX-OS 5.0.

n5k-1# show module

Mod Ports  Module-Type                      Model                  Status

--- -----  -------------------------------- ---------------------- ------------

1    32     O2 32X10GE/Modular Universal Pla N5K-C5548UP-SUP        active *

3    0      O2 Daughter Card with L3 ASIC    N55-D160L3             ok

Mod  Sw              Hw      World-Wide-Name(s) (WWN)

---  --------------  ------  --------------------------------------------------

1    5.0(3)N2(1)     1.0     --

3    5.0(3)N2(1)     1.0     --

Mod  MAC-Address(es)                         Serial-Num

---  --------------------------------------  ----------

1    0005.73fc.2988 to 0005.73fc.29a7         JAF1523DTST

3    0000.0000.0000 to 0000.0000.000f         FOC153839YM

n5k-1#

##############################################################################

n5k-1# show environment

Fan:

------------------------------------------------------

Fan             Model                Hw         Status

------------------------------------------------------

Chassis-1       N5548P-FAN-B         --         ok

Chassis-2       N5548P-FAN-B         --         ok

PS-1            N55-PAC-750W-B       --         ok

PS-2            N55-PAC-750W-B       --         ok

Temperature

-----------------------------------------------------------------

Module   Sensor     MajorThresh   MinorThres   CurTemp     Status

                    (Celsius)     (Celsius)    (Celsius)        

-----------------------------------------------------------------

1        Outlet     67            57           40          ok            

Power Supply:

Voltage: 12 Volts

-----------------------------------------------------------

PS  Model                Input Power       Power     Status

                         Type  (Watts)     (Amp)          

-----------------------------------------------------------

1   N55-PAC-750W-B       AC     744.00     62.00     ok                 

2   N55-PAC-750W-B       AC     744.00     62.00     ok                 

Mod Model                   Power     Power       Power     Power       Status

                            Requested Requested   Allocated Allocated        

                            (Watts)   (Amp)       (Watts)   (Amp)              

--- ----------------------  -------   ----------  --------- ----------  --------

--

1    N5K-C5548UP-SUP        648.00    54.00       648.00    54.00       powered-

up

3    N55-D160L3             144.00    12.00       144.00    12.00       powered-

up

Power Usage Summary:

--------------------

Power Supply redundancy mode:                 Redundant

Power Supply redundancy operational mode:     Redundant

Total Power Capacity                             1488.00 W

Power reserved for Supervisor(s)                  648.00 W

Power currently used by Modules                   144.00 W

                                                -------------

Total Power Available                             696.00 W

                                                -------------

n5k-1#

#################################################################

n5k-1# show inventory

NAME: "Chassis", DESCR: "Nexus5548 Chassis"

PID: N5K-C5548UP       , VID: V01 , SN: SSI151700EW

NAME: "Module 1", DESCR: "O2 32X10GE/Modular Universal Platform Supervisor"

PID: N5K-C5548UP       , VID: V01 , SN: JAF1523DTST

NAME: "Fan 1", DESCR: "Chassis fan module"

PID: N5548P-FAN-B      , VID: N/A , SN: N/A

NAME: "Fan 2", DESCR: "Chassis fan module"

PID: N5548P-FAN-B      , VID: N/A , SN: N/A

NAME: "Power supply 1", DESCR: "AC power supply"

PID: N55-PAC-750W-B    , VID: V01 , SN: ART1525X1FU

NAME: "Power supply 2", DESCR: "AC power supply"

PID: N55-PAC-750W-B    , VID: V01 , SN: ART1525X1FT

NAME: "Module 3", DESCR: "O2 Daughter Card with L3 ASIC"

PID: N55-D160L3        , VID: V01 , SN: FOC153839YM

n5k-1#

[Prashanth Krishnappa]

Thanks.. I had seen similar issue once in the past where N5548P-FAN-B was recognized as N5548P-FAN after an upgrade causing the error. I suggest that you open a TAC case and get the fans replaced to see if it helps. If you open a TAC case, do let me know the case number so that I can follow up with it.

[ataranen]

Managed to fix the problem. I had to replace both powersupplies and fan modules. It appears the Back-to-Front airflow provided by N55-PAC-750W-B power supply and N5548UP-FAN-B fan doesn't work with NX-OS 5.1 and 5.2. What works is N55-PAC-750W and N5548UP-FAN. 

[Prashanth Krishnappa]

N55-PAC-750W-B power supply and N5548UP-FAN-B fan do work but you will have to replace the

N5548UP-FAN-B modules

[ataranen]

From what I can tell, we can't mismatch the FAN and PAC when it comes to the airflow. If I try to put N5548UP-FAN with  N55-PAC-750W-B the switch will automatically turn off. Both PS and FAN have to be either Front-to-Back or Back-to-Front airflow. That's why to run NX-OS 5.1 or 5.2 I had to replace both the PSs and the FANs.

Thanks for your help, it pointed me in the right direction.