Upgrading UCS Mini to 3.1.1g, FI is getting as failed.

[andyblada1]

Hello Team,

I am upgrading my UCS Mini to 3.1.1g, FI is getting as failed. UCS manager upgraded successfully. But post activating firmware upgrade for subordinate FI, getting FAILED message .

Severity Code     Last Transition Time     ID       Description

--------- -------- ------------------------ -------- -----------

Major     F0856   2016-05-25T11:40:07.737   218232 Activation failed and Activate Status set to failed.

Major     F0856   2016-05-25T11:40:07.737   218233 Activation failed and Activate Status set to failed.

Warning   F16653   2016-05-25T11:40:07.736   218229 [FSM:STAGE:FAILED]: updating peer fabric interconnect(FSM-STAGE:sam:dme:MgmtControllerUpdateSwitch:updateRemote)

Warning   F78093   2016-05-25T11:40:07.736   218227 [FSM:STAGE:REMOTE-ERROR]: Result: end-point-failed Code: unspecified Message: Pre-Upgrade check failed.Free space in the filesystem is below threshold.(sam:dme:MgmtControllerUpdateSwitch:updateRemote)

Critical F999693 2016-05-25T09:17:21.941   218231 [FSM:FAILED]: update fabric interconnect image(FSM:sam:dme:MgmtControllerUpdateSwitch). Remote-Invocation-Error: Pre-Upgrade check failed.Free space in the filesystem is below threshold.

UCSXXX-XXX-B(local-mgmt)# dir

2 4096 May 25 09:07:18 2016 backup/

1   16 Apr 19 21:16:27 2011 cores

2 4096 May 20 07:58:05 2011 debug_plugin/

1   31 Apr 19 21:16:27 2011 diagnostics

2 4096 Jan 15 02:52:56 2011 lost+found/

2 4096 Jan 15 02:54:26 2011 techsupport/

Usage for workspace://

4039811072 bytes total

33615872 bytes used

3800977408 bytes free

Enough free space is available. Not sure why this error message is coming.

[Wes Austin · Accepted solution]

Hello,

It appears you do not have enough space in the /var/tmp directory to kick off the upgrade. Moving forward, I would suggest opening a TAC case and they can clear the directory for you and help you proceed with the upgrade.

HTH,

Wes

[andyblada1]

Thanks Wesley & Qiese,

Can't i perform this deletion. How can i access this /var/tmp.

[andyblada1]

Thank you Wesley & Qiese,

i rebooted my subordinate FI which resolved the issue.

/var/tmp was more than 10% as per link

https://bst.cloudapps.cisco.com/bugsearch/bug/CSCuv03557/?referring_site=bugquickviewredir

[Kral Two]

I hit the same bug on UCS 6200 platform, when trying to upgrade from 2.2(3d) to 3.1(2c).

It seems like the space validation routine is checking for var_tmp > 10% used space, instead of var_tmp < 10% left space.

Rebooting Fabric Interconnects solved my problem too (var_tmp under 1% after fresh reboot).

According to CSCun79792, this bug is fixed with 2.2(6c) and ongoing.

[Qiese Dides · Accepted solution]

Hi Andy,

As Wesley stated you are hitting a bug in which the /var/tmp folder is  >10%. The bug ID is listed below;

https://bst.cloudapps.cisco.com/bugsearch/bug/CSCun79792/?reffering_site=dumpcr

If you open a case with Cisco TAC they will be able to send you a file named the "debug plugin" and load it to your environment. To clear the /var/tmp is non disruptive and only takes minutes, and your upgrade will be able to continue without an issue.

I did notice you had other faults such as the board controller activation failed, this should be cleared up when you upgrade. This is due to the fact that the board controller doesn't have the image of the newer version, and a  board controller can not be downgraded. The support forum link has a response I gave a customer that goes into greater detail on this subject also.

https://supportforums.cisco.com/discussion/12714311/b200-m4-activation-failed#comment-10958451

I hope this helps you - please rate any answer and mark the answers as solutions, this helps other customers find useful information

Qiese Dides