(ASK) Host interface status on FEX during image download / upgrading

[manurung]

Hi,

I want to upgrade nexus N9K/N5K and fex extender and as I know there is the process:

1. Parent switch will download new OS then upgrade/reloaded to new OS, when parent switch reload fex will be offline same as host interface will be down as well.

2. Once parent switch come up with new OS, fabric interface will be up and fex noticed the parent switch using new OS. In this state fex will download new image and proceed the upgrade.

My question:

During image download process and upgrading the fex (before fex reload the devices), what is the status host interface in fex? will it be down or up?

As we know only if network/fabric interface down, then host interface will down as well. But during the image download, the fabric interface is up right, so not sure if the host interface also up or down.

I guess we couldnt check host interface status via parent switch 100% correctly, the only option we need to check the status from server itself.

So, might be anyone had experience to see how is the server interface status when you upgrade the FEX devices.

Thank you.

Manurung

[anpetit]

Hello, 

Once the parent switch will be running on the target release, the fex will proceed to download and install the image.

Interfaces on the fex will be down until the version mismatch from parent switch and the fex is cleared. 

I've already experienced during these type of upgrade, one fex who failed to donwload the image and it was resulting in version mismatch and the fex was not able to run properly, servers were unreachable. 

Hope it answers your request.

Kind Regards,

Antoine

[manurung]

Hi @anpetit 

Thank you for answer.

But, during a FEX downloading new image, did you double check the vmnic is down on Server side (just checking on level one basis)?

Best regards,

Manurung

[anpetit]

HI @manurung , 

No, I haven't check the vmnic on server side to see if it was up or down during the upgrade.

Nevertheless, here is something interesting from the parent switch. The output below was from a FEX trying to download the image but failing constantly to do so. 

show fex 152 detail
FEX: 152 Description: FEX152|T02D35 state: Image Download >>>> FEX downloading the image
FEX version: 7.1(4)N1(1) [Switch version: 7.1(4)N1(1e)]
FEX Interim version: 7.1(4)N1(1)
Switch Interim version: 7.1(4)N1(1e)
Module Sw Gen: 21 [Switch Sw Gen: 21]
post level: complete
Pinning-mode: static Max-links: 1
Fabric port for control traffic: Eth1/7
FCoE Admin: false
FCoE Oper: true
FCoE FEX AA Configured: false
Fabric interface state:
Po152 - Interface Up. State: Active
Eth1/7 - Interface Up. State: Active
Eth1/8 - Interface Up. State: Active
Logs:
03/18/2021 09:19:42.236697: Offlining Module
03/18/2021 09:19:42.299006: Deleting route to FEX
03/18/2021 09:19:42.309144: Module disconnected
03/18/2021 09:19:42.310590: Offlining Module
03/18/2021 09:25:24.920026: Module register received
03/18/2021 09:25:24.920825: Image Version Mismatch
03/18/2021 09:25:24.921085: Registration response sent
03/18/2021 09:25:24.921244: Requesting satellite to download image
03/18/2021 09:27:02.159540: Image preload failed.
03/18/2021 09:27:03.522890: Deleting route to FEX
03/18/2021 09:27:03.533756: Module disconnected
03/18/2021 09:27:03.534566: Module Offline
03/18/2021 09:27:03.565592: Deleting route to FEX
03/18/2021 09:27:03.573712: Module disconnected
03/18/2021 09:27:03.575416: Offlining Module
03/18/2021 09:27:09.877126: Deleting route to FEX
03/18/2021 09:27:09.884806: Module disconnected
03/18/2021 09:27:09.885819: Offlining Module
03/18/2021 09:29:21.578176: Module register received
03/18/2021 09:29:21.578954: Image Version Mismatch
03/18/2021 09:29:21.579161: Registration response sent
03/18/2021 09:29:21.579318: Requesting satellite to download image
03/18/2021 09:31:05.436913: Image preload failed.
03/18/2021 09:31:06.830136: Deleting route to FEX
03/18/2021 09:31:06.840759: Module disconnected
03/18/2021 09:31:06.841370: Module Offline
03/18/2021 09:31:06.882296: Deleting route to FEX
03/18/2021 09:31:06.890040: Module disconnected
03/18/2021 09:31:06.891495: Offlining Module
03/18/2021 09:31:16.698769: Deleting route to FEX
03/18/2021 09:31:16.708613: Module disconnected
03/18/2021 09:31:16.709598: Offlining Module
03/18/2021 09:33:24.885560: Module register received
03/18/2021 09:33:24.886364: Image Version Mismatch
03/18/2021 09:33:24.886590: Registration response sent
03/18/2021 09:33:24.886748: Requesting satellite to download image
03/18/2021 09:35:16.667997: Image preload failed.
03/18/2021 09:35:18.212131: Deleting route to FEX
03/18/2021 09:35:18.222628: Module disconnected
03/18/2021 09:35:18.223170: Module Offline
03/18/2021 09:35:18.245764: Deleting route to FEX
03/18/2021 09:35:18.253481: Module disconnected
03/18/2021 09:35:18.254369: Offlining Module
03/18/2021 09:35:18.306314: Deleting route to FEX
03/18/2021 09:35:18.314086: Module disconnected
03/18/2021 09:35:18.315010: Offlining Module
03/18/2021 09:37:36.108826: Module register received
03/18/2021 09:37:36.109629: Image Version Mismatch
03/18/2021 09:37:36.109865: Registration response sent
03/18/2021 09:37:36.110021: Requesting satellite to download image
03/18/2021 09:39:10.914881: Image preload failed.
03/18/2021 09:39:12.168836: Deleting route to FEX
03/18/2021 09:39:12.176779: Module disconnected
03/18/2021 09:39:12.177364: Module Offline
03/18/2021 09:39:12.197661: Deleting route to FEX
03/18/2021 09:39:12.205226: Module disconnected
03/18/2021 09:39:12.206083: Offlining Module
03/18/2021 09:39:12.245118: Deleting route to FEX
03/18/2021 09:39:12.253163: Module disconnected
03/18/2021 09:39:12.254060: Offlining Module
03/18/2021 09:41:29.914091: Module register received
03/18/2021 09:41:29.914873: Image Version Mismatch
03/18/2021 09:41:29.915108: Registration response sent
03/18/2021 09:41:29.915330: Requesting satellite to download image

 From the show fex <id> detail cli, in an online state, we are observing the interfaces connected to server from the fex are either up or down. 

When the FEX  is on Image download state, this cli do not return any information from the interfaces connected to server. So I would assume they are down, and down as well on server side. 

Hope it answers your request.

Kind regards,

Antoine

[anpetit]

HI @manurung , 

Does it answer your query ? 

Thanks for the feedback. 

Kind Regards,
Antoine