Nexus 5K to FEX 2200

[johnlloyd_13]

hi,

i need to configure a pair of nexus 5k (for vPC) and FEX 2200 modules.

my question is, do i configure vPC first or the FEX?

i saw there can be two approach (or are these two steps required?):

1.using a direct ethernet interface

2.using a port-channel interface

https://www.cisco.com/c/en/us/td/docs/switches/datacenter/nexus5000/sw/command/reference/rel_4_2_1_N2_1/NX5000CommandReference/fex-cmd-ref.html

This example shows how to associate the Fabric Extender to an Ethernet interface:
switch# configure terminal
switch(config)# interface ethernet 1/40
switch(config-if)# switchport mode fex-fabric
switch(config-if)# fex associate 101

This example shows how to associate the Fabric Extender to an EtherChannel interface:
switch# configure terminal
switch(config)# interface port-channel 4
switch(config-if)# switchport mode fex-fabric
switch(config-if)# fex associate 101

also, please confirm the FEX module will auto-upgrade itself and get the OS from the main N5K?

any helpful (and friendly/simple link to follow) will be appreciated.

[balaji.bandi]

need to configure a pair of nexus 5k (for vPC) and FEX 2200 modules.

my question is, do i configure vPC first or the FEX?

VPC first between Nexus 5K and Port-channel prefered for redundency.

follow below blog for vPC :

https://www.balajibandi.com/?p=448

Once VPC Build and working, then conenct FEX ( you need to decide, FEX need to Dual home or sigle Homed) - prefer Dual Homed ( so you need to configured vPC also here)

yes when you upgrade nexus 5K, Fex get upgraded and reboot, you can do control manner when you want to less distruption https://www.cisco.com/en/US/docs/switches/datacenter/nexus5000/sw/mkt_ops_guides/513_n1_1/n5k_enhanced_vpc.pdf.

[Reza Sharifi · Accepted solution]

If you are connecting the FEX to 2 parent switches, you need a Portchannel. Here is an example of one parent 5k switch connecting to a fex. You need the same exact config for the other 5k. There will be a total of 2 10Gig connecting the fex to the parent switches.

interface port-channel10
switchport mode fex-fabric
fex associate 10

interface Ethernetx/x/x
switchport mode fex-fabric
fex associate 10
channel-group 10

The 2200 comes with 4 10Gig for uplinks so you connect all 4 (2 to one switch and 2 to the other) or 2 10Gig (one to each switch)

HTH

[johnlloyd_13]

thanks for the feedback guys! regading the NX-OS upgrade, i upgraded a N3k a few years back, does the 5K follow the same upgrade process, i.e copy/transfer the 'kickstart' and .bin image and use the 'install' command?

i haven't check or console yet to the N5K (pending install by a remote tech) and i want to upgrade to latest NX-OS. is there an upgrade path to follow? or can i just jump directly to the latest OS since this is a "new" box?

install all kickstart bootflash:///<kickstart>.bin system bootflash:///<main NX-OS>.bin

[Reza Sharifi]

Check out this document. In general, with Nexus, if you are a few versions behind, there is an upgrade path you have to follow to get to the version you desire. Once you upgrade the 5ks, the same image will be pushed to the FEX.

https://www.cisco.com/c/en/us/td/docs/switches/datacenter/nexus5500/sw/upgrade/735_N1_1/n5500_upgrade_downgrade_735_n1_1.html

HTH

[shaikmohib]

Hey John,

Follow the below steps for upgrade. 

You can jump to the latest code but ensure you have the right files copied and perform the necessary tests. 
show install all impact nxos nxos.7.0.3.I4.7.bin  --> I have this in my 5k. This will do an impact test- It is not a requirement for the software upgrade but just a good sense check to make sure all is ok.

Also do a manual  md5 checksum 

issue the command install all nxos bootflash:nxos.7.0.3.I4.7.bin

[johnlloyd_13]

so i found out today the NX-OS is quite recent.

Software

  BIOS:      version 2.1.7

  Power Sequencer Firmware:

             Module 1: v4.0

             Module 1: v4.0

  Fabric Power Sequencer Firmware: Module 1: version v4.0

  Microcontroller Firmware:        version v0.0.0.15

  QSFP Microcontroller Firmware:  

             Module 1: v2.0.0.0

  CXP Microcontroller Firmware:  

             Module not detected

  kickstart: version 7.3(1)N1(1)

  system:    version 7.3(1)N1(1)

  BIOS compile time:       06/16/2016

  kickstart image file is: bootflash:///n6000-uk9-kickstart.7.3.1.N1.1.bin

  kickstart compile time:  10/5/2016 19:00:00 [10/06/2016 05:19:57]

  system image file is:    bootflash:///n6000-uk9.7.3.1.N1.1.bin

  system compile time:     10/5/2016 19:00:00 [10/06/2016 05:21:39]

can someone confirm i can directly upgrade my 5672UP to 7.3(8) since it's the same major release?

Main NX-OS:

https://software.cisco.com/download/home/286221337/type/282088129/release/7.3(8)N1(1)

Kickstart:

https://software.cisco.com/download/home/286221337/type/282088130/release/7.3(8)N1(1)

[balaji.bandi]

yes you can upgrade directly from your old to new : (Table 3 Supported Upgrade and Downgrade Paths for Cisco NX-OS Release 7.3(8)N1(1) )

Upgrade :

https://www.cisco.com/c/en/us/td/docs/switches/datacenter/nexus5600/sw/upgrade/738_N1_1/n5600_upgrade_downgrade_738_n1_1.html

read the release notes closely :

https://www.cisco.com/c/en/us/td/docs/switches/datacenter/nexus5600/sw/release/notes/7x/Nexus5600_Release_Notes_7x.html#pgfId-857651

[johnlloyd_13]

hi balaji,

thanks! it's been a while since i upgraded a nexus switch. just to confirm, i upgrade the 'kickstart' OS first before the main NX-OS?

or sequence doesn't matter?

[balaji.bandi · Accepted solution]

use below commands :

switch# show incompatibility system bootflash:n5600-uk9.7.3.3.N1.1.bin

switch# show spanning-tree issu-impact

switch# show install all impact kickstart bootflash:n5600-uk9-kickstart.7.3.8.N1.1.bin system bootflash:n5600-uk9.7.3.8.N1.1.bin

here is clear steps : (suggest to spend 10-15min and understand the process, rather doing in rush)

https://www.cisco.com/c/en/us/td/docs/switches/datacenter/nexus5600/sw/upgrade/738_N1_1/n5600_upgrade_downgrade_738_n1_1.html#pgfId-718912

[johnlloyd_13]

hi guys,

i managed to upgrade the N5K. there's a upgrade path to follow: 7.3(1) > 7.3(2) > 7.3(8)

i really need to "brush up" my cisco DC skills. are there good cisco books/video tutorials you can recommend?

# sh ver
Cisco Nexus Operating System (NX-OS) Software
TAC support: http://www.cisco.com/tac
Documents: http://www.cisco.com/en/US/products/ps9372/tsd_products_support_serie
s_home.html
Copyright (c) 2002-2020, Cisco Systems, Inc. All rights reserved.
The copyrights to certain works contained herein are owned by
other third parties and are used and distributed under license.
Some parts of this software are covered under the GNU Public
License. A copy of the license is available at
http://www.gnu.org/licenses/gpl.html.

Software
BIOS: version 2.1.7
Power Sequencer Firmware:
Module 1: v4.0
Module 1: v4.0
Fabric Power Sequencer Firmware: Module 1: version v4.0
Microcontroller Firmware: version v0.0.0.15
QSFP Microcontroller Firmware:
Module 1: v2.0.0.0
SFP Microcontroller Firmware:
Module 1: v1.3.0.0
CXP Microcontroller Firmware:
Module not detected
kickstart: version 7.3(8)N1(1)
system: version 7.3(8)N1(1)
BIOS compile time: 06/16/2016
kickstart image file is: bootflash:///n6000-uk9-kickstart.7.3.8.N1.1.bin
kickstart compile time: 7/26/2020 12:00:00 [07/26/2020 21:46:52]
system image file is: bootflash:///n6000-uk9.7.3.8.N1.1.bin
system compile time: 7/26/2020 12:00:00 [07/26/2020 21:48:20]