cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
3509
Views
10
Helpful
10
Replies

Nexus 7009 M1 Linecardreplacement

Hi,

i have a Nexus 7009 with two SUP2E running NX-OS 6.2(22); the Switch has 2 M1 Linecards which have to be raplaced by M3 Linecards N7K-M348XP-25L=

Mod Ports Module-Type Model Status
--- ----- ----------------------------------- ------------------ ----------
1 0 Supervisor Module-2 N7K-SUP2E ha-standby
2 0 Supervisor Module-2 N7K-SUP2E active *
3 24 10 Gbps Ethernet Module N7K-M224XP-23L ok
4 24 10 Gbps Ethernet Module N7K-M224XP-23L ok
5 48 1000 Mbps Optical Ethernet XL Modul N7K-M148GS-11L ok
6 24 10 Gbps Ethernet Module N7K-M224XP-23L ok
7 24 10 Gbps Ethernet Module N7K-M224XP-23L ok
8 48 1000 Mbps Optical Ethernet XL Modul N7K-M148GS-11L ok
9 6 10/40 Gbps Ethernet Module N7K-M206FQ-23L ok

 

Any suggestions howto replace M1 Linecards with M3 Linecards, without loosing the

port-configuration.

Thanks in advance

Manfred

10 Replies 10

balaji.bandi
Hall of Fame
Hall of Fame

Suggest to look at the comparability matrix :

 

https://www.cisco.com/c/dam/en/us/td/docs/switches/datacenter/nexus7000/sw/matrix/technical/reference/Module_Comparison_Matrix.pdf

 

Once it is satisfy the requirement, and you do not have empty slot for new M3 card, you need eject the old and one and insert and test.

in this stage all the connection connected to slot that port will be loss of connectivity.

 

if Nexus have Pair configured, you can replace one at a time in each chasis, you need to copy the port configuration, since new module may need to put the configraiton back again once newly install moduled installed and configured.

 

Other note : if this is vDC environment you need allocate new resources to correct vDC.

 

 

 

BB

***** Rate All Helpful Responses *****

How to Ask The Cisco Community for Help

CNM88
Level 1
Level 1
BUMP....

I'd like to confirm, with someone who has done this, whether the configuration is lost when replacing an older generation line card with a new line card e.g. M3 series. I know that when replacing like cards the configuration remains intact but I have not been able to confirm when moving from one series of line card to another. In this case, the port count remains the same.

ervindm
Level 1
Level 1

Hi

 

Did you end up getting and answer to this question as well as going thru and replacing the m1 with m3 cards and what was the outcome ? I am looking at similar process but going from M2 and F2 to F3 cards on same vdc ?

 

Thanks


@ervindm wrote:

Hi

 

Did you end up getting and answer to this question as well as going thru and replacing the m1 with m3 cards and what was the outcome ? I am looking at similar process but going from M2 and F2 to F3 cards on same vdc ?

 

Thanks


We did not do the replacement yet but I did confirm with TAC that the configuration is lost when changing cards. As long as the slots remain the same, you should be able to cut & paste the config word for word. The only caveat to that would be if the port time was changing. For example, if you're going form GigabitEthernet ports to TenGigabitEthernet ports.

Thanks for that so config will be lost once new card goes in and restore from back up then.  I ad this plan below for trying to preserve the config but by sounds of it its a mute point anyway Also should we suspend the vdc at some point in the process when replacing the card ?

 

First step

F2 swap out to F3

1)      Logical shut down of all interfaces on line card 5 N7K-F248XP-25E  i.e. shutdown interfaces xx

2)      Power down line card 5   module N7K-F248XP-25E    

3)      Remove line card 5 and cables

4)      Insert  F3 N7K-F348XP-25 line card into slots

5)      Patch cables to F3 card

6)      On the admin vdc change resource allocation to limit-resource module-type m2xl F3

7)      Power up line card 5

8)      Un shut interfaces and confirm are working and showing up in PROD-B vdc

9)      Copy config to startup

 

Second steps

M2 swap out to F3

1)      Logical shut down of all interfaces on lines cards 3 and 4 N7K-M224XP-23L  i.e. shutdown interfaces xx

2)      Power down line card 3 and 4   module N7K-M224XP-23L 

3)      Remove line card 3 and 4  and cables

4)      Insert  F3 N7K-F348XP-25 line card into slots

5)      Patch cables to F3 cards

6)      On the admin vdc change resource allocation to limit-resource module-type F3

7)      Power up line card 3 and 4

8)      Unshut interfaces and confirm are working

 

 

 

Current Modules and VDC allocation

Mod  Ports  Module-Type                         Model              Status

---  -----  ---------------------------------- ------------------ ----------

1    0      Supervisor Module-2                 N7K-SUP2E          ha-standby

2    0      Supervisor Module-2                 N7K-SUP2E          active *

3    24     10 Gbps Ethernet Module             N7K-M224XP-23L     ok

4    24     10 Gbps Ethernet Module             N7K-M224XP-23L     ok

5    48     1/10 Gbps Ethernet Module           N7K-F248XP-25E     ok

 

 

 

vdc PROD-B id 2

  limit-resource module-type m2xl f2e

  cpu-share 5

  allocate interface Ethernet3/1-24

  allocate interface Ethernet4/1-24

  allocate interface Ethernet5/1-48

 

One other thing to be aware of is that different line cards have different VDC port groupings. You can check the following doc for more details on that.
https://www.cisco.com/c/en/us/td/docs/switches/datacenter/sw/nx-os/virtual_device_context/configuration/guide/b-7k-Cisco-Nexus-7000-Series-NX-OS-Virtual-Device-Context-Configuration-Guide/managing-vdc.html

Hi,
thanks very much for your answer. We replaced our M1 Linecrds by M3
Linecards.
Unfortunately you have to deallocate M1 Linecards from VDC´s in order to
change
vdc supported Linecards; doing this you are clearing the LC Port
configuration.
Here are my steps:


*>> Step 1. ISSU Upgrade from 7.3(3)D1(1) to target release 8.2(4)*

*1.1) power down unsupported M1 linecard(s) *using the command:

*N7k-S955-2#**/conf t/*

Enter configuration commands, one per line.End with CNTL/Z



*N7k-S955-2(config)#**/poweroff module /*

*1.2) purge the configuration from unsupported M1 linecard(s) *using the
command:

*N7k-S955-2#**/conf t/*

Enter configuration commands, one per line.End with CNTL/Z.



*N7k-S955-2(config)#**/vdc /*

*N7k-S955-2(config-vdc)#**/purge module running-config/*

*N7k-S955-2(config)#**/end/*

*1.3) save running- to startup configuration*using the command:

*N7k-S955-2#**/copy running-config startup-config vdc-all/*

*1.4) start ISSU Upgrade to 8.2(4) *using the command:

*N7k-S955-2#**/install all kickstart
bootflash:n7000-s2-kickstart.8.2.4.bin system/*//

*/bootflash:n7000-s2-dk9.8.2.4.bin/*
*//*

*1.4) check install upgrade for success *using the command:

*N7k-S955-2#**/show install all status/*

*>> Step 2. Remove unsupported M1 linecard(s) from Switch Chassis*

**

*>> Step 3. Install M3 linecard(s)*

*3.1) **install M3 linecard(s) into empty Slots*

*Remark: M3 linecards are powered down after insertion into chassis and
arenot automatically allocated to source vdc !***

*3.2) power up new inserted M3 linecard(s) *using the command:

*N7k-S955-2#**/conf t/*

Enter configuration commands, one per line.End with CNTL/Z.

*N7k-S955-2(config)#**/no poweroff module /*

*3.3) check module status *using the command:

*N7k-S955-2#* */sh mod/*

*>> Step 4. Change supported linecard(s) switchwide & vdc-wide*

*4.1) **check supported linecard(s) *using the command:**

*N7k-S955-2#**/show vdc detail/***

*/Switchwide mode ism1 f1 m1xl f2 m2xl f2e f3 m3 /*

/vdc id: 1/

/vdc name: *N7k-S955-2*/

/vdc type: Ethernet/

/……/

*/vdc supported linecards: m1 f1 m1xl m2xl/*

**

*4.2) Change Chassis-supported (Switchwide mode) linecard(s)*- in our
case not necessary - using the command:

*N7k-S955-2#**/conf t/*

Enter configuration commands, one per line.End with CNTL/Z.

*N7k-S955-2(config)#**/system module-type m1 f1 m1xl f2 m2xl f2e f3 m3/*

*4.3) Change VDC supported linecard(s) if necessary*

*Remark*:

·you need to remove the M1 linecards as they are not supported in the
same VDC with the M3 linecard. Thus you won’t be able to add M3
linecard(s) unless you remove them

·m2 interfaces can coexist with m3 or m1xl interfaces in same vdc, but
m1xl and m3 interfaces cannot coexist

·no interface from m2 module working with m3 interface can be allocated
to other vdc

·m2 module need to be in V5 (vdc with inter-oper command) mode if m3
interface exists in same vdc

·m2 module need to be in V4 (vdc without inter-oper command) mode if
m1xl interface exists in same vdc; this is the default interop-mode for
m2 modules

**

*4.3.1) Before changing vdc supported linecard(s) to M2, M3 supported
linecard(s) you have to deallocate all M2 linecard(s) from vdc*using the
command:

*N7k-S955-2#**/conf t/*

Enter configuration commands, one per line.End with CNTL/Z.

*N7k-S955-2(config)#**/vdc ///*

*N7k-S955-2(config-vdc)#**/no allocate interface ethernet
/*

*Moving ports will cause all config associated to them in source vdc to
be removed*. Are you sure you want to move the ports (y/n)? [*yes*]

*N7k-S955-2(config-vdc)#**/exit/*

*4.3.2) Change vdc supported linecard(s) to M2, M3 supported
linecard(s)*using the command:

*N7k-S955-2#**/conf t/*

Enter configuration commands, one per line.End with CNTL/Z.

*N7k-S955-2(config)#**/vdc /*

*N7k-S955-2(config-vdc)#**/limit-resource module-type m3 m2xl/*

*//*

*4.3.3) check supported linecard(s) in vdc*

*N7k-S955-2#* */show vdc detail/*

/Switchwide mode ism1 f1 m1xl f2 m2xl f2e f3 m3/

/vdc id: 1/

*/vdc name: N7k-S955-2/*

/vdc type: Ethernet/

/……/

*/vdc supported linecards: m2xl m3/*

*//*

*4.3.4) change Interoperability of deallocated M2 linecard(s) to m2-m3
mode (V5 mode) *using the command:

*N7k-S955-2#**/conf t/*

Enter configuration commands, one per line.End with CNTL/Z.

*N7k-S955-2(config)#**/system interop-mode m2-m3 mod /*

This command might reload module, Do you want to proceed (y/n) [no] */yes/*

Enable interop mode for module:slot-number

*__*

*>> Step 5. Allocate linecard(s) to source vdc & restore LC(s)
configuration*

*5.1) allocate M2 linecard(s) in V5 mode and new installed M3
linecard(s) to source vdc *using the command:**

*N7k-S955-2#**/conf t/*

Enter configuration commands, one per line.End with CNTL/Z.

*N7k-S955-2(config)#**/vdc /*

*N7k-S955-2(config-vdc)#**/allocate interface ethernet
/*

**

*5.2) add Interface configuration to allocated linecard(s) in source vdc
using runtime-scripts *using the command:**

*N7k-S955-2#**run-script bootflash:N7k-S955-2-Eth3-script.txt | no-more***

*or*

*N7k-S955-2#**show file bootflash:N7k-S955-2-Eth3-script.txt | vsh***

**

*5.3) save running- to startup configuration*using the command:

*N7k-S955-2#* */copy running-config startup-config vdc-all/*

*HINT !*

**

**Creating runtime-scripts - Example**

*

*Tips & Tricks:*before starting the replacement of linecards save Port
configuration of linecards in a runtime-script ! Restore interface
configuration of linecard(s) after allocation to source vdc by using
runtime scripts !

*


Hi Manfred 

 

Thanks for sharing your process for the M1 to M3 cards that is much appreciated. based upon what you were doing I have created my  process to migrate from M2 and f2 to F3 does this seem logical from your experience ?.   As M2 F2 and F3 cannot co exist same time in the VDC mine may be easier just to go straight to F3  

 

Thanks again 

 

 

PROCESS FOR CARD LINE CARD REPLACEMENT

 

Step 1

Log into admin vdc

vdc admin-vdc

copy running-config startup-config vdc-all

copy all vdc configs off the box

 

Step 2

Shut down interfaces on all line cards in production vdc  prd-cs-a

conf t

 interface xxxxx

 shut

 

Step 3

Shutdown all of the I/O module line cards from admin VDC:

poweroff module 3

poweroff module 4

poweroff module 5

 

confirm they are down

show module 3

show module 4

show module 5

 

Step 4

Purge Modules 3,4 and 5 from admin vdc

purge module 3 running-config

purge module 4 running-config

purge module 5 running-config

 

Step 5

save config from admin vdc

copy running-config startup-config vdc-all

 

Step 6

Remove F2 and M2 line card from switch and insert F3 cards

Physically remove modules  from switch

Insert new F3 lines cards into modules

Patch cables to F3

 

Step 7

no poweroff module 3

no poweroff module 4

no poweroff module 5

no poweroff module 6

 

confirm they are up

show module 3

show module 4

show module 5

show module 6

 

step 8

unallocate interfaces from  prod vdc prd-cs-a

 no allocate interface Ethernet3/1-24

no allocate interface Ethernet4/1-24

no allocate interface Ethernet5/1-48

 

Step 9

Log In admin VDC and allocate F3 resource to prod vdc prd-cs-a vdc

limit-resource module-type f3

allocate interface Ethernet 3/1-48

allocate interface Ethernet 4/1-48

allocate interface Ethernet 5/1-48

 

Step 10

Restore line card configuration to new line cards from backup text file back up – copy and paste

 

 

Hi,


as far as Module 6 belongs to another production vdc, your process steps
seem to be OK !

Be aware, that yout linecard port configurations get lost, when you
deallocate ports from your vdc.

I created runtimescripts for each linecard in order to restore the
portconfigurations after allocating them to the

production vdc.

Greetings

Manfred

Hi Manfred

 

Thanks for the feedback. Yes we are going to allocate line card 5 and 6 actually  to another vdc later on so updated step 9 to only allocate line card 3 and 4 back to the prd-cs-a vdc and we will add just move the config from line card 5 to  line card 4 manually. Line card 5 only has 3 or 4 ports configured so easy to move manually. We are happy to do manual copy and paste of all the prd-cs-a config back in for everything  as it is not a huge config file 

 

Cheers 

 

Thank again for your advise/help 

 

step 8

unallocate interfaces from  vdc prd-cs-a

no allocate interface Ethernet3/1-24

no allocate interface Ethernet4/1-24

no allocate interface Ethernet5/1-48

 

Step 9

In admin VDC allocate F3 resource to prod vdc  prd-cs-a vdc

limit-resource module-type f3

allocate interface Ethernet 3/1-32

allocate interface Ethernet 4/1-32

 

Step 10

Restore line card configuration to new line cards from backup text file back  up – copy and paste

Getting Started

Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: