ASR9006 Cluster not forming

[sajism220]

Hi,

We are trying to convert one of the asr9k pairs to cluster mode, the issue what we are facing is that the rack1 is not joing to rack 0 and rack 1
Stuck in Boot Image validation request  . We cross checked all the SFP and fiber connectvity between this ASR box and its working fine.

We are not getting any logs in rack0 while performing this activity.

the running imgae are 6.0.2

below are the logs from rack 1

=~=~=~=~=~=~=~=~=~=~=~= PuTTY log 2017.05.08 16:13:20 =~=~=~=~=~=~=~=~=~=~=~=
-qÿ1Û3onfigure baudrate to 9600
Booting Main Processor
Transferring Console
[=3h[=3h[=3hCøb9Ë)Jc ™§b)JŒá
CPU reset reason = 13 (CPU_RESET_AUTO_RESET)

##########################################################
System Bootstrap, Version 10.53 [ASR9K x86 ROMMON],
Copyright (c) 1994-2014 by Cisco Systems, Inc.
Compiled on Thu 07/21/2016 10:32:25.58

BOARD_TYPE : 0x100316
Rommon : 10.53 (Primary)
Board Revision : 4
PCH EEPROM : 3.4
IPU FPGA(PL) : 0.43.0 (Primary)
IPU INIT(HW_FPD) : 0.44.0
IPU FSBL(BOOT.BIN) : 1.83.0
IPU LINUX(IMAGE.FPD) : 1.83.0
OPTIMUS FPGA : 0.12.0
OMEGA FPGA : 0.11.0
ALPHA FPGA : 0.14.0
CHA FPGA : 0.5.1
CBC0 : Part 1=34.38, Part 2=34.38, Act Part=1
Product Number : A9K-RSP880-TR
Chassis : ASR-9006-AC-V2
Chassis Serial Number : FOX2102QGVY
Slot Number : 1
Pxe Mac Address LAN 0 : 08:96:ad:2b:5b:b0
Pxe Mac Address LAN 1 : 08:96:ad:2b:5b:b1
==========================================================
Got EMT Mode as 3
Got Boot Mode as 65535

Booting IOS-XR (32 bit Classic XR) - Press Ctrl-c to stop

Checking peer OS type.

Serial ATA Port 4 : SMART SATA SHSLM32G3BCITHD22
Serial ATA Port 5 : SMART SATA SHSLM32G3BCITHD22
USB Device 1 : VT eUSB
Other Device 1 : SMART SATA SHSLM32G3BCITHD22
Other Device 2 : SMART SATA SHSLM32G3BCITHD22 Internal EFI ShellEFI Shell version 2.31 [4096.1]
Current running mode 1.1.2
ÿ
CPU reset reason = 13 (CPU_RESET_AUTO_RESET)
Emt Mode is 3, os_type is 2
pcie link retrain on bus=2 device=2 config_reg=0x10020 after reset

##########################################################
System Bootstrap, Version 10.53 [ASR9K x86 ROMMON],
Copyright (c) 1994-2014 by Cisco Systems, Inc.
Compiled on Thu 07/21/2016 10:32:25.58

BOARD_TYPE : 0x100316
Rommon : 10.53 (Primary)
Board Revision : 4
PCH EEPROM : 3.4
IPU FPGA(PL) : 0.43.0 (Primary)
IPU INIT(HW_FPD) : 0.44.0
IPU FSBL(BOOT.BIN) : 1.83.0
IPU LINUX(IMAGE.FPD) : 1.83.0
OPTIMUS FPGA : 0.12.0
OMEGA FPGA : 0.11.0
ALPHA FPGA : 0.14.0
CHA FPGA : 0.5.1
CBC0 : Part 1=34.38, Part 2=34.38, Act Part=1
==========================================================
Device mapping table
fs0 :HardDisk - Alias hd93e0a1 blk0
PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x4,0x0,0x0)/HD(1,MBR,0x00000000,0x20,0x2FB4FE0)
fs1 :HardDisk - Alias hd93e0a2 blk1
PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x4,0x0,0x0)/HD(2,MBR,0x00000000,0x2FB5000,0x98A800)
fs2 :HardDisk - Alias hd93f0a1 blk2
PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x5,0x0,0x0)/HD(1,MBR,0x00000000,0x20,0x2FB4FE0)
fs3 :HardDisk - Alias hd93f0a2 blk3
PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x5,0x0,0x0)/HD(2,MBR,0x00000000,0x2FB5000,0x98A800)
fs4 :Removable HardDisk - Alias hd90a0a0b blk4
PciRoot(0x0)/Pci(0x1D,0x0)/USB(0x0,0x0)/USB(0x0,0x0)/HD(1,MBR,0x25914D77,0x20,0xC267E0)
fs5 :Removable HardDisk - Alias hd90a0a0c blk5
PciRoot(0x0)/Pci(0x1D,0x0)/USB(0x0,0x0)/USB(0x0,0x0)/HD(2,MBR,0x25914D77,0xC26800,0x185000)
fs6 :Removable HardDisk - Alias hd90a0a0d blk6
PciRoot(0x0)/Pci(0x1D,0x0)/USB(0x0,0x0)/USB(0x0,0x0)/HD(3,MBR,0x25914D77,0xDAB800,0x174800)
blk0 :HardDisk - Alias hd93e0a1 fs0
PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x4,0x0,0x0)/HD(1,MBR,0x00000000,0x20,0x2FB4FE0)
blk1 :HardDisk - Alias hd93e0a2 fs1
PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x4,0x0,0x0)/HD(2,MBR,0x00000000,0x2FB5000,0x98A800)
blk2 :HardDisk - Alias hd93f0a1 fs2
PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x5,0x0,0x0)/HD(1,MBR,0x00000000,0x20,0x2FB4FE0)
blk3 :HardDisk - Alias hd93f0a2 fs3
PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x5,0x0,0x0)/HD(2,MBR,0x00000000,0x2FB5000,0x98A800)
blk4 :Removable HardDisk - Alias hd90a0a0b fs4
PciRoot(0x0)/Pci(0x1D,0x0)/USB(0x0,0x0)/USB(0x0,0x0)/HD(1,MBR,0x25914D77,0x20,0xC267E0)
blk5 :Removable HardDisk - Alias hd90a0a0c fs5
PciRoot(0x0)/Pci(0x1D,0x0)/USB(0x0,0x0)/USB(0x0,0x0)/HD(2,MBR,0x25914D77,0xC26800,0x185000)
blk6 :Removable HardDisk - Alias hd90a0a0d fs6
PciRoot(0x0)/Pci(0x1D,0x0)/USB(0x0,0x0)/USB(0x0,0x0)/HD(3,MBR,0x25914D77,0xDAB800,0x174800)
blk7 :HardDisk - Alias (null)
PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x4,0x0,0x0)/HD(3,MBR,0x00000000,0x393F800,0x263000)
blk8 :HardDisk - Alias (null)
PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x5,0x0,0x0)/HD(3,MBR,0x00000000,0x393F800,0x263000)
blk9 :BlockDevice - Alias (null)
PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x4,0x0,0x0)
blkA :BlockDevice - Alias (null)
PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x5,0x0,0x0)
blkB :Removable HardDisk - Alias (null)
PciRoot(0x0)/Pci(0x1D,0x0)/USB(0x0,0x0)/USB(0x0,0x0)/HD(4,MBR,0x25914D77,0xF20000,0x10000)
blkC :Removable BlockDevice - Alias (null)
PciRoot(0x0)/Pci(0x1D,0x0)/USB(0x0,0x0)/USB(0x0,0x0)
hd93e0a1 :HardDisk - Alias fs0 blk0
PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x4,0x0,0x0)/HD(1,MBR,0x00000000,0x20,0x2FB4FE0)
hd93e0a2 :HardDisk - Alias fs1 blk1
PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x4,0x0,0x0)/HD(2,MBR,0x00000000,0x2FB5000,0x98A800)
hd93f0a1 :HardDisk - Alias fs2 blk2
PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x5,0x0,0x0)/HD(1,MBR,0x00000000,0x20,0x2FB4FE0)
hd93f0a2 :HardDisk - Alias fs3 blk3
PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x5,0x0,0x0)/HD(2,MBR,0x00000000,0x2FB5000,0x98A800)
hd90a0a0b :Removable HardDisk - Alias fs4 blk4
PciRoot(0x0)/Pci(0x1D,0x0)/USB(0x0,0x0)/USB(0x0,0x0)/HD(1,MBR,0x25914D77,0x20,0xC267E0)
hd90a0a0c :Removable HardDisk - Alias fs5 blk5
PciRoot(0x0)/Pci(0x1D,0x0)/USB(0x0,0x0)/USB(0x0,0x0)/HD(2,MBR,0x25914D77,0xC26800,0x185000)
hd90a0a0d :Removable HardDisk - Alias fs6 blk6
PciRoot(0x0)/Pci(0x1D,0x0)/USB(0x0,0x0)/USB(0x0,0x0)/HD(3,MBR,0x25914D77,0xDAB800,0x174800)
Device mapping table
disk0 :HardDisk - Alias hd93e0a1 fs0 blk0
PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x4,0x0,0x0)/HD(1,MBR,0x00000000,0x20,0x2FB4FE0)
Device mapping table
disk0a :HardDisk - Alias hd93e0a2 fs1 blk1
PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x4,0x0,0x0)/HD(2,MBR,0x00000000,0x2FB5000,0x98A800)
Device mapping table
disk1 :HardDisk - Alias hd93f0a1 fs2 blk2
PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x5,0x0,0x0)/HD(1,MBR,0x00000000,0x20,0x2FB4FE0)
Device mapping table
disk1a :HardDisk - Alias hd93f0a2 fs3 blk3
PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x5,0x0,0x0)/HD(2,MBR,0x00000000,0x2FB5000,0x98A800)
Device mapping table
harddisk :Removable HardDisk - Alias hd90a0a0b fs4 blk4
PciRoot(0x0)/Pci(0x1D,0x0)/USB(0x0,0x0)/USB(0x0,0x0)/HD(1,MBR,0x25914D77,0x20,0xC267E0)
Device mapping table
harddiska :Removable HardDisk - Alias hd90a0a0c fs5 blk5
PciRoot(0x0)/Pci(0x1D,0x0)/USB(0x0,0x0)/USB(0x0,0x0)/HD(2,MBR,0x25914D77,0xC26800,0x185000)
Device mapping table
harddiskb :Removable HardDisk - Alias hd90a0a0d fs6 blk6
PciRoot(0x0)/Pci(0x1D,0x0)/USB(0x0,0x0)/USB(0x0,0x0)/HD(3,MBR,0x25914D77,0xDAB800,0x174800)
map: Invalid argument - 'fs7:'
map: Invalid argument - 'fs7:'
SPI Flash: NumonyxN25Q128
Memory Size: 16384 MB
MAC Address from cookie: 08:96:ad:2b:5b:b0
Board Type: 0x00100316
Chassis Type: 0x00ef02fb
Slot Number: 01
Chassis Serial: FOX2102QGVY
Cbc uart base address = 3e8

Sending Chassis type 0xef02fb to IPU
In cbc_get_rommon_fast_bootstatus 2042394400
mbi_boot_smart_reload() - Fastboot status is zero
Sending Boot Image validation request.
HIT CTRL-C to abort
The value of autoc is 0xc09c2205
The value of autoc is 0xc09c2205
Interface link changed state to UP.
Interface link state up.
................Boot Image validation: Boot response retry
In cbc_get_rommon_fast_bootstatus 2042394400
mbi_boot_smart_reload() - Fastboot status is zero
Sending Boot Image validation request.
HIT CTRL-C to abort
Interface link changed state to UP.
Interface link state up.
................Boot Image validation: Boot response retry
In cbc_get_rommon_fast_bootstatus 2042394400
mbi_boot_smart_reload() - Fastboot status is zero
Sending Boot Image validation request.
HIT CTRL-C to abort
Interface link changed state to UP.
Interface link state up.
................Boot Image validation: Boot response retry
In cbc_get_rommon_fast_bootstatus 2042394400
mbi_boot_smart_reload() - Fastboot status is zero
Sending Boot Image validation request.
HIT CTRL-C to abort
Interface link changed state to UP.
Interface link state up.
................Boot Image validation: Boot response retry
In cbc_get_rommon_fast_bootstatus 2042394400
mbi_boot_smart_reload() - Fastboot status is zero
Sending Boot Image validation request.
HIT CTRL-C to abort
Interface link changed state to UP.
Interface link state up.
......

can any one help on this

[sajism220]

We followed this step

http://www.cisco.com/c/en/us/support/docs/routers/asr-9000-series-aggregation-services-routers/117642-configure-asr-00.html#anc22

[Eddie Chami]

Hi,

A9K-RSP880-TR does not support nv cluster. Only the RSP440 does(and the last release was 5.3.4), you need to look at how to achieving the same desired outcomes with MCLag, BVI or VPLS/EVPN technology.

Regards

Eddie. 

[sajism220]

Can RSP880-SE with 400G limited card support cluster ?

My scenario is with direcly connected fiber between rack0 and rack1 with RSP880-TR

is it in roadmap or do we need to follow this to achive clustor ?

" you need to look at how to achieving the same desired outcomes with MCLag, BVI or VPLS/EVPN technology."

[Eddie Chami]

There is no plans to support cluster on RSP880. You'll have to look at using the systems in standalone mode and mclag or such technology to achieve the same outcome for that service thats being provisioned.

Eddie.

[sajism220]

Could you please add more information on how we can create the clustoer in this case with RSP880-TR mclag or such technology

Any documentation would highly appreciative.

They why Cisco is adding cluster license along with this RSP880-TR and SE card ?

[Eddie Chami]

Its not possible to create an NV cluster with RSP880, you will have to bring up the two systems as standalone chassis, and configure MCLag between them. Take a look at this mclag guide: https://supportforums.cisco.com/document/9868751/asr9000xr-multichassis-lag-or-mc-lag-mclag-guide

[sajism220]

Thanks for the input,

Is there any documentation mentioning this cluster support issue on RSP880 with direct fiber.

I am not able to find anywhere

[sajism220]

Dear Eddie,

Just wanted to input some more clarification from you as i need plan for re-design the network

It cannot be that 880 will not support nvcluster as it’s the new model out and there is license also for the same. Point is whether clustering can happen directly or the MCLag, BVI, VPLS is a mandatory pre-requisite for nvclustering.

Is this ONLY for TR card ? Is the same applicable to SE card also ??

[Eddie Chami]

NV Cluster is NOT supported on any of the RSP880 versions and you can not purchase a license for it, so there has been some miscommunications on this with your sales rep, its best if you contact me offline with your email address and we can sort this out offline. 

Your future design can not include clustering. 

Regards

Eddie.

[sajism220]

Thanks appreciate you prompt response

So if we want to go with clustering on ASR 9K what is the option ??? any options are avaiable with any ASR9K platforms

[Eddie Chami · Accepted solution]

Your only option is RSP440 + Typhoon Linecards on 5.3.4, but we are advocating that customers move away from NV Cluster technology to standards based MClag or VPLS to provide the same redundancy.