Re: N540-FH-AGG-SYS 10G interface problem

MARTIN HUERTER · ‎02-09-2022

I have two brand new N540-FH-AGG-SYS routers. Configured them with a Call-home profile, it communicates the our Cisco Smart License portal and registers the "N540-Front Haul Aggregation Router Tracking PID in Routers" licenses, one for each to the routers. We have purchased a Qty of 80 "Access Essentials SIA per 10G in Routers" and "Access Essentials SW Right-to-Use v1.0 per 10G in Routers" licenses. However when I configure a TenGigE port they do not show up in the "interface brief" command or the "show run interface TenGigE0/0/01" command. They are present when I do a show run, but they are in the "preconfigured" mode. I've plugged a live 10G connection to it, but the interfaces on the N540 never come up. I've had a TAC case open on this problem for 2 weeks now and they can't even figure it out. We've tried everything, but everything seems to be configured as it should. Both of our N540 routers are in the exact same state. So I am reaching out to the community to see if anyone else has experience with the N540 AGG platform and what is needed to get the 10G interfaces to function. It seems like there is some sort of configuration that needs to be applied to get them to come up.

interface preconfigure TenGigE0/0/0/1
description TenGigE0/0/0/1
ipv4 address 1.1.1.1 255.255.255.0

decode.chr13 · ‎02-09-2022

Hi,

It seems that in all NCS family is the same.

I personally don't see any inconveniences in this behaviour because unused interfaces must be in shutdown and the used one are configured. So in any case there will be some config on each interface.

If you don't want the unused ones in shutdown, just add some config, like description or load-interval or cdp.

BR

Fredrik Lonnman · ‎02-10-2022

While I don't have experience with that exact model if 540, other models of 540 and related 5500 family requires 25G ports to be reconfigured as 10G ports in quads, see https://www.cisco.com/c/en/us/td/docs/iosxr/ncs5xx/hardware/installation/guide/b-ncs540-hig/b-ncs540-hig_chapter_0111.html#Cisco_Concept.dita_5f5cb0d8-730c-4458-b948-d827d9dc81ef

Since all the 10G ports in your specific model also is 25G capable, and they do not show up in the configuration as TenGigE ports, I'm guessing they are all configured as TwentyFiveGigE per default (abbreviated TF in show interface brief) and needs to be reconfigured to 1/10G mode via the hw-module quad command linked above.

MARTIN HUERTER · ‎02-10-2022

From the documentation you referenced it states to run

RP/0/RP0/CPU0:router(config)# hw-module quad X location 0/0/CPU0

RP/0/RP0/CPU0:router(config-quad-0x0)# mode 10g

After I run these commands and attempt to commit the configuration it fails.

hw-module quad 0 location 0/RP0/CPU0
mode 10g
!!% 'CfgMgr' detected the 'fatal' condition 'This configuration has not been verified and can not be accepted by the system.'

As you can see this platform has 24 ports 25G/10F/TSN plus 4 ports 100G. I have configured TenGigE0/0/0/1 with an ipv4 address and description. If I do "show running interface TenGigE0/0/01" it says no such configuration. However is I do "show run interface" it show up. If I do a "show interface brief" I only see the Mgmt and 100G interfaces.

Cisco NCS 540 FH System with 24xCPRI/25G/10G/TSN+4x100G

RP/0/RP0/CPU0:border-router-01#sho run int TenGigE0/0/0/1
Thu Feb 10 06:23:29.049 UTC
% No such configuration item(s)

RP/0/RP0/CPU0:border-router-01#show run interface
Thu Feb 10 06:18:26.581 UTC
interface MgmtEth0/RP0/CPU0/0
description border-router-01_mgmt
vrf Mgmt-vrf
ipv4 address 10.59.5.20 255.255.255.0
!
interface HundredGigE0/0/0/24
shutdown
!
interface HundredGigE0/0/0/25
shutdown
!
interface HundredGigE0/0/0/26
shutdown
!
interface HundredGigE0/0/0/27
shutdown
!
interface preconfigure TenGigE0/0/0/0
loopback internal
!
interface preconfigure TenGigE0/0/0/1
description TenGigE0/0/0/1
ipv4 address 1.1.1.1 255.255.255.0

RP/0/RP0/CPU0:border-router-01#show interface brief
Thu Feb 10 06:17:46.198 UTC

Intf Intf LineP Encap MTU BW
Name State State Type (byte) (Kbps)
--------------------------------------------------------------------------------
Nu0 up up Null 1500 0
Mg0/RP0/CPU0/0 up up ARPA 1514 1000000
Hu0/0/0/24 admin-down admin-down ARPA 1514 100000000
Hu0/0/0/25 admin-down admin-down ARPA 1514 100000000
Hu0/0/0/26 admin-down admin-down ARPA 1514 100000000
Hu0/0/0/27 admin-down admin-down ARPA 1514 100000000

Fredrik Lonnman · ‎02-10-2022

Ok so you're missing all the ports except for the HundredGigE ports, then I would believe this is either HW fault or bug. You should have 24x TwentyFiveGigE ports in the show run interface and show interface brief commands as well, before you even start to look at commands to enable them for 10G if needed.

When you configure an interface and they become "preconfigure" means that the interface you tried to configure does not exist.

MARTIN HUERTER · ‎02-10-2022

Both of my N540 routers have the exact same problem, so hardware isn't likely, but a bug maybe the problem. Cisco TAC has been working on this for two weeks and they can't come to a conclusion as to what the problem could be. Beginning to wonder if I shouldn't box them up and send them back.

Fredrik Lonnman · ‎02-10-2022

Yeah bug maybe. Having not worked with this device, I was thinking if there are some kind of "CPRI" mode, where all ports are configured as CPRI ports instead of Ethernet ports, maybe here are some other hw-module command to toggle CPRI/Ethernet modes?

schwamjohnson · ‎08-09-2022

Anyone find a solution to this? Running into the same issue with only the 100G interfaces showing up.

Stumbled upon this command but they still don't show up.

hw-module dpfpga 1 location 0/RP0/CPU0
mode ethernet

nkarpysh · ‎08-09-2022

Can you pls check if this command help to resolve it:

hw-module dpfpga 0 location 0/0/CPU0
mode ethernet
!
controller Optics0/0/0/0
port-mode Ethernet framing packet rate
10GE


OR
controller Optics0/0/0/0
port-mode Ethernet framing cem-packetize rate 1GE/10GE

More details on:

https://www.cisco.com/c/en/us/td/docs/iosxr/ncs5500/interfaces/b-ncs5500-interfaces-cli-reference/b-ncs5500-interfaces-cli-reference_chapter_01000.html

HTH
Niko

HTH,
Niko

schwamjohnson · ‎08-10-2022

The top two commands fixed the issue. I can now see the interface when I do a "show int brief" as well as see it in the running config. Thanks Niko. I have been working with TAC for a month and they were wanting to RMA the boxes until I noticed the issue on all 4 of our new 540s. Appreciate you!

MARTIN HUERTER · ‎08-10-2022

Yes I was able to resolve the problem. The configuration below was missing on the controller in order to define the optics. Once I put this configuration in place, the 10G ports started showing up. You need to add the configuration for each 10G port in order to enable all of them.

Hope this helps!

controller Optics0/0/0/1
port-mode Ethernet framing packet rate 10GE