Re: Pseudowire Headend support on ASR 9001

decode.chr13 · ‎12-26-2017

[I copied this from MPLS Board, because I didn't know how to move it.]

Do you know if PWHE is supported on ASR 9001 platform?

Documentation says that PWHE is supported on Typhoon linecard, Service Edge optimized.
ASR 9001 is Typhoon linecard, but I don't know if it is also SE optimized.

I have the following diagram:

CPE01 ----- PE01 ---(te0/0/2/1)-- ASR9001
|
PE02 ---- CPE02

I configured 2 PWHE on ASR9001 and everything is ok, except the fact that the traffic does not pass thru the router.

l2vpn
router-id 10.20.99.1
!
pw-class pwhe-class
encapsulation mpls

control-word
ipv4 source 10.20.99.1
!
xconnect group test-pwhe
p2p segment-01
interface PW-Ether1202
neighbor ipv4 10.20.72.1 pw-id 201202
pw-class pwhe-class
!
description segment-01
!
xconnect group test-pwhe
p2p segment-02
interface PW-Ether1001
neighbor ipv4 10.20.99.11 pw-id 1001
pw-class pwhe-class
!
description segment-02
!
!
interface PW-Ether1202
mtu 9114
load-interval 30
attach generic-interface-list gil-20
l2overhead 20
!
interface PW-Ether1202.24
vrf test
ipv4 address 10.9.1.1 255.255.255.252
load-interval 30
encapsulation dot1q 1202 second-dot1q 24
!
interface PW-Ether1001
vrf test
ipv4 address 10.1.1.1 255.255.255.252
load-interval 30
mtu 9114
load-interval 30
attach generic-interface-list gil-20
l2overhead 20
!
generic-interface-list gil-20
interface TenGigE0/0/2/1
end

ASR9001 must be a service edge node, terminating L3 services.

This works:
1) CPE01 pings ASR9001
2) CPE02 pings ASR9001

This doesn't work: CPE01 pings CPE02.

I tried to configure the same setup with VFI and routed BVI interface and everything works as expected.

Thank you

[EDIT]

Found this link:

https://www.cisco.com/c/en/us/support/docs/routers/asr-9000-series-aggregation-services-routers/200135-Aggregation-Services-Router-9001-ASR-90.html

Q. What is the Architecture and Performance of ASR-9001?

The ASR-9001 system is built around the same forwarding engine and switch fabric complex as the other ASR-9000 linecards and systems. Most importantly, this means that the system will have identical feature support as the other platforms in ASR-9000 series devices. The Network Processors (NPs) and memories are sized to be equivalent to the Services Edge ("SE") linecards, so all of the ports (both fixed and via MPA) on the system are capable of full Hierarchical Quality of Service (H-QoS) and other SE features.

xr-escalation · ‎12-26-2017

ASR9001 is the equivalent of MOD80-SE line card.

If the only thing that doesn't work is a ping between the CPE01 and CPE02, I would suggest to check the routing on both of these to confirm they have asr9001 as the next hop. If that's ok, run continuous ping with interval 1 and check the NP counters for any drops.

/Aleksandar

decode.chr13 · ‎12-27-2017

Hi Aleksandar,

Thank you for reply.

Checked the routes and they are ok.

ASR9001
---------
interface PW-Ether1202.24
vrf test
ipv4 address 10.9.1.1 255.255.255.252
!
interface PW-Ether1001
vrf test
ipv4 address 10.1.1.1 255.255.255.252
!
router static
vrf test
address-family ipv4 unicast
0.0.0.0/0 10.1.1.2
10.4.9.0/24 10.9.1.2

CPE01
---------
interface GigabitEthernet0/0.24
encapsulation dot1Q 24
ip address 10.9.1.2 255.255.255.252
!
interface Loopback10
ip address 10.4.9.10 255.255.255.255
!
ip route 10.1.0.0 255.255.0.0 10.9.1.1

CPE02
---------
interface BDI1001
ip address 10.1.1.2 255.255.255.252
!
interface Loopback10
ip address 10.1.1.10 255.255.255.255
!
ip route 10.4.9.0 255.255.255.0 10.1.1.1

Checked NP counters for drops and I have drops. I don't know why... :-(

ASR9001 - NP drops
-----------------------

#show controller np counters np0 location 0/0/CPU0 | i DROP
Offset Counter FrameValue Rate (pps)
-------------------------------------------------------------------------------
100 RSV_DROP_EGR_HWOFF_NO_MATCH 51038478 159870
138 RSV_DROP_MPLS_RXADJ_DROP 75 1

#sh controllers np descriptions location 0/0/CPU0 | i RSV_DROP_EGR_HWOFF_NO_MATCH
RSV_DROP_EGR_HWOFF_NO_MATCH Drop Infra Frames dropped due to inconsistent software state which may occur during reprogramming

#sh controllers np descriptions location 0/0/CPU0 | i RSV_DROP_MPLS_RXADJ_DROP
RSV_DROP_MPLS_RXADJ_DROP Drop L3 dropped due to Rx-Adjacency set to drop all packets for this route. (TBD: why would this happen?)

Thanks

decode.chr13 · ‎12-27-2017

Done some more monitoring and the NP counter that is reacting is:

138 RSV_DROP_MPLS_RXADJ_DROP

explanation:

Drop L3 - dropped due to Rx-Adjacency set to drop all packets for this route. (TBD: why would this happen?)

#show drops location 0/0/CPU0

Node: 0/0/CPU0:

----------------------------------------------------------------

NP 0 Drops:

----------------------------------------------------------------

RSV_DROP_EGR_HWOFF_NO_MATCH 254998176

RSV_DROP_MPLS_RXADJ_DROP 11112

UNKNOWN_L2_ON_L3_DISCARD 3

----------------------------------------------------------------

No NP 1 Drops

----------------------------------------------------------------

FIA 0 Drops:

----------------------------------------------------------------

Total drop: 8

Ingress drop: 8

Ingress sp0 align fail 3

Ingress sp1 crc err 2

Ingress sp1 align fail 3

----------------------------------------------------------------

FIA 1 Drops:

----------------------------------------------------------------

Total drop: 16

Ingress drop: 16

Ingress sp0 crc err 5

Ingress sp0 bad code 5

Ingress sp0 align fail 3

Ingress sp1 align fail 3

----------------------------------------------------------------

xr-escalation · ‎12-27-2017

Which release are you using? Our recommendation for 2018 is 6.1.4 or 6.2.3. Please see https://supportforums.cisco.com/t5/service-providers-documents/ios-xr-release-strategy-and-deployment-recommendation/ta-p/3165422

"sh controllers np capture" will show the dump of the last 32 dropped packets. This will help confirm whether RSV_DROP_EGR_HWOFF_NO_MATCH is really related to pings. A full output of np counters during the ping would also help, as well as the "show cef hardware ...". As the output will be long, please attach the outputs instead of pasting in the body of the message.

We are in a year-end shutdown mode, so further response may come with a delay. I wish you a happy new year!!

/Aleksandar

decode.chr13 · ‎12-27-2017

I'm using 6.1.4 release.
#show ver
Cisco IOS XR Software, Version 6.1.4[Default]

Attached the output of sh controllers np capture and show cef vrf test hardware ingress/egress...

No worries about the delay.

I wish you a happy new year and great party!

/CR

decode.chr13 · ‎12-28-2017

After some show commands, I found out following:

#sh mpls forwarding location 0/0/CPU0

24025 1044 PW-HE(PE1202) 10.20.72.1 566652

24026 Unlabelled PW(10.20.99.11:1001) \

PE1001 PW-HE-Disp 0

24028 Unlabelled PW(10.20.72.1:2000011202) \

PE1202 PW-HE-Disp 0

24029 43 PW-HE(PE1001) 10.20.99.11 92

#show cef vrf test summary

7 next hops

4 incomplete next hops

#show cef vrf dia adjacency pe1001 detail location 0/0/CPU0

PE1001 Prefix: 0.0.0.0/32 local 2

no next-hop adj

Interface: NULLIFHNDL

NHID: 0x0

Mac-length is 0

incomplete

Interface Type: 0x52, Base Flags: 0x8 (0x84a24978)

Nhinfo PT: 0x84a24978, Idb PT: 0x81bed34c, If Handle: 0x2e0

Dependent adj type: remote (0x84a95df8)

Dependent adj intf: PE1001

Ancestor If Handle: 0x0

#show controllers np counters np0 location 0/0/CPU0 | i DROP

138 RSV_DROP_MPLS_RXADJ_DROP 11 0

1099 DROP_FRM_FRM_ERR_NULL14 1 0

#monitor np counter RSV_DROP_MPLS_RXADJ_DROP np0 location 0/0/CPU0

From TenGigE0/0/2/1: 132 byte packet, bytes[0-3] invalid!

0000: 50 87 89 19 64 29 f0 29 29 9b 44 c0 81 00 00 28 P...d)p)).D@...(

0010: 88 47 05 dd c1 ff 00 00 00 00 50 87 89 1e 2c d6 .G.]A.....P...,V

0020: c8 9c 1d b9 6a 00 11 00 04 b2 81 00 02 00 00 00 H..9j....2......

0030: 45 00 00 54 0c 8e 00 00 3e 01 51 fa 0a 04 09 13 E..T....>.Qz....

0040: 0a 01 01 0a 08 00 78 4c 83 c4 00 00 5a 44 a4 8b ......xL.D..ZD$.

0050: 00 03 12 19 08 09 0a 0b 0c 0d 0e 0f 10 11 12 13 ................

0060: 14 15 16 17 18 19 1a 1b 1c 1d 1e 1f 20 21 22 23 ............ !"#

0070: 24 25 26 27 28 29 2a 2b 2c 2d 2e 2f 30 31 32 33 $%&'()*+,-./0123

0080: 00 00 00 00 ....

I have no more ideas where to look...

Aleksandar Vidakovic · ‎12-28-2017

Can you collect these:

show cef vrf test 10.1.1.2 hardware ingress detail location 0/0/CPU0

show cef vrf test 10.9.1.2 hardware ingress detail location 0/0/CPU0

show l2vpn xconnect interface PW-Ether1001 detail

show l2vpn xconnect interface PW-Ether1202 detail

show mpls forwarding labels <local_label_of_PW-Ether1001> hardware ingress detail location 0/0/CPU0

show mpls forwarding labels <local_label_of_PW-Ether1202> hardware ingress detail location 0/0/CPU0

... and attach to the discussion?

decode.chr13 · ‎12-28-2017

This is a very long output.

At the bottom of attachment I included also the sh run l2vpn and sh run interface pw-ether configs.

decode.chr13 · ‎12-28-2017

I have upgraded to 6.2.3, but still no luck.

xr-escalation · ‎12-28-2017

I don’t see what’s wrong. I’d have to try this in my lab. During the year-end shutdown our labs are powered off, to reduce the impact on environment. I’ll try out this same configuration in the lab and get back to you. Apologies for the delay.
In the meantime I can only wish you a Happy New Year!

/Aleksandar

decode.chr13 · ‎12-29-2017

Thanks Aleks.

I wish you Happy New and Peaceful Year and a good party :-)

For your lab, maybe it would help to mention that PE1 is ME3600X and PE2 is ASR1002.

decode.chr13 · ‎12-28-2017

Below the admin show run. I don't know if it helps...

#admin show running-config

Thu Dec 28 11:12:34.809 UTC

Building configuration...

!! IOS XR Admin Configuration 6.1.4

!

hw-module profile package services

hw-module profile scale l3xl

hw-module vrf scale extended

hw-module bfd-hw-offload enable location 0/0/CPU0

end