Solved: XRv 9000 IPoE BNG

manoj.karmacharya · ‎08-19-2018

subscribers cannot ping to default-router, though subscriber connected properly Setup was done with VMware ESXi 6.5.

Aleksandar Vidakovic · ‎08-21-2018

Thanks for clarifying. BNG feature parity between asr9k and xrv9k is should be achieved next year, in one of the 7.x upcoming releases. If your deployment model of xrv9k BNG requires ambiguous mode, please reach out to your account team at Cisco and let's work towards a resolution.

View solution in original post

Aleksandar Vidakovic · ‎08-20-2018

You need to check whether the vBNG doesn't send the ICMP echo request properly or the CPE doesn't reply properly. Check the route and CEF entry for the subscriber's IPv4 address. Run 1000 pings with timeout zero and check the interface counters to see whether packets are sent/received. You probably need to do some troubleshooting on CPE as well.

Btw, you should also send the "default-router" from your DHCP server profile.

/Aleksandar

manoj.karmacharya · ‎08-20-2018

Added "default-router" option in dhcp profile and sent 1000 packet with timeout 0. Result is negative. Didn't find any increment in interface counter.

RP/0/RP0/CPU0:vBNG#show subscriber session all

Tue Aug 21 10:13:07.033 UTC

Codes: IN - Initialize, CN - Connecting, CD - Connected, AC - Activated,

ID - Idle, DN - Disconnecting, ED - End

Type Interface State Subscriber IP Addr / Prefix

LNS Address (Vrf)

--------------------------------------------------------------------------------

IP:DHCP Gi0/0/0/1.ip1591 AC 10.10.37.42 (default)

IP:DHCP Gi0/0/0/1.ip1590 AC 10.10.37.41 (default)

RP/0/RP0/CPU0:vBNG#show interfaces GigabitEthernet 0/0/0/1.ip1590

Tue Aug 21 10:13:27.474 UTC

GigabitEthernet0/0/0/1.ip1590 is up, line protocol is up

Interface state transitions: 1

Hardware is IP Subscriber interface(s), address is 000c.2929.5e21

Internet address is 10.10.37.1/24

MTU 1500 bytes, BW 1000000 Kbit (Max: 1000000 Kbit)

reliability 255/255, txload 0/255, rxload 0/255

Encapsulation Ipsub_base, loopback not set,

Last link flapped 00:04:21

ARP learning is disabled

Last input 00:00:00, output never

Last clearing of "show interface" counters never

244 packets input, 15661 bytes

0 input drops, 0 queue drops, 0 input errors

0 drops for unrecognized upper-level protocol

0 packets output, 0 bytes

0 output drops, 0 queue drops, 0 output errors

RP/0/RP0/CPU0:vBNG#show interfaces GigabitEthernet 0/0/0/1

Tue Aug 21 10:13:37.133 UTC

GigabitEthernet0/0/0/1 is up, line protocol is up

Interface state transitions: 1

Hardware is GigabitEthernet, address is 000c.2929.5e21 (bia 000c.2929.5e21)

Internet address is 10.10.37.1/24

MTU 1514 bytes, BW 1000000 Kbit (Max: 1000000 Kbit)

reliability 255/255, txload 0/255, rxload 0/255

Encapsulation ARPA,

Duplex unknown, 1000Mb/s, link type is force-up

output flow control is off, input flow control is off

loopback not set,

Last link flapped 3d22h

ARP learning is disabled

Last input 00:00:00, output 00:00:11

Last clearing of "show interface" counters never

5 minute input rate 0 bits/sec, 1 packets/sec

5 minute output rate 0 bits/sec, 0 packets/sec

134989 packets input, 18720483 bytes, 42 total input drops

0 drops for unrecognized upper-level protocol

Received 5333 broadcast packets, 0 multicast packets

0 runts, 0 giants, 0 throttles, 0 parity

0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort

10236 packets output, 3510055 bytes, 0 total output drops

Output 4465 broadcast packets, 0 multicast packets

0 output errors, 0 underruns, 0 applique, 0 resets

0 output buffer failures, 0 output buffers swapped out

0 carrier transitions

RP/0/RP0/CPU0:vBNG#show route | i A

Tue Aug 21 10:13:42.419 UTC

D - EIGRP, EX - EIGRP external, O - OSPF, IA - OSPF inter area

N1 - OSPF NSSA external type 1, N2 - OSPF NSSA external type 2

U - per-user static route, o - ODR, L - local, G - DAGR, l - LISP

A - access/subscriber, a - Application route

A 10.10.37.41/32 is directly connected, 00:04:36, GigabitEthernet0/0/0/1.ip1590

A 10.10.37.42/32 is directly connected, 00:00:40, GigabitEthernet0/0/0/1.ip1591

RP/0/RP0/CPU0:vBNG#ping 10.10.37.41 repeat 1000 timeout 0

Tue Aug 21 10:13:54.134 UTC

pings with timeout=0 may result in system instability and

control protocol flaps resulting in traffic impact.

Do you really want to continue[confirm with only 'y' or 'n'] [y/n] :y

Type escape sequence to abort.

Sending 1000, 100-byte ICMP Echos to 10.10.37.41, timeout is 0 seconds:

......................................................................

....................

Success rate is 0 percent (0/1000)

RP/0/RP0/CPU0:vBNG#show configuration running-config dhcp ipv4

Tue Aug 21 10:14:19.270 UTC

dhcp ipv4

profile DHCP-SERVER server

lease 0 0 10

pool IPv4-POOL-01

dns-server 192.168.6.60

default-router 10.10.37.1

!

interface GigabitEthernet0/0/0/1 server profile DHCP-SERVER

!

RP/0/RP0/CPU0:vBNG#show interfaces GigabitEthernet 0/0/0/1.ip1590

Tue Aug 21 10:14:54.373 UTC

GigabitEthernet0/0/0/1.ip1590 is up, line protocol is up

Interface state transitions: 1

Hardware is IP Subscriber interface(s), address is 000c.2929.5e21

Internet address is 10.10.37.1/24

MTU 1500 bytes, BW 1000000 Kbit (Max: 1000000 Kbit)

reliability 255/255, txload 0/255, rxload 0/255

Encapsulation Ipsub_base, loopback not set,

Last link flapped 00:05:48

ARP learning is disabled

Last input 00:00:00, output never

Last clearing of "show interface" counters never

318 packets input, 20101 bytes

0 input drops, 0 queue drops, 0 input errors

0 drops for unrecognized upper-level protocol

0 packets output, 0 bytes

0 output drops, 0 queue drops, 0 output errors

RP/0/RP0/CPU0:vBNG#show interfaces GigabitEthernet 0/0/0/1

Tue Aug 21 10:15:06.895 UTC

GigabitEthernet0/0/0/1 is up, line protocol is up

Interface state transitions: 1

Hardware is GigabitEthernet, address is 000c.2929.5e21 (bia 000c.2929.5e21)

Internet address is 10.10.37.1/24

MTU 1514 bytes, BW 1000000 Kbit (Max: 1000000 Kbit)

reliability 255/255, txload 0/255, rxload 0/255

Encapsulation ARPA,

Duplex unknown, 1000Mb/s, link type is force-up

output flow control is off, input flow control is off

loopback not set,

Last link flapped 3d22h

ARP learning is disabled

Last input 00:00:00, output 00:01:41

Last clearing of "show interface" counters never

5 minute input rate 0 bits/sec, 1 packets/sec

5 minute output rate 0 bits/sec, 0 packets/sec

135079 packets input, 18726243 bytes, 42 total input drops

0 drops for unrecognized upper-level protocol

Received 5333 broadcast packets, 0 multicast packets

0 runts, 0 giants, 0 throttles, 0 parity

0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort

10236 packets output, 3510055 bytes, 0 total output drops

Output 4465 broadcast packets, 0 multicast packets

0 output errors, 0 underruns, 0 applique, 0 resets

0 output buffer failures, 0 output buffers swapped out

0 carrier transitions

With following configuration can ping to CPE

RP/0/RP0/CPU0:vBNG#show configuration running-config dhcp ipv4

Tue Aug 21 10:14:19.270 UTC

dhcp ipv4

profile DHCP-SERVER server

lease 0 0 10

pool IPv4-POOL-01

dns-server 192.168.6.60

!

interface GigabitEthernet0/0/0/1 server profile DHCP-SERVER

RP/0/RP0/CPU0:vBNG#show configuration running-config pool

Tue Aug 21 10:18:47.798 UTC

pool vrf default ipv4 IPv4-POOL-01

network 10.10.37.0/24 default-router 10.10.37.1

RP/0/RP0/CPU0:vBNG#show configuration running-config interface GigabitEthernet 0/0/0/1

Tue Aug 21 10:19:14.378 UTC

interface GigabitEthernet0/0/0/1

ipv4 address 10.10.37.1/24

Aleksandar Vidakovic · ‎08-21-2018

Can I ask you to do one thing: main physical interface as BNG subscriber access interface is a fairly new thing. I'm not sure whether it's officially supported on XRv9000. Can you try using a sub-interface instead of a main interface for subscriber access and let us know the outcome?

And also get the "show route x.x.x.x", "show cef x.x.x.x detail" and "show cef x.x.x.x internal".

/Aleksandar

manoj.karmacharya · ‎08-21-2018

Changing access interface from main interface to sub interface worked. Also "encapsulation ambiguous dot1q" wasn't applicable. Couldn't debug outputs of "show route, show cef, show cef internal". Outputs are as follows

Before:

--------------

RP/0/RP0/CPU0:vBNG#show subscriber session all

Tue Aug 21 13:58:25.616 UTC

Codes: IN - Initialize, CN - Connecting, CD - Connected, AC - Activated,

ID - Idle, DN - Disconnecting, ED - End

Type Interface State Subscriber IP Addr / Prefix

LNS Address (Vrf)

--------------------------------------------------------------------------------

IP:DHCP Gi0/0/0/1.ip1650 AC 10.10.37.2 (default)

IP:DHCP Gi0/0/0/1.ip1649 AC 10.10.37.1 (default)

RP/0/RP0/CPU0:vBNG#show route 10.10.37.2

Tue Aug 21 13:58:37.030 UTC

Routing entry for 10.10.37.2/32

Known via "subscriber IPSUB_SUBSCR", distance 2, metric 0 (connected)

Installed Aug 21 13:54:22.049 for 00:04:15

Routing Descriptor Blocks

directly connected, via GigabitEthernet0/0/0/1.ip1650

Route metric is 0

No advertising protos.

RP/0/RP0/CPU0:vBNG#show route 10.10.37.0

Tue Aug 21 13:58:38.996 UTC

Routing entry for 10.10.37.0/24

Known via "connected", distance 0, metric 0 (connected)

Installed Aug 21 12:13:42.672 for 01:44:56

Routing Descriptor Blocks

directly connected, via Loopback1

Route metric is 0

No advertising protos.

RP/0/RP0/CPU0:vBNG#show route 10.10.37.1

Tue Aug 21 13:58:41.992 UTC

Routing entry for 10.10.37.1/32

Known via "subscriber IPSUB_SUBSCR", distance 2, metric 0 (connected)

Installed Aug 21 13:51:39.276 for 00:07:02

Routing Descriptor Blocks

directly connected, via GigabitEthernet0/0/0/1.ip1649

Route metric is 0

No advertising protos.

RP/0/RP0/CPU0:vBNG#show cef 10.10.37.1

Tue Aug 21 13:58:56.414 UTC

10.10.37.1/32, version 3547, attached, subscriber, internal 0x1000041 0x0 (ptr 0xd5d2e98) [1], 0x0 (0xd795be8), 0x0 (0x0)

Updated Aug 21 13:51:39.278

remote adjacency to GigabitEthernet0/0/0/1

Prefix Len 32, traffic index 0, precedence n/a, priority 3

via GigabitEthernet0/0/0/1.ip1649, 2 dependencies, weight 0, class 0 [flags 0x8]

path-idx 0 NHID 0x0 [0xe6b0140 0x0]

remote adjacency

RP/0/RP0/CPU0:vBNG#show cef 10.10.37.1 internal

Tue Aug 21 13:59:01.963 UTC

IPv4:default:0xe0000000[0x10c8e63b8]:rib:10.10.37.1/32[ref:1 proto:ipv4 flags:0x1000041 f2:0x0 src:rib][0x10d5d2e98]

LDI => [ref:3 pl:0x10d5fc9b8 proto:ipv4 type:ip lvl:1 buckets:1 slots:1 fixup:0 flags:[owner locked, added to pl, depth changed, subscriber]][0x10d6af380]

slots:

{0,p0,s0}={

NHINFO => [type:rx, linkt:link_IPv4, nh_proto:IPv4, ifh:GigabitEthernet0_0_0_1(0x1000048), adj:0x10d46d018, flags:[pd bind pending]][0x10e6b0140]

IDB => [ref:1 ifh:0x1 type:0/none parent-type:0/none flags:[owner locked,remote,p2p][0x10c5dc2f0]

IDB_EXT:{MPLS IPv4:NULL,IPv4:[ref:1 IPv4:default[0x10c8e63b8] NH:2 MTU:1500 flags:[none][0x10e5f6170]],MPLS IPv6:NULL,IPv6:NULL}

}

buckets:

{0,p0,s0}={[0x10e6b0140]}

LDI_LW => [type:ip loadinfo:[0x10d6af380]][0x10d795be8]

PATHLIST => [ref:2 count:1 depth:1 ldi:0x10d6af380 type:Shared flags:[subscriber] extn_flags:[]][0x10d5fc9b8]

0={

[[nh:0.0.0.0 ifh:GigabitEthernet0_0_0_1(0x1000048) tbl:0xe0000000 type:ip flags:[attached]]

[depth:1 flags:[resolved,ldi-preferred] resolves-via: ###

NHINFO => [type:rx, linkt:link_IPv4, nh_proto:IPv4, ifh:GigabitEthernet0_0_0_1(0x1000048), adj:0x10d46d018, flags:[pd bind pending]][0x10e6b0140]

IDB => [ref:1 ifh:0x1 type:0/none parent-type:0/none flags:[owner locked,remote,p2p][0x10c5dc2f0]

IDB_EXT:{MPLS IPv4:NULL,IPv4:[ref:1 IPv4:default[0x10c8e63b8] NH:2 MTU:1500 flags:[none][0x10e5f6170]],MPLS IPv6:NULL,IPv6:NULL} ###]}

After:

---------------------------

RP/0/RP0/CPU0:vBNG#show subscriber session all

Tue Aug 21 14:13:49.907 UTC

Codes: IN - Initialize, CN - Connecting, CD - Connected, AC - Activated,

ID - Idle, DN - Disconnecting, ED - End

Type Interface State Subscriber IP Addr / Prefix

LNS Address (Vrf)

--------------------------------------------------------------------------------

IP:DHCP Gi0/0/0/1.1.ip1 AC 10.10.37.2 (default)

RP/0/RP0/CPU0:vBNG#ping 10.10.37.2

Tue Aug 21 14:13:53.894 UTC

Type escape sequence to abort.

Sending 5, 100-byte ICMP Echos to 10.10.37.2, timeout is 2 seconds:

!!!!!

Success rate is 100 percent (5/5), round-trip min/avg/max = 1/1/2 ms

RP/0/RP0/CPU0:vBNG#show route 10.10.37.2

Tue Aug 21 14:14:17.611 UTC

Routing entry for 10.10.37.2/32

Known via "subscriber IPSUB_SUBSCR", distance 2, metric 0 (connected)

Installed Aug 21 14:13:33.280 for 00:00:44

Routing Descriptor Blocks

directly connected, via GigabitEthernet0/0/0/1.1.ip1

Route metric is 0

No advertising protos.

RP/0/RP0/CPU0:vBNG#show cef 10.10.37.2

Tue Aug 21 14:14:25.544 UTC

10.10.37.2/32, version 3556, attached, subscriber, internal 0x1000041 0x0 (ptr 0xd5d3240) [1], 0x0 (0xd795be8), 0x0 (0x0)

Updated Aug 21 14:13:33.283

remote adjacency to GigabitEthernet0/0/0/1.1

Prefix Len 32, traffic index 0, precedence n/a, priority 3

via GigabitEthernet0/0/0/1.1.ip1, 2 dependencies, weight 0, class 0 [flags 0x8]

path-idx 0 NHID 0x0 [0xe6b0140 0x0]

remote adjacency

RP/0/RP0/CPU0:vBNG#show cef 10.10.37.2 internal

Tue Aug 21 14:14:29.397 UTC

IPv4:default:0xe0000000[0x10c8e63b8]:rib:10.10.37.2/32[ref:1 proto:ipv4 flags:0x1000041 f2:0x0 src:rib][0x10d5d3240]

LDI => [ref:2 pl:0x10d5fc9b8 proto:ipv4 type:ip lvl:1 buckets:1 slots:1 fixup:0 flags:[owner locked, added to pl, depth changed, subscriber]][0x10d6af380]

slots:

{0,p0,s0}={

NHINFO => [type:rx, linkt:link_IPv4, nh_proto:IPv4, ifh:GigabitEthernet0_0_0_1.1(0x1001550), adj:0x10d46d148, flags:[pd bind pending]][0x10e6b0140]

IDB => [ref:1 ifh:0x1 type:0/none parent-type:0/none flags:[owner locked,remote,p2p][0x10c5dc2f0]

IDB_EXT:{MPLS IPv4:NULL,IPv4:[ref:1 IPv4:default[0x10c8e63b8] NH:2 MTU:1500 flags:[none][0x10e5f6170]],MPLS IPv6:NULL,IPv6:NULL}

}

buckets:

{0,p0,s0}={[0x10e6b0140]}

LDI_LW => [type:ip loadinfo:[0x10d6af380]][0x10d795be8]

PATHLIST => [ref:1 count:1 depth:1 ldi:0x10d6af380 type:Shared flags:[subscriber] extn_flags:[]][0x10d5fc9b8]

0={

[[nh:0.0.0.0 ifh:GigabitEthernet0_0_0_1.1(0x1001550) tbl:0xe0000000 type:ip flags:[attached]]

[depth:1 flags:[resolved,ldi-preferred] resolves-via: ###

NHINFO => [type:rx, linkt:link_IPv4, nh_proto:IPv4, ifh:GigabitEthernet0_0_0_1.1(0x1001550), adj:0x10d46d148, flags:[pd bind pending]][0x10e6b0140]

IDB => [ref:1 ifh:0x1 type:0/none parent-type:0/none flags:[owner locked,remote,p2p][0x10c5dc2f0]

IDB_EXT:{MPLS IPv4:NULL,IPv4:[ref:1 IPv4:default[0x10c8e63b8] NH:2 MTU:1500 flags:[none][0x10e5f6170]],MPLS IPv6:NULL,IPv6:NULL} ###]}

Aleksandar Vidakovic · ‎08-21-2018

Just as I expected, main interface is not supported yet. Can you clarify what you meant by "... wasn't applicable"? Ambiguous dot1q must work in the typical scenario: outer tag is explicitly configured and inner is ambiguous.

manoj.karmacharya · ‎08-21-2018

XRv9000 didn't support "encapsulation ambiguous dot1q {any | vlan-range }". I've used this command several time in BE interface on a physical A9K routers while configuring PPPoE BNG.

Aleksandar Vidakovic · ‎08-21-2018

Thanks for clarifying. BNG feature parity between asr9k and xrv9k is should be achieved next year, in one of the 7.x upcoming releases. If your deployment model of xrv9k BNG requires ambiguous mode, please reach out to your account team at Cisco and let's work towards a resolution.