Solved: Re: MPLS L3 VPN not pinging routes in Route table

wilok · ‎07-08-2018

Hi Fellows,

Please i need help, i have been trying to troubleshoot these topology, I created an MPLS VPN (design/ configs attached), but the ISP3R can't ping ISP1R VRF. Everything looks okay with the config.

ISP2R and attached CE can ping ISP1R and attached CE's but ISP3R can't ping across the configured P routers (ISP5R and ISP6R). But the Routes all show up in the Routing tables/ VRF table,

when i use: sh bgp vpnv4 unicast

Please kindly help. I'm doing this on a Cisco VIRL using the IOS XR as the Provider Network and IOSv as the Customer edge.

Attached are the design and config.

RP/0/0/CPU0:ISP1R#sh run
Fri Jul 6 15:14:25.304 UTC
Building configuration...
!! IOS XR Configuration 6.1.3
!! Last configuration change at Fri Jul 6 12:18:53 2018 by CVAC
!
hostname ISP1R
vrf WILOK
address-family ipv4 unicast
import route-target
450:100
!
export route-target
450:100
!
!
address-family ipv4 multicast
import route-target
450:100
!
export route-target
450:100
!
!
!
vrf WILSON
address-family ipv4 unicast
import route-target
300:150
450:100
!
export route-target
300:150
!
!
!
interface Loopback0
ipv4 address 11.11.11.11 255.255.255.255
!
interface MgmtEth0/0/CPU0/0
shutdown
!
interface GigabitEthernet0/0/0/0
description INT TO ISP5R G0/0 INT
ipv4 address 10.10.9.1 255.255.255.252
!
interface GigabitEthernet0/0/0/1
description INT TO ISP6R G0/0 INT
ipv4 address 10.10.10.1 255.255.255.252
!
interface GigabitEthernet0/0/0/2
shutdown
!
interface GigabitEthernet0/0/0/3
shutdown
!
interface GigabitEthernet0/0/0/4
shutdown
!
interface GigabitEthernet0/0/0/5
vrf WILOK
ipv4 address 20.40.2.1 255.255.255.252
!
interface GigabitEthernet0/0/0/6
vrf WILSON
ipv4 address 21.21.2.1 255.255.255.252
!
route-policy ACCEPT
end-policy
!
router static
vrf WILOK
address-family ipv4 unicast
20.40.0.0/16 20.40.2.2
!
!
!
router ospf 5
router-id 11.11.11.11
address-family ipv4 unicast
area 0.0.0.0
interface Loopback0
!
interface GigabitEthernet0/0/0/0
!
interface GigabitEthernet0/0/0/1
!
!
!
router bgp 5500
address-family ipv4 unicast
!
address-family vpnv4 unicast
!
neighbor-group PE_ROUTERS
remote-as 5500
update-source Loopback0
address-family vpnv4 unicast
next-hop-self
!
!
neighbor 22.22.22.22
use neighbor-group PE_ROUTERS
address-family vpnv4 unicast
!
!
neighbor 33.33.33.33
use neighbor-group PE_ROUTERS
address-family vpnv4 unicast
!
!
neighbor 44.44.44.44
use neighbor-group PE_ROUTERS
address-family vpnv4 unicast
!
!
vrf WILOK
rd 100:50
address-family ipv4 unicast
redistribute static
!
!
vrf WILSON
rd 200:100
address-family ipv4 unicast
redistribute eigrp 40
!
!
!
mpls oam
!
mpls ldp
interface GigabitEthernet0/0/0/0
!
interface GigabitEthernet0/0/0/1
!
!
mpls label range table 0 16100 16199
router eigrp 40
vrf WILSON
address-family ipv4
default-metric 10000 100 255 1 1500
autonomous-system 40
redistribute bgp 5500
interface GigabitEthernet0/0/0/6
!
!
!
!
end

================================================================================

RP/0/0/CPU0:ISP2R#sh run
Fri Jul 6 15:16:59.476 UTC
Building configuration...
!! IOS XR Configuration 6.1.3
!! Last configuration change at Fri Jul 6 13:25:35 2018 by cisco
!
hostname ISP2R
vrf WILOK
address-family ipv4 unicast
import route-target
300:150
450:100
!
export route-target
450:100
!
!
!
interface Loopback0
ipv4 address 22.22.22.22 255.255.255.255
!
interface MgmtEth0/0/CPU0/0
shutdown
!
interface GigabitEthernet0/0/0/0
description INT TO ISP5R G0/1 INT
ipv4 address 10.10.11.1 255.255.255.252
!
interface GigabitEthernet0/0/0/1
description INT TO ISP6R G0/1 INT
ipv4 address 10.10.12.1 255.255.255.252
!
interface GigabitEthernet0/0/0/2
shutdown
!
interface GigabitEthernet0/0/0/3
shutdown
!
interface GigabitEthernet0/0/0/4
shutdown
!
interface GigabitEthernet0/0/0/5
description INT TO WILOKCORP SITE 2
vrf WILOK
ipv4 address 100.150.10.1 255.255.255.252
!
router static
vrf WILOK
address-family ipv4 unicast
100.150.0.0/16 100.150.10.2
!
!
!
router ospf 5
address-family ipv4 unicast
area 0.0.0.0
interface Loopback0
!
interface GigabitEthernet0/0/0/0
!
interface GigabitEthernet0/0/0/1
!
!
!
router bgp 5500
address-family ipv4 unicast
!
address-family vpnv4 unicast
!
neighbor-group PE_ROUTERS
remote-as 5500
update-source Loopback0
address-family vpnv4 unicast
next-hop-self
!
!
neighbor 11.11.11.11
use neighbor-group PE_ROUTERS
address-family vpnv4 unicast
!
!
neighbor 33.33.33.33
use neighbor-group PE_ROUTERS
address-family ipv4 unicast
!
address-family vpnv4 unicast
!
!
neighbor 44.44.44.44
use neighbor-group PE_ROUTERS
address-family vpnv4 unicast
!
!
vrf WILOK
rd 100:50
address-family ipv4 unicast
redistribute static
!
!
!
mpls oam
!
mpls ldp
interface GigabitEthernet0/0/0/0
!
interface GigabitEthernet0/0/0/1
!
!
mpls label range table 0 16200 16299
end

RP/0/0/CPU0:ISP2R#

================================================================================

RP/0/0/CPU0:ISP5R#sh run
Fri Jul 6 15:18:08.070 UTC
Building configuration...
!! IOS XR Configuration 6.1.3
!! Last configuration change at Fri Jul 6 13:19:11 2018 by cisco
!
hostname ISP5R
interface Loopback0
ipv4 address 55.55.55.55 255.255.255.255
!
interface MgmtEth0/0/CPU0/0
shutdown
!
interface GigabitEthernet0/0/0/0
description INT TO ISPIR G0/0
ipv4 address 10.10.9.2 255.255.255.252
!
interface GigabitEthernet0/0/0/1
description INT TO ISP2R G0/0
ipv4 address 10.10.11.2 255.255.255.252
!
interface GigabitEthernet0/0/0/2
description INT TO ISP3R G0/0/0/0 INT
ipv4 address 11.11.9.2 255.255.255.252
!
interface GigabitEthernet0/0/0/3
description INT TO ISP4R G0/0/0/0 INT
ipv4 address 11.11.11.2 255.255.255.252
!
interface GigabitEthernet0/0/0/4
shutdown
!
interface GigabitEthernet0/0/0/5
shutdown
!
interface GigabitEthernet0/0/0/6
shutdown
!
interface GigabitEthernet0/0/0/7
shutdown
!
interface GigabitEthernet0/0/0/8
shutdown
!
interface GigabitEthernet0/0/0/9
shutdown
!
interface GigabitEthernet0/0/0/10
description INT TO ISP6R G0/10
ipv4 address 172.16.16.2 255.255.255.252
!
router ospf 5
router-id 55.55.55.55
address-family ipv4 unicast
area 0.0.0.0
interface Loopback0
!
interface GigabitEthernet0/0/0/0
!
interface GigabitEthernet0/0/0/1
!
interface GigabitEthernet0/0/0/2
!
interface GigabitEthernet0/0/0/3
!
interface GigabitEthernet0/0/0/10
!
!
!
mpls oam
!
mpls ldp
router-id 55.55.55.55
interface GigabitEthernet0/0/0/0
!
interface GigabitEthernet0/0/0/1
!
interface GigabitEthernet0/0/0/2
!
interface GigabitEthernet0/0/0/3
!
interface GigabitEthernet0/0/0/10
!
!
mpls label range table 0 16500 16599
end

RP/0/0/CPU0:ISP5R#

===============================================================================

RP/0/0/CPU0:ISP6R#sh run
Fri Jul 6 15:19:30.604 UTC
Building configuration...
!! IOS XR Configuration 6.1.3
!! Last configuration change at Fri Jul 6 13:18:37 2018 by cisco
!
hostname ISP6R
interface Loopback0
ipv4 address 66.66.66.66 255.255.255.255
!
interface MgmtEth0/0/CPU0/0
shutdown
!
interface GigabitEthernet0/0/0/0
description INT TO ISPIR G0/0
ipv4 address 10.10.10.2 255.255.255.252
!
interface GigabitEthernet0/0/0/1
description INT TO ISP2R G0/0
ipv4 address 10.10.12.2 255.255.255.252
!
interface GigabitEthernet0/0/0/2
description INT TO ISP3R G0/0/0/1 INT
ipv4 address 11.11.10.2 255.255.255.252
!
interface GigabitEthernet0/0/0/3
description INT TO ISP4R G0/0/0/1 INT
ipv4 address 11.11.12.2 255.255.255.252
!
interface GigabitEthernet0/0/0/4
shutdown
!
interface GigabitEthernet0/0/0/5
shutdown
!
interface GigabitEthernet0/0/0/6
shutdown
!
interface GigabitEthernet0/0/0/7
shutdown
!
interface GigabitEthernet0/0/0/8
shutdown
!
interface GigabitEthernet0/0/0/9
shutdown
!
interface GigabitEthernet0/0/0/10
description INT TO ISP6R G0/10
ipv4 address 172.16.16.1 255.255.255.252
!
router ospf 5
router-id 66.66.66.66
address-family ipv4 unicast
area 0.0.0.0
interface Loopback0
!
interface GigabitEthernet0/0/0/0
!
interface GigabitEthernet0/0/0/1
!
interface GigabitEthernet0/0/0/2
!
interface GigabitEthernet0/0/0/3
!
interface GigabitEthernet0/0/0/10
!
!
!
mpls oam
!
mpls ldp
router-id 66.66.66.66
interface GigabitEthernet0/0/0/0
!
interface GigabitEthernet0/0/0/1
!
interface GigabitEthernet0/0/0/2
!
interface GigabitEthernet0/0/0/3
!
interface GigabitEthernet0/0/0/10
!
!
mpls label range table 0 16600 16699
end

RP/0/0/CPU0:ISP6R#

===============================================================================

RP/0/0/CPU0:ISP3R#sh run
Fri Jul 6 15:20:14.933 UTC
Building configuration...
!! IOS XR Configuration 6.1.3
!! Last configuration change at Fri Jul 6 13:26:50 2018 by cisco
!
hostname ISP3R
vrf WILOK
address-family ipv4 unicast
import route-target
450:100
!
export route-target
450:100
!
!
!
vrf WILSON
address-family ipv4 unicast
import route-target
300:150
450:100
!
export route-target
300:150
!
!
!
interface Loopback0
ipv4 address 33.33.33.33 255.255.255.255
!
interface MgmtEth0/0/CPU0/0
shutdown
!
interface GigabitEthernet0/0/0/0
description INT TO ISP5R G0/0/0/2 INT
ipv4 address 11.11.9.1 255.255.255.252
!
interface GigabitEthernet0/0/0/1
description INT TO ISP6R G0/0/0/2 INT
ipv4 address 11.11.10.1 255.255.255.252
!
interface GigabitEthernet0/0/0/2
description INT TO WILOKCORP3 ROUTER G0/1
vrf WILOK
ipv4 address 15.25.35.1 255.255.255.252
!
route-policy ACCEPT
pass
end-policy
!
router ospf 5
router-id 33.33.33.33
address-family ipv4 unicast
area 0.0.0.0
interface Loopback0
!
interface GigabitEthernet0/0/0/0
!
interface GigabitEthernet0/0/0/1
!
!
!
router bgp 5500
address-family ipv4 unicast
!
address-family vpnv4 unicast
!
neighbor-group PE_ROUTERS
remote-as 5500
update-source Loopback0
address-family vpnv4 unicast
weight 32768
next-hop-self
!
!
neighbor 11.11.11.11
use neighbor-group PE_ROUTERS
address-family vpnv4 unicast
!
!
neighbor 22.22.22.22
use neighbor-group PE_ROUTERS
address-family ipv4 unicast
!
address-family vpnv4 unicast
!
!
neighbor 44.44.44.44
use neighbor-group PE_ROUTERS
address-family vpnv4 unicast
!
!
vrf WILOK
rd 100:50
address-family ipv4 unicast
!
!
vrf WILSON
rd 200:100
address-family ipv4 unicast
!
!
!
mpls oam
!
mpls ldp
interface GigabitEthernet0/0/0/0
!
interface GigabitEthernet0/0/0/1
!
!
mpls label range table 0 16300 16399
end

RP/0/0/CPU0:ISP3R#

===============================================================================

RP/0/0/CPU0:ISP4R#sh run
Fri Jul 6 15:22:00.065 UTC
Building configuration...
!! IOS XR Configuration 6.1.3
!! Last configuration change at Fri Jul 6 12:19:13 2018 by CVAC
!
hostname ISP4R
vrf WILOK
address-family ipv4 unicast
import route-target
450:100
!
export route-target
450:100
!
!
!
vrf WILSON
address-family ipv4 unicast
import route-target
300:150
450:100
!
export route-target
300:150
450:100
!
!
!
interface Loopback0
ipv4 address 44.44.44.44 255.255.255.255
!
interface MgmtEth0/0/CPU0/0
shutdown
!
interface GigabitEthernet0/0/0/0
description INT TO ISP5R G0/0/0/3 INT
ipv4 address 11.11.11.1 255.255.255.252
!
interface GigabitEthernet0/0/0/1
description INT TO ISP6R G0/0/0/3 INT
ipv4 address 11.11.12.1 255.255.255.252
!
interface GigabitEthernet0/0/0/2
description INT TO WILSONCORP2 ROUTER GE0/1
vrf WILSON
ipv4 address 30.31.32.1 255.255.255.252
!
router ospf 5
address-family ipv4 unicast
area 0.0.0.0
interface Loopback0
!
interface GigabitEthernet0/0/0/0
!
interface GigabitEthernet0/0/0/1
!
!
!
router bgp 5500
address-family ipv4 unicast
!
address-family vpnv4 unicast
!
neighbor-group PE_ROUTERS
remote-as 5500
update-source Loopback0
address-family vpnv4 unicast
next-hop-self
!
!
neighbor 11.11.11.11
use neighbor-group PE_ROUTERS
address-family vpnv4 unicast
route-reflector-client
!
!
neighbor 22.22.22.22
use neighbor-group PE_ROUTERS
address-family vpnv4 unicast
route-reflector-client
!
!
neighbor 33.33.33.33
use neighbor-group PE_ROUTERS
address-family vpnv4 unicast
route-reflector-client
!
!
!
mpls oam
!
mpls ldp
interface GigabitEthernet0/0/0/0
!
interface GigabitEthernet0/0/0/1
!
!
mpls label range table 0 16400 16499
end

RP/0/0/CPU0:ISP4R#

a.alekseev · ‎07-09-2018

On R3 you should add "redistribute connected"

vrf WILOK
rd 100:50
address-family ipv4 unicast
redistribute connected
!
!
vrf WILSON
rd 200:100
address-family ipv4 unicast
redistribute connected
!

View solution in original post

a.alekseev · ‎07-08-2018

sh mpls ldp neighbor

wilok · ‎07-08-2018

I have checked earlier, i still could not find the problem.

Using the P routers, here are the outputs.

RP/0/0/CPU0:ISP5R#sh mpls ldp neighbor brief
Mon Jul 9 02:27:33.190 UTC

Peer GR NSR Up Time Discovery Addresses Labels
ipv4 ipv6 ipv4 ipv6 ipv4 ipv6
----------------- -- --- ---------- ---------- ---------- ------------
66.66.66.66:0 N N 00:02:41 1 0 6 0 15 0
11.11.11.11:0 N N 00:02:41 1 0 3 0 15 0
33.33.33.33:0 N N 00:02:41 1 0 3 0 15 0
44.44.44.44:0 N N 00:02:41 1 0 3 0 15 0
22.22.22.22:0 N N 00:02:41 1 0 3 0 15 0

RP/0/0/CPU0:ISP6R#sh mpls ldp neighbor brief
Mon Jul 9 02:27:52.830 UTC

Peer GR NSR Up Time Discovery Addresses Labels
ipv4 ipv6 ipv4 ipv6 ipv4 ipv6
----------------- -- --- ---------- ---------- ---------- ------------
22.22.22.22:0 N N 00:05:08 1 0 3 0 15 0
11.11.11.11:0 N N 00:05:08 1 0 3 0 15 0
44.44.44.44:0 N N 00:05:07 1 0 3 0 15 0
33.33.33.33:0 N N 00:04:21 1 0 3 0 15 0
55.55.55.55:0 N N 00:03:00 1 0 6 0 15 0

RP/0/0/CPU0:ISP5R#show mpls interfaces
Mon Jul 9 02:29:38.012 UTC
Interface LDP Tunnel Static Enabled
-------------------------- -------- -------- -------- --------
GigabitEthernet0/0/0/0 Yes No No Yes
GigabitEthernet0/0/0/1 Yes No No Yes
GigabitEthernet0/0/0/2 Yes No No Yes
GigabitEthernet0/0/0/3 Yes No No Yes
GigabitEthernet0/0/0/10 Yes No No Yes
RP/0/0/CPU0:ISP5R#

RP/0/0/CPU0:ISP6R#sh mpls interfaces
Mon Jul 9 02:29:46.382 UTC
Interface LDP Tunnel Static Enabled
-------------------------- -------- -------- -------- --------
GigabitEthernet0/0/0/0 Yes No No Yes
GigabitEthernet0/0/0/1 Yes No No Yes
GigabitEthernet0/0/0/2 Yes No No Yes
GigabitEthernet0/0/0/3 Yes No No Yes
GigabitEthernet0/0/0/10 Yes No No Yes

a.alekseev · ‎07-08-2018

Sh ip bgp vpnv4 all

from 33.33.33.33 and 44.44.44.44

wilok · ‎07-09-2018

Hi Alekseev,
Thanks for your quick response, please here is the output. For 33.33.33.33 and 44.44.44.44

RP/0/0/CPU0:ISP3R#sh bgp vpnv4 unicast
Mon Jul 9 08:00:16.086 UTC
BGP router identifier 33.33.33.33, local AS number 5500
BGP generic scan interval 60 secs
Non-stop routing is enabled
BGP table state: Active
Table ID: 0x0 RD version: 0
BGP main routing table version 37
BGP NSR Initial initsync version 20 (Reached)
BGP NSR/ISSU Sync-Group versions 0/0
BGP scan interval 60 secs

Status codes: s suppressed, d damped, h history, * valid, > best
i - internal, r RIB-failure, S stale, N Nexthop-discard
Origin codes: i - IGP, e - EGP, ? - incomplete
Network Next Hop Metric LocPrf Weight Path
Route Distinguisher: 100:50 (default for vrf WILOK)
*>i20.40.0.0/16 11.11.11.11 0 100 0 ?
* i 11.11.11.11 0 100 0 ?
*>i21.21.2.0/30 11.11.11.11 0 100 0 ?
*>i21.21.3.0/24 11.11.11.11 2570240 100 0 ?
*>i21.21.4.0/24 11.11.11.11 2570240 100 0 ?
*>i100.150.0.0/16 22.22.22.22 0 100 0 ?
* i 22.22.22.22 0 100 0 ?
Route Distinguisher: 200:100 (default for vrf WILSON)
*>i20.40.0.0/16 11.11.11.11 0 100 0 ?
*>i21.21.2.0/30 11.11.11.11 0 100 0 ?
* i 11.11.11.11 0 100 0 ?
*>i21.21.3.0/24 11.11.11.11 2570240 100 0 ?
* i 11.11.11.11 2570240 100 0 ?
*>i21.21.4.0/24 11.11.11.11 2570240 100 0 ?
* i 11.11.11.11 2570240 100 0 ?
*>i100.150.0.0/16 22.22.22.22 0 100 0 ?

Processed 10 prefixes, 15 paths

RP/0/0/CPU0:ISP4R#sh bgp vpnv4 unicast
Mon Jul 9 08:00:45.524 UTC
BGP router identifier 44.44.44.44, local AS number 5500
BGP generic scan interval 60 secs
Non-stop routing is enabled
BGP table state: Active
Table ID: 0x0 RD version: 0
BGP main routing table version 31
BGP NSR Initial initsync version 5 (Reached)
BGP NSR/ISSU Sync-Group versions 0/0
BGP scan interval 60 secs

Status codes: s suppressed, d damped, h history, * valid, > best
i - internal, r RIB-failure, S stale, N Nexthop-discard
Origin codes: i - IGP, e - EGP, ? - incomplete
Network Next Hop Metric LocPrf Weight Path
Route Distinguisher: 100:50 (default for vrf WILOK)
*>i20.40.0.0/16 11.11.11.11 0 100 0 ?
* i 11.11.11.11 0 100 0 ?
*>i100.150.0.0/16 22.22.22.22 0 100 0 ?
* i 22.22.22.22 0 100 0 ?
Route Distinguisher: 200:100 (default for vrf WILSON)
*>i20.40.0.0/16 11.11.11.11 0 100 0 ?
*>i21.21.2.0/30 11.11.11.11 0 100 0 ?
* i 11.11.11.11 0 100 0 ?
*>i21.21.3.0/24 11.11.11.11 2570240 100 0 ?
* i 11.11.11.11 2570240 100 0 ?
*>i21.21.4.0/24 11.11.11.11 2570240 100 0 ?
* i 11.11.11.11 2570240 100 0 ?
*>i100.150.0.0/16 22.22.22.22 0 100 0 ?

Processed 7 prefixes, 12 paths
RP/0/0/CPU0:ISP4R#

a.alekseev · ‎07-09-2018

On R3 you should add "redistribute connected"

vrf WILOK
rd 100:50
address-family ipv4 unicast
redistribute connected
!
!
vrf WILSON
rd 200:100
address-family ipv4 unicast
redistribute connected
!

wilok · ‎07-09-2018

I'm lost of words to say thanks.
You made my morning. This solved it.
Thanks greatly.