BGP/MPLS multiple static routes to same destination

[bstrain1974]

Diagram attached. Cisco beginner here. I have 6 offices in total. Currently I have 1 static route in MAIN OFFICE 1 router that points all data center traffic to FW 1 and all the other routers learn this route through BGP and it works fine. Traffic goes from FW 1 to VPN 1 then DC.

What I would like to do is add a static route in BRANCH 1 router that points all data center traffic to FW 2. Traffic goes from FW 2 to VPN 2 then DC.

I'm having trouble getting this to work. A traceroute from BRANCH 1 goes in a loop - I'm assuming because of the Verizon PE routers? 

MAIN OFFICE 1 ROUTER

bgp router-id 68.139.249.XXX
bgp log-neighbor-changes
timers bgp 10 30
redistribute connected
redistribute static
neighbor 68.139.249.XXX remote-as 65000

BRANCH 1 ROUTER

router bgp 65001
bgp router-id 68.136.106.XX
bgp log-neighbor-changes
redistribute connected
redistribute static
neighbor 68.136.106.XX remote-as 65000

[paul driver]

Hello

Instead of just redistributing the static routes into the branch sites and having manual static routes at your branch office you could just redistribute/advertise the static from each main site with a local preference given to main office 2

example:

Main site 1
router bgp 65001
redistribute connected
redistribute static route-map LP
neighbor <branch office > remote-as 65001
neighbor <main office 2> remote-as 65001
neighbor <main office 2> next-hop-self
neighbor 68.139.x.x remote-as 65000
no auto-summary

route-map LP permit
set local-preference 20000

ip route 10.20.240.0 255.255.255.0 10.10.156.2

Main site 2

router bgp 65001
redistribute connected
redistribute static route-map LP
neighbor <branch office > remote-as 65001
neighbor <main office 1> remote-as 65001
neighbor <main office 1> next-hop-self
neighbor 68.139.x.x remote-as 65000
no auto-summary

route-map LP permit
set local-preference 50000

track 10 interface <wan interface> line-protocol

ip route 10.20.240.0 255.255.255.0 10.10.152.2 track 10

[bstrain1974]

Paul, thanks so much for the reply. Currently I have just the 1 static route 10.20.40.0 in the MAIN OFFICE 1  router and that gets advertised to my other routers and works fine.

Going forward I want to also use VPN 2 to reach the data center. I'd like some branches to go through MAIN OFFICE 1/FW 1/VPN 1, and then some other branches to use MAIN OFFICE 2/FW 2/VPN 2.

Adding the static route (ip route 10.20.40.0 255.255.255.0 10.10.155.2) to BRANCH 1 did not work.

I have tried adding additional neighbors to 10.10.157.1 and 10.10.155.1 and also adding the ebgp-multihop command, since there are multiple Verizon routers between my 2 routers - this did not work.

What if I advertised the MAIN OFFICE 2 network as follows

network 10.10.155.0 mask 255.255.255.0

Would that possibly help? Again, thanks for any help you can provide.

[bstrain1974]

New diagram attached to help clarify what I'm trying to do, thanks.

[Jon Marshall]

If this is a L3 MPLS solution you can't do what you want because your sites are not peering with each other they are peering with provider routers. 

So you cannot tell one branch to use a different default route to the others because how do you tell the provider to route a specific branch one way and other branches the other. 

What you would have to do to achieve this is to build tunnels across the MPLS network and then use a routing protocol across the tunnel so you could then directly influence which site goes where. 

Of course there are other possible solutions eg. different VPNs with different default routes but these would need to be agreed with the provider. 

Paul also may have some ideas ?

Jon

[bstrain1974]

I have read about the ebgp-multihop. Is that something that can be used here?

https://networklessons.com/bgp/ebgp-multihop