I need help with suggestions, we are obviously not getting something right regarding spanning tree and it's burning us hard. The Data center comprises of a pair of Juniper QFX-5100 (root bridge for the spanning tree, i'll refer to this as CRS), another pair of QFX-5100 uplinked to the root bridge (I'll refer to this as CSW) and 8*4948 hanging off the Juniper QFX(I'll refer to this as ASW).
The 8*4948(ASWs) are running PVST+, the root bridge (CRSs) runs RSTP and VSTP towards the Cisco, this way fast convergence is achieved. The CRS and CSW runs RSTP only. This was all tested in the lab and everything seems fine, however when operating in production, a TCN generated from the ASW (Cisco switches) such as plugging a server into an un-configured port on the cisco, or loosing 1 of the uplinks on the ASW causes a spanning tree event that melts the whole network, this occurs for about 2 minutes and suddenly returns to normal without intervention but causes a lot of disruption.
We started experiencing this when the CSW was to be integrated.
See sample configs below: (ae38-45 are lacps from CRS1 to ASWs, ae0 is lacp between CRS1-CRS2, et0/0/50-et0/0/51 is link to CSW, rstp edge connects to servers) #Note the vlans are much and only one is referenced here
CRS1:
set protocols vstp interface ae0 cost 250
set protocols vstp interface ae38
set protocols vstp interface ae39
set protocols vstp interface ae40
set protocols vstp interface ae41
set protocols vstp interface ae42
set protocols vstp interface ae43
set protocols vstp interface ae44
set protocols vstp interface ae45
set protocols vstp vlan all bridge-priority 4k
set protocols rstp interface et-0/0/50
set protocols rstp interface et-0/0/51
set protocols rstp interface ae0 cost 250
set protocols rstp interface ae38
set protocols rstp interface ae39
set protocols rstp interface ae40
set protocols rstp interface ae41
set protocols rstp interface ae42
set protocols rstp interface ae43
set protocols rstp interface ae44
set protocols rstp interface ae45
set protocols rstp bpdu-block-on-edge
set protocols rstp bridge-priority 4k
set protocols rstp interface xe-0/0/0 edge
set protocols rstp interface xe-0/0/1 edge
Sample trunk config on CRS towards ASW:
set interfaces xe-0/0/38 description "[AE38]-[ASW1.Te0/51"
set interfaces xe-0/0/38 ether-options 802.3ad ae38
set interfaces ae38 description "[AE38]-[ASW1.Po1]"
set interfaces ae38 native-vlan-id 1
set interfaces ae38 mtu 9198
set interfaces ae38 aggregated-ether-options lacp active
set interfaces ae38 unit 0 family ethernet-switching interface-mode trunk
set interfaces ae38 unit 0 family ethernet-switching vlan members v1424
set interfaces ae38 unit 0 family ethernet-switching vlan members default
trunk between CRS1 and CRS2
set interfaces et-0/0/52 ether-options 802.3ad ae0
set interfaces et-0/0/53 ether-options 802.3ad ae0
set interfaces ae0 description "[AE]-CRS2.ae0"
set interfaces ae0 mtu 9198
set interfaces ae0 unit 0 family ethernet-switching interface-mode trunk
set interfaces ae0 unit 0 family ethernet-switching vlan members v1423
set interfaces ae0 unit 0 family ethernet-switching vlan members default
CRS2
set protocols vstp interface ae0 cost 250
set protocols vstp interface ae38
set protocols vstp interface ae39
set protocols vstp interface ae40
set protocols vstp interface ae41
set protocols vstp interface ae42
set protocols vstp interface ae43
set protocols vstp interface ae44
set protocols vstp interface ae45
set protocols vstp vlan all bridge-priority 8k
set protocols rstp interface et-0/0/50
set protocols rstp interface et-0/0/51
set protocols rstp interface ae0 cost 250
set protocols rstp interface ae38
set protocols rstp interface ae39
set protocols rstp interface ae40
set protocols rstp interface ae41
set protocols rstp interface ae42
set protocols rstp interface ae43
set protocols rstp interface ae44
set protocols rstp interface ae45
set protocols rstp bpdu-block-on-edge
set protocols rstp bridge-priority 8k
set protocols rstp interface xe-0/0/0 edge
set protocols rstp interface xe-0/0/1 edge
Sample trunk config on CRS towards ASW:
set interfaces xe-0/0/38 description "[AE38]-[ASW1.Te0/51"
set interfaces xe-0/0/38 ether-options 802.3ad ae38
set interfaces ae38 description "[AE38]-[ASW1.Po1]"
set interfaces ae38 native-vlan-id 1
set interfaces ae38 mtu 9198
set interfaces ae38 aggregated-ether-options lacp active
set interfaces ae38 unit 0 family ethernet-switching interface-mode trunk
set interfaces ae38 unit 0 family ethernet-switching vlan members v1424
set interfaces ae38 unit 0 family ethernet-switching vlan members default
trunk between CRS1 and CRS2
set interfaces et-0/0/52 ether-options 802.3ad ae0
set interfaces et-0/0/53 ether-options 802.3ad ae0
set interfaces ae0 description "[AE]-CRS2.ae0"
set interfaces ae0 mtu 9198
set interfaces ae0 unit 0 family ethernet-switching interface-mode trunk
set interfaces ae0 unit 0 family ethernet-switching vlan members v1423
set interfaces ae0 unit 0 family ethernet-switching vlan members default
CSW1
set protocols rstp interface et-0/0/50
set protocols rstp interface et-0/0/51
set protocols rstp bpdu-block-on-edge
CSW2
set protocols rstp interface et-0/0/50
set protocols rstp interface et-0/0/51
set protocols rstp bpdu-block-on-edge
ASWs (pvst+ enabled and portfast enabled to hosts on trunk/access ports)
spanning-tree mode rapid-pvst
spanning-tree portfast trunk
spanning-tree bpdufilter enable
spanning-tree portfast
Sample trunk config on port-channel towards CRS
interface Port-channel1
description CRS1.ae38
switchport
switchport mode trunk
mtu 9198
load-interval 30
This is a major issue and am wondering if anyone has experienced a similar issue or having any suggestion? This would be greatly appreciated.
