Trunk between Cisco an Aruba

[mulbreizh]

Hello and sorry for my bad english,

I have a lag/etherchannel between my Cisco C3850 and two Aruba 8100 in stack. I have troubles because there is a lot of packets discarded as you can see below on picture. 

My configuration on Cisco is like this :
interface Port-channel32
description aruba
switchport trunk native vlan 999
switchport mode trunk
switchport nonegotiate

interface TenGigabitEthernet1/0/39
description Aruba A8100
switchport trunk native vlan 999
switchport mode trunk
switchport nonegotiate
channel-group 32 mode active
!
interface TenGigabitEthernet1/0/40
description Aruba A8100
switchport trunk native vlan 999
switchport mode trunk
switchport nonegotiate
channel-group 32 mode active

and on Aruba :

interface lag 1 multi-chassis
description LACP-to-Coeur
no shutdown
no routing
vlan trunk native 999
vlan trunk allowed 1-2,5,15,17,21-22,25-26,45,51,54,56,61-62,70,89,100,102,104,110,999
lacp mode active
spanning-tree bpdu-filter
spanning-tree rpvst-filter

interface 1/1/47
description aggr LAG1 to core
no shutdown
lag 1
!
interface 1/1/48
description aggr LAG1 to core
no shutdown
lag 1

do you think this configuration is bad ? 

[MHM Cisco World]

share 
show interface PO <<- Port channel connect cisco to aruba 
MHM

[mulbreizh]

C3850#show int po 32
Port-channel32 is up, line protocol is up (connected)
Hardware is EtherChannel, address is 8024.8f7c.8528 (bia 8024.8f7c.8528)
Description: aruba salle E011
MTU 1500 bytes, BW 40000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 3/255, rxload 3/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 10Gb/s, link type is auto, media type is N/A
input flow-control is on, output flow-control is unsupported
Members in this channel: Te1/0/39 Te1/0/40 Te2/0/37 Te2/0/38
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:00, output 00:00:00, output hang never
Last clearing of "show interface" counters 10w0d
Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 32212049
77
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 520479000 bits/sec, 48487 packets/sec
5 minute output rate 618248000 bits/sec, 57664 packets/sec
224933561996 packets input, 298435325573539 bytes, 1 no buffer
Received 73389426 broadcasts (58444006 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 58444006 multicast, 0 pause input
0 input packets with dribble condition detected
121916216788 packets output, 136144030059965 bytes, 0 underruns
Output 209866243 broadcasts (0 multicasts)
0 output errors, 0 collisions, 0 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out

[MHM Cisco World]

qos queue-softmax-multiplier 1200

Add this in Cisco SW and monitor the output drop

MHM

[mulbreizh]

this command has impact for production ? i apply only in interface ?

[MHM Cisco World]

No impact 

And it add in global mode 

For more info about command 

https://www.cisco.com/c/en/us/support/docs/switches/catalyst-3850-series-switches/200594-Catalyst-3850-Troubleshooting-Output-dr.html

MHM

[mulbreizh]

For information, from side of Cisco i have spanning-tree Rapid-PVST and from Aruba MSTP

[MHM Cisco World]

It dont matter' the Aruba use bpdu filter so any stp not exchange between two link.

And STP is make UP or down not make interface UP but some data is drop.

You have queue issue only 

MHM

[Joseph W. Doherty]

---

@mulbreizh wrote:

this command has impact for production ?

---

Often, but not always, it has a positive impact, but a negative impact is a possibility.  The latter, a possible reason why it's NOT the Cisco default although Cisco suggests trying it.

Whenever you make QoS configuration changes, and/or resource configuration changes, you want to carefully monitor "before" vs. "after" for some time (usually up to a week).

[paul driver]

Hello

---

@mulbreizh wrote:
For information, from side of Cisco i have spanning-tree Rapid-PVST and from Aruba MSTP

and on Aruba :
interface lag 1 multi-chassis
vlan trunk native 999
vlan trunk allowed 1-2,5,15,17,21-22,25-26,45,51,54,56,61-62,70,89,100,102,104,110,999

Mstp is per instance stp NOT per vlan like RPVST, so really you should not be pruning on the aruba Mlag

aruba
sh spanning-tree summary root 
sh lacp aggregates
sh int x/x/x (physical interfaces for lag)
sh int lag 1

cisco
sh spanning-tree root 
sh etherchannel 32 summary | be Gr
sh int port 32
sh int x/x (physical interfaces for PC)

[MHM Cisco World]

What ever Aruba use he use stp or mst he already disable send bpdu by bpdufilter so cisco SW dont see it as SW but as Host use trunk.

I explain this in his other post.

@mulbreizh you STP is OK if ypu have one link' the data is drop becuase of small queue I send to you link check it and apply  command I recommend 

MHM

[mulbreizh]

Hello, 

I have past the command but still have troubles on interface /

[MHM Cisco World]

run command 

C3850#show int po 32
wait 10 min then run command again 

MHM

[mulbreizh]

Port-channel32 is up, line protocol is up (connected)
Hardware is EtherChannel, address is 8024.8f7c.8528 (bia 8024.8f7c.8528)
Description: aruba salle E011
MTU 1500 bytes, BW 40000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 2/255, rxload 9/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 10Gb/s, link type is auto, media type is N/A
input flow-control is on, output flow-control is unsupported
Members in this channel: Te1/0/39 Te1/0/40 Te2/0/37 Te2/0/38
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:00, output 00:00:00, output hang never
Last clearing of "show interface" counters 2d18h
Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 83366093
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 1534175000 bits/sec, 135225 packets/sec
5 minute output rate 352239000 bits/sec, 41753 packets/sec
19102727012 packets input, 27188562606598 bytes, 0 no buffer
Received 4224733 broadcasts (2501193 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 2501193 multicast, 0 pause input
0 input packets with dribble condition detected
10021365963 packets output, 12916592083168 bytes, 0 underruns
Output 6257767 broadcasts (0 multicasts)
0 output errors, 0 collisions, 0 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out

Port-channel32 is up, line protocol is up (connected)
Hardware is EtherChannel, address is 8024.8f7c.8528 (bia 8024.8f7c.8528)
Description: aruba salle E011
MTU 1500 bytes, BW 40000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 2/255, rxload 6/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 10Gb/s, link type is auto, media type is N/A
input flow-control is on, output flow-control is unsupported
Members in this channel: Te1/0/39 Te1/0/40 Te2/0/37 Te2/0/38
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:00, output 00:00:00, output hang never
Last clearing of "show interface" counters 2d18h
Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 83366093
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 1000718000 bits/sec, 90584 packets/sec
5 minute output rate 349594000 bits/sec, 39257 packets/sec
19151585292 packets input, 27255565007793 bytes, 0 no buffer
Received 4241643 broadcasts (2507321 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 2507321 multicast, 0 pause input
0 input packets with dribble condition detected
10044193620 packets output, 12942221695970 bytes, 0 underruns
Output 6295692 broadcasts (0 multicasts)
0 output errors, 0 collisions, 0 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out

[MHM Cisco World]

There is no more output drop 

83366093

83366093