12-10-2013 02:00 AM
Hi all,
during a troubleshooting analisys I've noted a lot of drops on some of Nexus1000v interfaces.
The 1000v is in an architecture with N7k-UCS FI 6296-UCS blade M series- Vmware Esxi5.1
1000v version is 4.2(1)SV1(5.2)
In particular the drops occurred on veth interfaces toward vmk for Vmotion and Vxlan (two different vmkx- vmk2/vmk3) , and on uplink portchannel dedicated to vxlan and vmotion.
Vxlan implementation is a L2 one.
On portchannel we use mac address pinning toward UCS End Host Mode, so the drops are quite normal ( broadcast/multicast on non designated port), but i'm worried about the drops on vmk.
I've cleared the counters on one of the veth interface, and the drops are still 0, no increment.
Someone can help me to investigate about the problem ?
Maybe some Mtu issue on Dvswitch, or on ESxi ?
Or some performance issue ? I think these drops occur during a peak of traffic toward a customer VM ( the traffic was only 70k ppps , so not so high to think of a performance issue..).
These are the drops on one of the vmk for vxlan ( input+output , or output only)
Vethernet4 is up
Port description is VMware VMkernel, vmk3
Owner is VMware VMkernel, adapter is vmk3
Active on module 10
VMware DVS port 104
Port-Profile is 1120-VXLAN
Port mode is access
5 minute input rate 88509912 bits/second, 12542 packets/second
5 minute output rate 22010120 bits/second, 9501 packets/second
Rx
90293108855 Input Packets 7293052419905852798 Unicast Packets
2319412221426068554 Multicast Packets 240550728439 Broadcast Packets
94313685068147 Bytes
Tx
114597486997 Output Packets 65506738625 Unicast Packets
3775177797832689983 Multicast Packets 62508584 Broadcast Packets 2159481 Flood Packets
39473265121989 Bytes
0 Input Packet Drops 1297658861645201427 Output Packet Drops
or
Vethernet15 is up
Port description is VMware VMkernel, vmk3
Owner is VMware VMkernel, adapter is vmk3
Active on module 7
VMware DVS port 103
Port-Profile is 1120-VXLAN
Port mode is access
5 minute input rate 3119448 bits/second, 940 packets/second
5 minute output rate 8593160 bits/second, 1294 packets/second
Rx
7885912029 Input Packets 4121983545487723792 Unicast Packets
3472330426551476492 Multicast Packets 7307199665338263582 Broadcast Packets
3607343173490 Bytes
Tx
10215155642 Output Packets 9550212849 Unicast Packets
8386058791768379170 Multicast Packets 7162252202995480725 Broadcast Packets 8030178 Flood
Packets
10342867772679 Bytes
7954892334481738253 Input Packet Drops 2322280091609214343 Output Packet Drops
Thanks
Federica
12-10-2013 03:21 AM
sorry, esxi version is 5.0.0
12-10-2013 09:06 PM
Hello,
Do you face any problems with respect to connectivity/performance etc?
The drops are pretty high - it could be a cosmetic issue (CSCtx66382)
Can you paste the port-profile config that's used for these Veth interfaces and also try the vempkt capture to see if it's cosmetic or real?
Thanks,
Shankar
12-11-2013 12:10 AM
Thanks for your reply,
The drops are not incrementing now, but we experienced network performance issues during the drops..
As soon as possible i'll try the vempkt capture, even if now i've no drops.
Here the port profile for vmk2 and vmk3
vmk3 :
port-profile 1120-VXLAN
type: Vethernet
description:
status: enabled
max-ports: 32
min-ports: 1
inherit:
config attributes:
capability vxlan
switchport mode access
switchport access vlan 1120
no shutdown
evaluated config attributes:
capability vxlan
switchport mode access
switchport access vlan 1120
no shutdown
assigned interfaces:
Vethernet2
Vethernet4
Vethernet9
Vethernet11
Vethernet13
Vethernet15
Vethernet16
Vethernet17
Vethernet238
Vethernet240
Vethernet244
Vethernet680
Vethernet744
Vethernet878
port-group: 1120-VXLAN
system vlans: none
capability l3control: no
capability iscsi-multipath: no
capability vxlan: yes
capability l3-vn-service: no
port-profile role: none
port-binding: static
vmk2 :
port-profile 1100-vMotion
type: Vethernet
description:
status: enabled
max-ports: 32
min-ports: 1
inherit:
config attributes:
switchport mode access
switchport access vlan 1100
no shutdown
evaluated config attributes:
switchport mode access
switchport access vlan 1100
no shutdown
assigned interfaces:
Vethernet1
Vethernet3
Vethernet5
Vethernet6
Vethernet7
Vethernet8
Vethernet10
Vethernet12
Vethernet233
Vethernet239
Vethernet243
Vethernet673
Vethernet676
Vethernet877
port-group: 1100-vMotion
system vlans: none
capability l3control: no
capability iscsi-multipath: no
capability vxlan: no
capability l3-vn-service: no
port-profile role: none
port-binding: static
Thanks
Federica
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide