NX-OSv dataplane broken?

[Istvan kelemen]

Hello,

I have been trying to test the following failure scenario but I am having issues with basic VXLAN connectivity.

I have tried 3 different versions, but only 7.0 supports VLAN over Peer-Link.

7.0 performance is awful compared to 9.2 and 9.x versions.

Anyhow, the control-plane is up, but the data-plane is broken. MAC addresses are only learned via the vPC port-channel, not NVE interface. I did some packet capture on the transit links, the switch does not even encapsulate the packets except the ARPs are sent out as multicast. Phantom RP (BDIR PIM) is deployed.

I have tried Flood & Learn, Static tunnel and BGP EVPN. Data-plane is always broken.

sh ver
Cisco Nexus Operating System (NX-OS) Software
TAC support: http://www.cisco.com/tac
Documents: http://www.cisco.com/en/US/products/ps9372/tsd_products_support_serie
s_home.html
Copyright (c) 2002-2016, Cisco Systems, Inc. All rights reserved.
The copyrights to certain works contained herein are owned by
other third parties and are used and distributed under license.
Some parts of this software are covered under the GNU Public
License. A copy of the license is available at
http://www.gnu.org/licenses/gpl.html.

NX-OSv9K is a demo version of the Nexus Operating System

Software
BIOS: version
NXOS: version 7.0(3)I5(1)
BIOS compile time:
NXOS image file is: bootflash:///nxos.7.0.3.I5.1.bin
NXOS compile time: 10/29/2016 6:00:00 [10/29/2016 13:46:41]

Hardware
cisco NX-OSv Chassis
Intel(R) Xeon(R) CPU E7- 4870 @ 2.40GHz with 16410060 kB of memory.
Processor Board ID 93JGQ1BCJZ9

Device name: NXv9k9
bootflash: 3509454 kB
Kernel uptime is 0 day(s), 23 hour(s), 29 minute(s), 10 second(s)

Last reset
Reason: Unknown
System version:
Service:

plugin
Core Plugin, Ethernet Plugin

Active Package(s):

[Vinit Jain · Accepted solution]

I dont think the data plane is broken. I do have few questions to begin with:

1. Can you try using static RP's. BIDIR PIM support with VXLAN-EVPN is starting from 9.2(1) release. Refer to below CCO doc. Also, the support is limited to specific hardware. I would recommend try static RP in underlay.

https://www.cisco.com/c/en/us/td/docs/switches/datacenter/pf/configuration/guide/b-pf-configuration/IP-Fabric-Underlay-Options.html

2. what do you see in your nve peers?

- show nve peers

 ++ Do you see remote VTEP IP in nve peers?

Request if you can share the above info. I have been using N9000v image for long time now and havent had much issues.

[Istvan kelemen]

Hello,

Actually I solved the problem that OSPF did not come up on SVI and upgraded to NX-OSv 9.3.1.

I have just realized that the peer-link must be a vSW with all VLANs enabled and finally were able to test if traffic can be rerouted over the peer-link, which it did.

I am having an issue with MC setup, but Static tunnel works well. I am just wondering why the MAC addresses are not learned via the static NVE. (I am comparing NXv with Huawei DC switches).

The next step is to try the same failover scenario with BGP EVPN.

By the way, I noted that NX-OSv 7.x.x  consumes much much more CPU and BGP session packets are continuously retransmitted. V 9.3.1 works better.