Inter VLAN routing on N5548P without L3 Daughter Cards

davidespeso · ‎06-02-2013

Hi,

I have a DC topology based on 2 layers, access and aggregation, based on 2 pairs of N5548Ps, both without L3 Daugher Cards. My intent is to use the aggregation N5K pair as L3 inter VLAN layer, so I configured all the VLAN default GWs there. The 2 layers are interconnected via vPC, in a double-sided vPC topology for some N2Ks and some vSwitches.

The point is that, despite connecitivity is working fairly ok, for some applications, like file transfer via either FTP or HTTP, between hosts in different VLANs, the performance is too poor. The file transfer starts ok, but after a while it becomes lower and lower. ICMP is working, but I can see some strange random behaviour, like having some packets taking more that 20 ms (sometimes 40 or more), whilst average is 2 ms.

I read through some articles saying that until you don´t have the L3 license (the one coming with L3 Daughter Cards) you can expect some weird behaviour on L3 level. Is that true?. What can I do apart of purchasing L3 Daughter Cards?. Can I enable L3 Basic license at the moment (I don´t need dynamic routing for now).

Here some excerpts of what I´m saying:

PING results:

10000 packets transmitted, 10000 packets received, 0.00% packet loss

round-trip min/avg/max = 0.809/2.496/57.559 ms

System version: 5.0(3)N2(1)

License and features on the N5Ks:

switch# sho license usage

Feature Ins Lic Status Expiry Date Comments

Count

--------------------------------------------------------------------------------

FCOE_NPV_PKG No - Unused -

FM_SERVER_PKG No - Unused -

ENTERPRISE_PKG No - Unused -

FC_FEATURES_PKG No - Unused -

LAN_BASE_SERVICES_PKG No - Unused -

LAN_ENTERPRISE_SERVICES_PKG No - Unused -

--------------------------------------------------------------------------------

switch#

switch# sho feature

Feature Name Instance State

-------------------- -------- --------

Flexlink 1 disabled

adapter-fex 1 disabled

bgp 1 disabled

dhcp 1 disabled

eigrp 1 disabled

eigrp 2 disabled

eigrp 3 disabled

eigrp 4 disabled

fcoe 1 disabled

fcoe-npv 1 disabled

fex 1 enabled

hsrp_engine 1 enabled

interface-vlan 1 enabled

lacp 1 enabled

ldap 1 disabled

lldp 1 enabled

msdp 1 disabled

ospf 1 disabled

ospf 2 disabled

ospf 3 disabled

ospf 4 disabled

pim 1 disabled

poe 1 disabled

private-vlan 1 disabled

privilege 1 disabled

rip 1 disabled

rip 2 disabled

rip 3 disabled

rip 4 disabled

sshServer 1 enabled

tacacs 1 enabled

telnetServer 1 enabled

udld 1 disabled

vem 1 disabled

vpc 1 enabled

vrrp 1 disabled

vtp 1 disabled

switch#

and modules installed:

switch# sho module

Mod Ports Module-Type Model Status

--- ----- -------------------------------- ---------------------- ------------

1 32 O2 32X10GE/Modular Supervisor N5K-C5548P-SUP active *

3 0 O2 Non L3 Daughter Card N55-DL2 ok

Mod Sw Hw World-Wide-Name(s) (WWN)

--- -------------- ------ --------------------------------------------------

1 5.0(3)N2(1) 1.0 --

3 5.0(3)N2(1) 1.0 --

Mod MAC-Address(es) Serial-Num

--- -------------------------------------- ----------

1 547f.ee2d.e968 to 547f.ee2d.e987 FOC15370EGJ

3 0000.0000.0000 to 0000.0000.000f FOC153858PB

switch#

Thanks in advance

Reza Sharifi · ‎06-02-2013

Hi,

If you need to do inter-vlan routing with SVI (layer-3 functions) on your switches, you need daughter cards.

The 5Ks without daughter cards are just layer-2.

HTH

Leo Laohoo · ‎06-02-2013

You need a Layer 3 daughter card and activate the complimentary layer 3 license that comes with it.

Otherwise, you'll need another appliance to do the layer 3 for you, like another layer 3 switch or a router.

davidespeso · ‎06-02-2013

Hi, thanks both of you for your swift answer.

The point is that there is connectivity inter-vlan but performance is not as good as desired. Looking at your answers it looks like a matter of no grey room for it, so if not having the cards, then you cannot do any inter-vlan communication, but the fact is that packets go across different VLANs, but with some misbehaviour.

When reading Cisco Support pages, it seems it is possible to do it with the basic license LAN_BASE_SERVICES_PKG. It´s also very weird that in on of the access switches I do have that license enabled, whilst being pure L2 switch not having L3 Daughter card:

switch# sho licens

license_SSI1543064Q_17.lic:

SERVER this_host ANY

VENDOR cisco

INCREMENT LAN_BASE_SERVICES_PKG cisco 1.0 permanent uncounted \

VENDOR_STRING=MDS HOSTID=VDH=SSI1543064Q \

NOTICE=201201301947550001N5K-C

5548P-BUNSSI1543064Q \

SIGN=887B7F66FDC2

INCREMENT LAN_ENTERPRISE_SERVICES_PKG cisco 1.0 permanent uncounted \

VENDOR_STRING=MDS HOSTID=VDH=SSI1543064Q \

NOTICE=201201301947550002N5K-C

5548P-BUNSSI1543064Q \

SIGN=2D07F1B64BD0

switch# sho licens usage

Feature Ins Lic Status Expiry Date Comments

Count

--------------------------------------------------------------------------------

FCOE_NPV_PKG No - Unused -

FM_SERVER_PKG No - Unused -

ENTERPRISE_PKG No - Unused -

FC_FEATURES_PKG No - Unused -

LAN_BASE_SERVICES_PKG Yes - In use Never -

LAN_ENTERPRISE_SERVICES_PKG Yes - Unused Never -

--------------------------------------------------------------------------------

switch#

Thanks!

Ahmed Elnagar · ‎12-12-2013

Hello;

Did you figure out what was the problem? all documents says it is okay to configure it without any need for additional license or the L3 DC...any updates you have?

Leo Laohoo · ‎12-12-2013

The Nexus 5K is originally a Layer 2 appliance. So aside from a Layer 3 daughter card or line card, yuo need something to do the Layer 3 functions externally like a Layer 3 switch or a router.

If in doubt, you can always raise a Cisco TAC Case.

arikawahyono · ‎12-25-2013

you case just like me,

https://supportforums.cisco.com/message/4075217#4075217