Datatransfer with Nexus 5548UP over two Vlan's very slow

[christianhabermehl]

I have a problem with my Nexus 5548UP.

The data transfer between 2 Vlan's is very slow.
Data transfer in same vlan's is ok.

Have installed a L3 card and a LAN_ENTERPRISE_LICENSE

Inter-Vlan routing works.

See pictures:

Here is a PC in vlan 30 with 10Gbit SFP+ on the Nexus
and the other PC in Vlan 100 on a Catalyst with 1Gbit RJ45

Here is a PC in vlan 30 with 10Gbit SFP+ on the Nexus
and the other PC also in vlan 30 on a Catalyst with 1Gbit RJ45

How can that be??

[Georg Pauwen]

Hello,

so you have a Nexus connected to a Catalyst ? Are the Vlans confined to just one switch ? Where is the inter-Vlan routing configured ?

Post the running configs of both switches.

[christianhabermehl]

The Nexus does the routing and the VLan's are configured on both switches. The Catalyst is in L2 mode.

Config from Nexus:

Nexus5K# sh run

!Command: show running-config
!Time: Sun Jan  9 16:07:04 2022

version 7.3(8)N1(1)
no license grace-period

hostname Nexus5K

no feature telnet
no feature ssh
feature interface-vlan
feature dot1x
feature lldp

username admin password 5 $1$68ClF6Rq$VFkF3uwA.AV9LCf/0toJz.  role network-admin
ip domain-lookup
ip domain-name Nexus
logging event link-status default
snmp-server user admin network-admin auth md5 0xe3023b1b186f1ec23f99f2575a0ff4ce
 priv 0xe3023b1b186f1ec23f99f2575a0ff4ce localizedkey
rmon event 1 log description FATAL(1) owner PMON@FATAL
rmon event 2 log description CRITICAL(2) owner PMON@CRITICAL
rmon event 3 log description ERROR(3) owner PMON@ERROR
rmon event 4 log description WARNING(4) owner PMON@WARNING
rmon event 5 log description INFORMATION(5) owner PMON@INFO

vlan 1
vlan 10
  name Transfer
vlan 20
  name Clients
vlan 30
  name Server
vlan 40
  name iSCSI#1
vlan 50
  name iSCSI#2
vlan 60
  name HEARTBEAT
vlan 70
  name LIVEMIGRATION
vlan 100
 name test
vrf context management
  ip route 0.0.0.0/0 10.58.252.1

interface Vlan1

interface Vlan10
  no shutdown
  ip address 172.16.10.1/24

interface Vlan20
  no shutdown
  ip address 172.16.20.1/24

interface Vlan30
  no shutdown
  ip address 172.16.30.1/24

interface Vlan100
 no shutdown 
 ip address 172.16.100.1/24 


interface Ethernet1/1
  switchport access vlan 40
  description iSCSI#1_Link_1

interface Ethernet1/2
  switchport access vlan 50
 description iSCSI#2_Link_1

interface Ethernet1/3
  switchport access vlan 40
 description iSCSI#1_Link_2

interface Ethernet1/4
  switchport access vlan 50
 description iSCSI#2_Link_2

interface Ethernet1/5
  switchport access vlan 40
 description iSCSI#1_SRV_Link1

interface Ethernet1/6
  switchport access vlan 50
description iSCSI#2_SRV_Link1

interface Ethernet1/7

interface Ethernet1/8
  switchport access vlan 30
 description DCSRV01

interface Ethernet1/9
  shutdown

interface Ethernet1/10
  shutdown

interface Ethernet1/11
  shutdown

interface Ethernet1/12
  switchport access vlan 10
  speed 1000
  description Link_to_ASA

interface Ethernet1/13
  shutdown

interface Ethernet1/14
  shutdown

interface Ethernet1/15
  shutdown

interface Ethernet1/16
  shutdown

interface Ethernet1/17
  shutdown

interface Ethernet1/18
  shutdown
  

interface Ethernet1/19
  shutdown

interface Ethernet1/20
  shutdown

interface Ethernet1/21
  shutdown

interface Ethernet1/22
  shutdown

interface Ethernet1/23
  shutdown

interface Ethernet1/24
  shutdown

interface Ethernet1/25
  shutdown
  
interface Ethernet1/26
  shutdown

interface Ethernet1/27
  shutdown

interface Ethernet1/28
  shutdown

interface Ethernet1/29
  shutdown

interface Ethernet1/30
  shutdown

interface Ethernet1/31
  shutdown

interface Ethernet1/32
  switchport mode trunk
 description Trunk_Link_to_Catalyst

interface mgmt0
  vrf member management
  ip address 10.0.0.2/8
line console
line vty
boot kickstart bootflash:/n5000-uk9-kickstart.7.0.0.N1.1.bin
boot system bootflash:/n5000-uk9.7.0.0.N1.1.bin
poap transit


Nexus5K#

And here the Config from the Catalyst:

Catalyst(config-if)#do sh run
Building configuration...

Current configuration : 4468 bytes
!
! Last configuration change at 00:01:30 UTC Mon Jan 2 2006
!
version 15.2
no service pad
service timestamps debug datetime msec
service timestamps log datetime msec
no service password-encryption
!
hostname Catalyst
!
boot-start-marker
boot-end-marker
!
!
enable secret 5 $1$XwGM$VVKldfkYKesy15hwXhHy60
enable password cisco
!
no aaa new-model
switch 1 provision ws-c3750x-24
system mtu routing 1500
!
!
!
!
!
!
!
ip domain-name Catalyst
!
!
!
!
!
!
crypto pki trustpoint TP-self-signed-286914560
 enrollment selfsigned
 subject-name cn=IOS-Self-Signed-Certificate-286914560
 revocation-check none
 rsakeypair TP-self-signed-286914560
!
!
crypto pki certificate chain TP-self-signed-286914560
 certificate self-signed 01
  30820229 30820192 A0030201 02020101 300D0609 2A864886 F70D0101 05050030
  30312E30 2C060355 04031325 494F532D 53656C66 2D536967 6E65642D 43657274
  69666963 6174652D 32383639 31343536 30301E17 0D303630 31303230 30303134
  305A170D 32303031 30313030 30303030 5A303031 2E302C06 03550403 1325494F
  532D5365 6C662D53 69676E65 642D4365 72746966 69636174 652D3238 36393134
  35363030 819F300D 06092A86 4886F70D 01010105 0003818D 00308189 02818100
  8EBFB062 1A53DAD2 4AB90996 E1CF7A3C 90E9A0CE 5AE00428 5F381EAE 4D47FFF9
  36792D8C 75F871C5 3A244754 C2E42C3E CBC1395E 52332A01 738E5118 89EFCDEC
  D1EB78F8 4D5CA01E CD6D24B3 EAA41B26 68DC9C11 120190F2 906C97C4 610B2FA6
  9B58D782 D67C1E3A 3FAADC2E CC1075C7 6535B8B5 8D6D8EB5 59BD9058 7FF30635
  02030100 01A35330 51300F06 03551D13 0101FF04 05300301 01FF301F 0603551D
  23041830 168014A3 AC066FDB FB5BF3B5 B3B0CEB6 439E2A83 672F7D30 1D060355
  1D0E0416 0414A3AC 066FDBFB 5BF3B5B3 B0CEB643 9E2A8367 2F7D300D 06092A86
  4886F70D 01010505 00038181 004737C2 E1087E21 29707A22 D32797A0 0632CDEC
  3C89F9BD 4919982B DA9E2DD7 5A4BB1DB 99ED29FB 02FF91B4 80AED6C2 84878CB3
  1FDF7F9F 323B5895 05D5DEFF 19A0301F AA2635D1 B253F80D 0A1FADCE EB3D4CC8
  D7596DFA B85A5F17 2FB26B72 B2F9982B 3F50301D 5508FA1D C36BD896 1AAE0171
  D94854C6 096369DE 5C792628 87
        quit
license boot level ipservices
!
!
!
!
spanning-tree mode rapid-pvst
spanning-tree extend system-id
!
!
!
!
vlan internal allocation policy ascending
!
!
!
!
!
!
!
!
!
!
!
!
!
interface FastEthernet0
 no ip address
 no ip route-cache
 shutdown
!
interface GigabitEthernet1/0/1
 switchport access vlan 30
 switchport mode access
 description management_clussrv01
 
!
interface GigabitEthernet1/0/2
 switchport access vlan 30
 switchport mode access
 description management_clussrv02
!
interface GigabitEthernet1/0/3
 switchport access vlan 30
 switchport mode access
 description management_clussrv03
!
interface GigabitEthernet1/0/4
!
interface GigabitEthernet1/0/5
!
interface GigabitEthernet1/0/6
 !
interface GigabitEthernet1/0/7
!
interface GigabitEthernet1/0/8
!
interface GigabitEthernet1/0/9
!
interface GigabitEthernet1/0/10
!
interface GigabitEthernet1/0/11
!
interface GigabitEthernet1/0/12
!
interface GigabitEthernet1/0/13
 switchport access vlan 60
 switchport mode access
 description Heartbeat_srv01
!
interface GigabitEthernet1/0/14
 switchport access vlan 70
 switchport mode access
 description Livemigration_srv01
!
interface GigabitEthernet1/0/15
 switchport access vlan 60
 switchport mode access
 description Heartbeat_srv02
!
interface GigabitEthernet1/0/16
 switchport access vlan 70
 switchport mode access
 description Livemigration_srv02
!
interface GigabitEthernet1/0/17
!
interface GigabitEthernet1/0/18
!
interface GigabitEthernet1/0/19
!
interface GigabitEthernet1/0/20
!
interface GigabitEthernet1/0/21
!
interface GigabitEthernet1/0/22
!
interface GigabitEthernet1/0/23
 switchport access vlan 30
 switchport mode access
 description HyperV_Switch01
!
interface GigabitEthernet1/0/24
 switchport access vlan 30
 switchport mode access
 description HyperV_Switch02
!
interface GigabitEthernet1/1/1
!
interface GigabitEthernet1/1/2
!
interface GigabitEthernet1/1/3
!
interface GigabitEthernet1/1/4
!
interface TenGigabitEthernet1/1/1
 switchport trunk 
 switchport trunk encapsulation dot1q
 description Trunk_Link_to_Nexus
!
interface TenGigabitEthernet1/1/2
!
interface Vlan1
 no ip address
 no ip route-cache
!
ip forward-protocol nd
!
!
ip http server
ip http secure-server
ip ssh pubkey-chain
  username admin
!
!
!
!
!
line con 0
line vty 0 4
 password cisco
 login
line vty 5 15
 password cisco
 login
!
!
end

Catalyst(config-if)#

[christianhabermehl]

For the test I changed between vlan 30 and 100
On the Catalyst
interface GigabitEthernet1/0/1
switchport access vlan 30 or 100

[balaji.bandi]

i would advice make some small network digram show us where end device connected ? also where switches connected ?

Quick observation, i do not see any where interface vlan 100 with IP address ?

So you are testing 10GB - does the PC has 10GB Interface ?

can you post where interface connected  end device :

show interface ethernet x/x

catalyst side

show interface gig 1/0/1

[christianhabermehl]

Sorry, that was a config I had written in another post. Have just adapted them.

The interface is there!

[christianhabermehl]

Everything is configured correctly.

Only the data transfer is very very slow

[balaji.bandi]

Everything is configured correctly.

Then you should get results as expected.

Only the data transfer is very very slow

hence this post here to understand the issue.

When you say ? slow ? what is mean here ? ( the transfer is Megabytes  (interface speed are Megabit) - we need to keep that in mind.

we know the configuraion, we do not know some information, what was asked as below (other post) - to help better i would like to know that information, so we can see where wrong ?

 would advice make some small network digram show us where end device connected ? also where switches connected ?

Quick observation, i do not see any where interface vlan 100 with IP address ?

So you are testing 10GB - does the PC has 10GB Interface ?

can you post where interface connected  end device :
 

show interface ethernet x/x

catalyst side

show interface gig 1/0/1

[christianhabermehl]

If the PCs are in the same vlan, I get 70 to 90 Mbyte/sec. If they are in different vlan's I get only 0.08 MByte/sec

It's easy to see on the pictures.

[balaji.bandi]

we do see that information on the image, we are not sure what test metric used, we can not assume what was the setup and confiogured rather, rather we give assumption advise and see what is wrong.

please post :

show interface ethernet x/x

catalyst side

show interface gig 1/0/1

[christianhabermehl]

[Squozen_EU]

Are you sure the MTU on the Nexus is matching the Catalyst? Not that that  would reduce the traffic to this extent, but worth checking.

[Georg Pauwen]

Hello,

what in your drawing are Cluster1 and Cluster2, what kind of machines are those ?

[christianhabermehl]

It doesn't matter what kind of machines they are.
The fact is that the data transfer from one Vlan to the other does not run at full speed. A data transfer from Vlan 30 to Vlan 30
is transferred with full speed. Exactly the same from Vlan 100 to VLan 100.
It also has nothing to do with the MTU of the Catalyst.
When both PCs are connected to the Nexus, the same problem occurs. So even if the Catalyst is not connected.

[Georg Pauwen]

Hello,

what does 'data transfer' mean in your specific case ? What kind of connection do both machines have (e.g. FTP) ?