Hello everyone.
I have a problem again.
I just set up my HyperV CLuster.
Cluster consists of: 3 HP DL360p G8 each with 2 Intel Xeon 2660 V2 10 Core and 64GB RAM.
Each server has a Mellanox ConnectX3 Dual 10Gbit network card installed and a second 10Gbit dual card (which can not RDMA).
This 10Gbit network(ConnectX3 cards) is connected to a Cisco Nexus 5548up(layer 2) switch.
If I connect 2 servers directly with Twinax cables, RDMA traffic is displayed correctly in perfmon.
So everything is configured correctly on the Windows side.
Only over the switch no RDMA traffic comes about.
Here the COnfig of the switch:
Nexus5K(config)# sh run
!Command: show running-config
!Time: Thu May 26 14:33:49 2022
version 5.0(3)N2(2b)
no feature telnet
no telnet server enable
feature lldp
username admin password 5 $1$BooxXhUp$ffgxsJ6J3PX02R1GDLtgO. role network-admin
no password strength-check
ssh key rsa 2048
ip domain-lookup
switchname Nexus5K
class-map type qos class-fcoe
class-map type qos match-all roce
match cos 5
class-map type queuing roce
match qos-group 5
class-map type queuing class-fcoe
match qos-group 1
class-map type queuing class-all-flood
match qos-group 2
class-map type queuing class-ip-multicast
match qos-group 2
policy-map type qos roce
class roce
set qos-group 5
class class-fcoe
set qos-group 1
policy-map type queuing roce
class type queuing roce
bandwidth percent 70
class type queuing class-fcoe
bandwidth percent 20
class type queuing class-default
bandwidth percent 10
class-map type network-qos roce
match qos-group 5
class-map type network-qos class-fcoe
match qos-group 1
class-map type network-qos class-all-flood
match qos-group 2
class-map type network-qos class-ip-multicast
match qos-group 2
policy-map type network-qos roce
class type network-qos roce
pause no-drop
mtu 9000
class type network-qos class-fcoe
pause no-drop
mtu 2158
class type network-qos class-default
mtu 9216
multicast-optimize
system qos
service-policy type qos input roce
service-policy type queuing input roce
service-policy type queuing output roce
service-policy type network-qos roce
snmp-server user admin network-admin auth md5 0xdf70cfdc76ddb562a87e519c32757594
priv 0xdf70cfdc76ddb562a87e519c32757594 localizedkey
rmon event 1 log description FATAL(1) owner PMON@FATAL
rmon event 2 log description CRITICAL(2) owner PMON@CRITICAL
rmon event 3 log description ERROR(3) owner PMON@ERROR
rmon event 4 log description WARNING(4) owner PMON@WARNING
rmon event 5 log description INFORMATION(5) owner PMON@INFO
snmp-server community Nexus group network-operator
vrf context management
vlan 1
vlan 200
name Stotage1
vlan 300
name Storage2
interface Ethernet1/1
priority-flow-control mode on
switchport access vlan 200
interface Ethernet1/2
priority-flow-control mode on
switchport access vlan 300
interface Ethernet1/3
priority-flow-control mode on
switchport access vlan 200
interface Ethernet1/4
priority-flow-control mode on
switchport access vlan 300
interface Ethernet1/5
priority-flow-control mode on
switchport access vlan 200
interface Ethernet1/6
priority-flow-control mode on
switchport access vlan 300
interface Ethernet1/7
interface Ethernet1/8
interface Ethernet1/9
interface Ethernet1/10
interface Ethernet1/11
interface Ethernet1/12
interface Ethernet1/13
interface Ethernet1/14
interface Ethernet1/15
interface Ethernet1/16
interface Ethernet1/17
interface Ethernet1/18
interface Ethernet1/19
interface Ethernet1/20
interface Ethernet1/21
interface Ethernet1/22
interface Ethernet1/23
interface Ethernet1/24
interface Ethernet1/25
interface Ethernet1/26
interface Ethernet1/27
interface Ethernet1/28
interface Ethernet1/29
interface Ethernet1/30
interface Ethernet1/31
interface Ethernet1/32
interface mgmt0
vrf member management
line console
line vty
boot kickstart bootflash:/n5000-uk9-kickstart.5.0.3.N2.2b.bin
boot system bootflash:/n5000-uk9.5.0.3.N2.2b.bin
Nexus5K(config)#can someone help pls?
