Enbaling jumbo frmaes on fex's connected 7k and 5k

[mehtarahul1998]

Hi ,

We are getting frequent disconnects on the VM's in our environment ,The issue has been suspected  due  high I/O 's to iscsi targets and could be buffer problem on N2K-C2232PP-10GE ,We don't have Jumbo frames enabled on  Esxi host connected to fex's ,if I need to enable the jumbo frmaes I understand I need to modify the network qos which is enabled by default ,Can you please let me know do I need to modify the existing policy  to support jumbo frames .

In addition we would be marking the traffic for iSCSI as Cos2 as data and storage traffic is flowing over same trunk links .

Below is existing policies.

eu-ukenf-dct-sds01a# sh policy-map

  Type qos policy-maps
  ====================

  policy-map type qos default-in-policy
    class type qos class-default
      set qos-group 0
  policy-map type qos fcoe-default-in-policy
    class type qos class-fcoe
      set qos-group 1
    class type qos class-default
      set qos-group 0

  Type queuing policy-maps
  ========================

  policy-map type queuing default-in-policy
    class type queuing class-default
      bandwidth percent 100
  policy-map type queuing default-out-policy
    class type queuing class-default
      bandwidth percent 100
  policy-map type queuing fcoe-default-in-policy
    class type queuing class-fcoe
      bandwidth percent 50
    class type queuing class-default
      bandwidth percent 50
  policy-map type queuing fcoe-default-out-policy
    class type queuing class-fcoe
      bandwidth percent 50
    class type queuing class-default
      bandwidth percent 50

  Type network-qos policy-maps
  ===============================

  policy-map type network-qos default-nq-policy
    class type network-qos class-default

      mtu 1500
      multicast-optimize
  policy-map type network-qos fcoe-default-nq-policy
    class type network-qos class-fcoe

      pause no-drop
      mtu 2158
    class type network-qos class-default

      mtu 1500
      multicast-optimize

[Mark Malone]

This is the way we have it done on our ESX 5Ks and it works fine

policy-map type network-qos jumbo
  class type network-qos class-default
    mtu 9216
    multicast-optimize
system qos
  service-policy type network-qos jumbo

[mehtarahul1998]

but jumbo frames are showing me are enabled by default sh interface Eth101/1/1 counters detailed
Ethernet101/1/1
  Rx Packets:                                   333306820
  Rx Unicast Packets:                           327641635
  Rx Multicast Packets:                            679915
  Rx Broadcast Packets:                           4985270
  Rx Jumbo Packets:                              97768119
  Rx Bytes:                                  193168562711
  Rx Packets from 0 to 64 bytes:                    12469
  Rx Packets from 65 to 127 bytes:              131419723
  Rx Packets from 128 to 255 bytes:              63123032
  Rx Packets from 256 to 511 bytes:              23143648
  Rx Packets from 512 to 1023 bytes:             12511868
  Rx Packets from 1024 to 1518 bytes:             5327961
  Rx Trunk Packets:                             333306814
  Tx Packets:                                  1222053874
  Tx Unicast Packets:                           519895698
  Tx Multicast Packets:                         190532736
  Tx Broadcast Packets:                         511625440
  Tx Jumbo Packets:                             306462669
  Tx Bytes:                                  596372603288
  Tx Packets from 0 to 64 bytes:                  6648341
  Tx Packets from 65 to 127 bytes:              698226784
  Tx Packets from 128 to 255 bytes:             134140991
  Tx Packets from 256 to 511 bytes:              33150335
  Tx Packets from 512 to 1023 bytes:             27435533
  Tx Packets from 1024 to 1518 bytes:            15989221
  Tx Trunk Packets:                            1221541403

Also if I need to enable jumbo and trust the traffic from ESXI for iscsi as Cos 2 ,will below config will be fine ,as we cannot delete FCOE class map so I will create the new class-maps and apply

class-map type network-qos match-any class-iscsi
match cos 2

 policy-map type network-qos iscsi-default-nq-policy
    class type network-qos class-iscsi

      pause no-drop
      mtu 9216
     class type network-qos class-default

      mtu 1500
      multicast-optimize

system qos

service-policy type iscsi-default-nq-policy

[mehtarahul1998]

Also on nexus 5k do I need to set the qos group to my incoming markings -Cos 2 and then need to call the qos group in the policy map or this can be directly applied as below

class-map type network-qos match-any class-iscsi
match cos 2

 policy-map type network-qos iscsi-default-nq-policy
    class type network-qos class-iscsi

      pause no-drop
      mtu 9216
     class type network-qos class-default

      mtu 1500
      multicast-optimize