Hi all,
We are experiencing slowness in our storage network (higher latency).
I have checked the network and there is a visible issue on the switches.
There is a lot of RX_WT_AVG_B2B_ZERO errors on the edge links and the uplink also.
edgeswitch#sh logging onboard err
--------------------------------------------------------------------------------
ERROR STATISTICS INFORMATION FOR DEVICE ID 127 DEVICE Sabre-fcp
--------------------------------------------------------------------------------
Interface | | | Time Stamp
Range | Error Stat Counter Name | Count |MM/DD/YY HH:MM:SS
| | |
--------------------------------------------------------------------------------
fc1/3 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |2093 |09/16/16 10:11:07
fc1/10 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |5468 |09/16/16 10:07:57
fc1/34 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |4122 |09/16/16 10:05:27
fc1/34 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |4121 |09/16/16 09:54:47
fc1/7 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |649 |09/16/16 09:38:57
fc1/5 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |780 |09/16/16 09:31:07
fc1/15 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |5379 |09/16/16 09:09:06
fc1/1 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |2323 |09/16/16 08:28:56
fc1/5 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |779 |09/16/16 08:28:46
fc1/34 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |4120 |09/16/16 08:19:16
fc1/29 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |4420 |09/16/16 08:18:16
fc1/7 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |648 |09/16/16 07:28:56
fc1/7 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |647 |09/16/16 07:22:26
Uplink:
edgeswitch# sh logging onboard err | i fc1/47|1/48
fc1/48 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |1642 |09/16/16 06:08:05
fc1/47 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |1124 |09/15/16 08:09:17
fc1/48 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |1641 |09/15/16 00:10:24
fc1/47 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |1123 |09/13/16 23:00:03
fc1/48 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |1640 |09/13/16 05:59:46
fc1/47 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |1122 |09/11/16 13:47:21
fc1/48 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |1639 |09/10/16 11:32:00
fc1/48 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |1638 |09/10/16 10:04:40
fc1/48 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |1637 |09/10/16 05:21:38
fc1/48 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |1636 |09/09/16 23:32:16
fc1/48 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |1635 |09/08/16 22:38:47
fc1/48 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |1634 |09/08/16 16:45:24
fc1/48 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |1633 |09/08/16 13:13:13
fc1/48 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |1632 |09/08/16 04:57:10
fc1/48 |FCP_CNTR_RX_WT_AVG_B2B_ZERO |1631 |09/08/16 04:39:00
edgeswitch# sh int po 142
port-channel142 is trunking
Port description is Uplink to BLUE Fabric Core in 341
Hardware is Fibre Channel
Port WWN is 24:8e:54:7f:ee:e2:97:d8
Admin port mode is E, trunk mode is on
snmp link state traps are enabled
Port mode is TE
Port vsan is 1
Speed is 8 Gbps
admin fec state is down
oper fec state is down
Trunk vsans (admin allowed and active) (100,2040)
Trunk vsans (up) (100,2040)
Trunk vsans (isolated) ()
Trunk vsans (initializing) ()
5 minutes input rate 1131921504 bits/sec,141490188 bytes/sec, 96059 frames/sec
5 minutes output rate 2327582656 bits/sec,290947832 bytes/sec, 173273 frames/sec
5662057717770 frames input,8722269625624360 bytes
0 discards,0 errors
0 invalid CRC/FCS,0 unknown class
0 too long,0 too short
8721141056898 frames output,14700759076476192 bytes
4331 discards,0 errors
0 input OLS,3 LRR,0 NOS,0 loop inits
6 output OLS,9 LRR, 4 NOS, 0 loop inits
Member[1] : fc1/47
Member[2] : fc1/48
Interface last changed at Tue Dec 8 21:08:00 2015
We have 2x4G uplink in ISL, but it looks the max traffic is around 4G (however the over subscription around 13:1)
Switch is Cisco MDS 9148 with 6.2(7)
The core is Cisco MDS 9513 with 6.2(9c).
Could you check and help me what can be the issue in this case please?
or help me how can it be determined?
Thanks in advance.
