Adapter uplink interface link state anavailable

[dkrinitcyn]

Hi to all

I have Blase Chassis 5108 with four blade servers UCS B200 M4. Periodicaly on two servers occurs disconnect of network adapters. UCSM Logs says:

Adapter uplink interface link state anavailable. Please verify connectivity to Fabric Interconnect.

Adapter is unreachable

Ether VIF on server down, reason: error disabled.

I try to re-acknowledge both chassis and servers with no luck. Try the last version of firmware and drivers with no luck.

On servers stands Windows Server 2012 R2. Try to disable "TCP segmentation offload" feature in the adapter policies of the vnic with no luck.

Anybody knows how to fix this? 

Thanks! 

[Walter Dey]

Which UCS version ?

what model of IOM ? 22xx

what model of FI ? 62xx

how many links between IOM and FI ?

what is the Connection policy for IOM uplinks ? 1 ?

Do you use port channel between IOM and FI ?

Does this Problem occur on both fabrics or just one ?

[dkrinitcyn]

Thanks for you answer!

1. 3.1 (1h)
2. 2204xp
3. 6248up
4. 8
5. Global
6. No
7. On both

[Walter Dey]

Hi

I have no Explanation of your Problem.

seems to be related to the links between IOM and FI, or the Chassis backplane.

with 4 servers and 8 links between IOM and FI, without port channel, you are wasting just 50% of the uplink bandwidth.

I would propose

- move blades in another slot, and see if Problem is the same

- create a port channel between IOM and FI (which is best practise)

Walter.

[dkrinitcyn]

Hi

- I tried move blades in another slot and the problem is same

- I tried move blades in another chassis and the problem is same

- I create port channel and the problem is same

I found that adapters became unreachable when on port channel appears FCS and RCV errors. After that I tried to replace DAC Cables but no luck. 

[Walter Dey]

Do you have this enic/fnic driver versions ?

from the interop tool http://www.cisco.com/web/techdoc/ucs/interoperability/matrix/matrix.html

Adapter Driver   = 2.4.0.13 (FNIC) / 3.5.0.13 (ENIC)
Adapter Firmware = 4.1(1)

see also

http://www.cisco.com/c/en/us/td/docs/unified_computing/ucs/release/notes/VIC/2-2/vicdrivers_22_rn.html

[dkrinitcyn]

Yes, I have this versions:

Adapter firmware - 4.1(1d)

ENIC driver - 3.5.0.13

[Walter Dey]

Do I understand you correctly ? 2 out of the 4 W2012 R2 servers are running ok ? and they have exactly the same configuration / drivers.....

If this is the case, and moving blade to another slot and / or chassis didn't solve the problem, I would RMA the adaptor ? which one do you have ?

several vif down issues have been reported in the past:

https://keepingitclassless.net/2014/01/vif-down-issues-with-ucsm-2-21b/

Cisco UCS VIF paths enter error disabled until first use

https://gist.github.com/ozzyjohnson/5e12381bf401e8c0a2ff

http://www.corpicorp.com/ucs-mezzanine-flapping-adapter-host-interface-xyz-link-state-down-error-disabled/