01-21-2019 07:07 PM
Existing scenario - UCS FI - 2Nos connected to 2 MDS 9148 with 4-4 ports on each devices with different vsan. Working properly
New Scenario - I have replaced one MDS 9148s and connect same ports and port channel configuration with one FI.
The MDS Ports status - not connected
FI Port status - ErrDisabled
Tried - shutdown/ not shut on both the devices. SFPs are working on new device. Same cables I am using and FC cables are ok. I have nothing changed on FI side. Only I replaced MDS 9148s as new device. Configuration same on both new and old device. I have checked multiple times and line to line.
Enabled
feature npiv
feature fport-channel-trunk
Moreover, tried to place old mds 9148 on that ports, it is working, but on new device 9148s it is not working.
MDS 9148 - Sw version 5.2
MDS 9148s - SW version 8.2
MDS 9148s port channel configuration
int fc1/21-24
switchport rate-mode dedicated
switchport trunk mode off
port-license acquire
channel-group 21 force
no shutdown
interface port-channel 21
channel mode active
switchport mode F
switchport rate-mode dedicated
switchport trunk mode off
01-22-2019 07:13 AM
Have you determined what kind of error is provoking the ErrDisable condition?
- Shut all the portchannel ports to UCS.
- "clear counters interface all" on 9148 and UCS FI
- No shut the portchannel port
- Inspect "show interface fc x/y details"
Typically errdisable is low-level physical link issue: CRCs, ITWs, fillword setting
(Ensure you are using OM3 or new cable.)
Is the old 9148 the 8Gb model and you are moving to the 16Gb MDS 9148S?
01-22-2019 09:17 PM
- Shut all the portchannel ports to UCS. - CHECKED
- "clear counters interface all" on 9148 and UCS FI - CHECKED
- No shut the portchannel port - CHECKED
- Inspect "show interface fc x/y details" ---not connected, down
Typically errdisable is low-level physical link issue: CRCs, ITWs, fillword setting
(Ensure you are using OM3 or new cable.) ----- same cable is working on 9148.
MDS 9148 - 8 Gbps
MDS 9148s - tried 8 Gbps as well as 16 Gbps
01-23-2019 06:05 AM
After shutting portchannel ports to UCS, clearing counters then doing no shut on portchannel port(s)
what did the show interface detail-counters fc x/y show?? There is a plethora of various counters .
Also did you check the show logging log and show log onboard for events against the fcx/y used
for the UCS to 9148S?
02-04-2019 05:38 PM
Do these links come up as individual links with trunking off without a port-channel?
If yes, you may be hitting the OUI issue where the FI is not recognising the OUI of the new MDS.
Here's how to identify the issue:
SSH into FI and run this command:
- show port internal event-history error
Look for an event that says "non-Cisco switch" for the FC uplink port. If you see this error, it is hitting the OUI issue.
Check the OUI of the MDS with below command:
Get the switch wwn:
- show switch wwn
Check the OUI using the above wwn:
- show fcid-allocation company-id-from-wwn <put the switch wwn here>
check the OUI against below bug:
CSCvk63036 UCS Missing OUI 003a9c, 000831, d0a5a6 -- Prevents FC/FCoE Port-Channel From Forming
Your FI may not be running the fixed version.
02-27-2019 11:25 PM
08-26-2019 05:44 PM
HI! You could share which version you upgraded and what version do the UCS have?
Thanks!
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide