Solved: SAN Port-Channel - No Operational Members

John Early · ‎09-06-2012

I am trying to setup a FC port-channel between a UCS and N5k. Environment is UCS 2.0(3c), 6248s, 5548s, EMC VNX 5300. When I leave the FC uplinks out of the port channel they work fine, no errors and I get successful flogi. When I setup the port-channel on both the UCS and N5k I get "Failed - No Operational Members" error code F0282. Here is the port-channel summary info and port configuration from both the UCS and N5k, both fabric A and fabric B have the same problem, this is the config of only A both are the same.

UCSM-A(nxos)# show san-port-channel sum

U-Up D-Down B-Hot-standby S-Suspended I-Individual link

summary header
--------------------------------------------------------------------------------
Group Port-      Type     Protocol Member Ports
       Channel
--------------------------------------------------------------------------------
121    San-po121            FC      PCP      (D) FC       fc1/31(D)    fc1/32(D)

interface san-port-channel 121

channel mode active

switchport mode NP

interface fc1/31
channel-group 121 force
no shutdown

interface fc1/32
channel-group 121 force
no shutdown

NEXUS-01# show san-port-channel sum

U-Up D-Down B-Hot-standby S-Suspended I-Individual link

summary header
--------------------------------------------------------------------------------
Group Port- Type Protocol Member Ports
Channel
--------------------------------------------------------------------------------

11 San-po11 FC PCP (D) FC fc1/31(D) fc1/32(D)

interface san-port-channel 11

channel mode active

interface fc1/31
channel-group 11 force
no shutdown

interface fc1/32
channel-group 11 force
no shutdown

Thank you for the help!

padramas · ‎09-06-2012

Hello John

Can you verify whether you have enabled fport-channel-trunk on the N5K switch ?

show feature

If not,please enable it by

conf t

feature fport-channel-trunk

Then do a shut / no shut for the port channel interface.

Padma

View solution in original post

padramas · ‎09-06-2012

John,

Can you please paste the output of following commands from FI and N5K

show int san-port-channel 121

show int fc 1/31

show int san-port-channel 11

show int fc 1/31

Padma

sytec · ‎09-06-2012

This is still John, having problems with my CCO account so I borrowed one to post back. Here are the interface outputs:

UCSM-A(nxos)# show int san-port-channel 121
san-port-channel 121 is down (No operational members)
    Hardware is Fibre Channel
    Port WWN is 24:79:54:7f:ee:aa:78:00
    Admin port mode is NP, trunk mode is off
    snmp link state traps are enabled
    Port vsan is 20
    1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
    1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
      331 frames input, 158436 bytes
        7 discards, 0 errors
        0 CRC, 0 unknown class
        0 too long, 0 too short
      322 frames output, 18140 bytes
        0 discards, 0 errors
      3 input OLS, 3 LRR, 3 NOS, 0 loop inits
      7 output OLS, 3 LRR, 5 NOS, 0 loop inits
    last clearing of "show interface" counters never
    Member[1] : fc1/31
    Member[2] : fc1/32

UCSM-A(nxos)# show int fc 1/31
fc1/31 is down (Link failure or not-connected)
    Hardware is Fibre Channel, SFP is short wave laser w/o OFC (SN)
    Port WWN is 20:1f:54:7f:ee:aa:78:00
    Admin port mode is NP, trunk mode is off
    snmp link state traps are enabled
    Port vsan is 20
    Receive data field Size is 2112
    Beacon is turned off
    Belongs to san-port-channel 121
    1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
    1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
      328 frames input, 158016 bytes
        5 discards, 0 errors
        0 CRC, 0 unknown class
        0 too long, 0 too short
      320 frames output, 17852 bytes
        0 discards, 0 errors
      2 input OLS, 2 LRR, 2 NOS, 0 loop inits
      5 output OLS, 2 LRR, 3 NOS, 0 loop inits
    last clearing of "show interface" counters never
    Interface last changed at Thu Sep 6 08:50:09 2012

UCSM-A(nxos)# show int fc 1/32
fc1/32 is down (Link failure or not-connected)
    Hardware is Fibre Channel, SFP is short wave laser w/o OFC (SN)
    Port WWN is 20:20:54:7f:ee:aa:78:00
    Admin port mode is NP, trunk mode is off
    snmp link state traps are enabled
    Port vsan is 20
    Receive data field Size is 2112
    Beacon is turned off
    Belongs to san-port-channel 121
    1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
    1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
      343 frames input, 159156 bytes
        6 discards, 0 errors
        0 CRC, 0 unknown class
        0 too long, 0 too short
      333 frames output, 18744 bytes
        0 discards, 0 errors
      2 input OLS, 2 LRR, 2 NOS, 0 loop inits
      4 output OLS, 1 LRR, 2 NOS, 0 loop inits
    last clearing of "show interface" counters never
    Interface last changed at Thu Sep 6 08:50:10 2012

NEXUS-01# show interface san-port-channel 11
san-port-channel 11 is down (No operational members)
    Hardware is Fibre Channel
    Port WWN is 24:0b:54:7f:ee:65:be:c0
    Admin port mode is auto, trunk mode is on
    snmp link state traps are enabled
    Port vsan is 20
    1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
    1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
      971 frames input, 55612 bytes
        0 discards, 0 errors
        0 CRC, 0 unknown class
        0 too long, 0 too short
      1029 frames output, 489688 bytes
        0 discards, 0 errors
      15 input OLS, 5 LRR, 493 NOS, 0 loop inits
      73 output OLS, 16 LRR, 485 NOS, 0 loop inits
    last clearing of "show interface" counters never
    Member[1] : fc1/31
    Member[2] : fc1/32

NEXUS-01# show int fc 1/31
fc1/31 is down (Error disabled - Possible port channel misconfiguration)
    Hardware is Fibre Channel, SFP is short wave laser w/o OFC (SN)
    Port WWN is 20:1f:54:7f:ee:65:be:c0
    Admin port mode is auto, trunk mode is on
    snmp link state traps are enabled
    Port vsan is 20
    Receive data field Size is 2112
    Beacon is turned off
    Belongs to san-port-channel 11
    1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
    1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
      969 frames input, 55324 bytes
        0 discards, 0 errors
        0 CRC, 0 unknown class
        0 too long, 0 too short
      1027 frames output, 489400 bytes
        0 discards, 0 errors
      14 input OLS, 4 LRR, 449 NOS, 0 loop inits
      67 output OLS, 16 LRR, 443 NOS, 0 loop inits
    last clearing of "show interface" counters never
    Interface last changed at Fri Aug 14 12:38:22 2009

NEXUS-01# show int fc 1/32
fc1/32 is down (Error disabled - Possible port channel misconfiguration)
    Hardware is Fibre Channel, SFP is short wave laser w/o OFC (SN)
    Port WWN is 20:20:54:7f:ee:65:be:c0
    Admin port mode is auto, trunk mode is on
    snmp link state traps are enabled
    Port vsan is 20
    Receive data field Size is 2112
    Beacon is turned off
    Belongs to san-port-channel 11
    1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
    1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
      978 frames input, 55840 bytes
        0 discards, 0 errors
        0 CRC, 0 unknown class
        0 too long, 0 too short
      1037 frames output, 489600 bytes
        0 discards, 0 errors
      11 input OLS, 3 LRR, 463 NOS, 0 loop inits
      65 output OLS, 15 LRR, 458 NOS, 0 loop inits
    last clearing of "show interface" counters never
    Interface last changed at Fri Aug 14 12:38:23 2009

Thanks,

-

John

padramas · ‎09-06-2012

Hello John

Can you verify whether you have enabled fport-channel-trunk on the N5K switch ?

show feature

If not,please enable it by

conf t

feature fport-channel-trunk

Then do a shut / no shut for the port channel interface.

Padma

sytec · ‎09-06-2012

feature fport-channel-trunk is not enabled. Is there any loss of connectivity when this is enabled??

Thanks,

John

padramas · ‎09-06-2012

John,

Enabling fport-channel-trunk feature does not affect any existing traffic.

It is required to form port-channel between FI ( NPV with NP ports ) and N5K ( NPIV switch with F ports )

HTH

Padma

John Early · ‎09-06-2012

Finally got my CCO account working again...

I will enable this feature and report back if it worked or not.

Thanks,

John

John Early · ‎09-10-2012

Had to wait for a maintenance window to enable the feature just to be on the safe side. Once enabled I bounced the ports on each side and everything is up and running now.

Thank you for the help!