IOM connecting FI error - Fabric unsupported connection

[KS Lim]

Hi Guys,

Not sure if anyone face the same scenario with me.

I have a B series Chassis with two IOM card ( model : 2208XP) which is 8 external port / 10Gb.

while the bundle come with 8 10Gbase-CU cables, I connect the first 4 port on IOM-1 to Fi-A and first 4 port on IOM-2 to FI-B

IOM1      FI-A

1               Port 1

2               Port 2

3               Port 3

4               Port 4

IOM2      FI-B

1               Port 1

2               Port 2

3               Port 3

4               Port 4

However base on my observation the server port role works fine on IOM1 - FI-A

on IOM 2 we can only see fabric 2/1 to 2/3 ( 3 link) while the Led light on 2/4 is up but not shown in UCS manager.

There is also a major error message :

iom1/2 current connectivity does not match discovery policy or connectivity is unsupported

I also tried to access NXOS in the FI and notice that the port is up, show port-channel summary tell me 4 port channel are up.

Please refer to the attachment for screenshot.

[padramas]

Hello,

Please provide the following output

connect nxos b

show fex

show int fex

show run int eth 1/23 - 25

If they are not in production, can you try re-acknowledging the chassis ?

Padma

[Manuel Velasco]

Hi Ks,

How are you? Did you make sure port 26 (or the fourth port )on fabric B is configure as server port?  If you configured it as an uplink or something else and there is a link between them the port is going to show as UP, so make sure it is a server port.

The reason you are getting the error message is because you have ports that are un acknowledge (see ucsiom.jpg) to resolve this issue you have  to re-ack your chassis.  I recommend that before you re-ack your chassis you make sure that all ports are configure properly.  Otherwise you may have to re-ack the chassis multiple times. When you re-ack you chassis, it will bring the connectivity down for some time, so make sure to schedule a maintenance window during this time.

Please try this and let me know if it helps.

[sperezoplk]

Hi Manuel. I'm facing the same problem, only one question for you.  What exactly does a reack of the chassis? It will reboot all the server in the chassis? The only thing that will be affected is the connectivity?

Best regards.

[Manuel Velasco]

Hi Samuel,

The re-ack of the chassis does not reboot the servers in the chassis it will only bring donw the connectivity of the servers for sometime.

[sperezoplk]

thanks for the replky Manuel, can you tell for how long the downtime will be?

[Manuel Velasco]

Hi Samuel,

I don’t have specific numbers but it should be down for a short time.

[Manuel Velasco]

Hi Ks,

I was just wondering if you were able to try what we proposed.

[KS Lim]

Hi Manuel,

sorry for the late response. I tried to re-ack the chassis multiple time but not help.

Not sure why the fourth port is not able to configured into fex mode, although it is serverport in UCSM

UCS-FABRIC-A-B(nxos)# show fex

  FEX         FEX           FEX                       FEX              

Number    Description      State            Model            Serial    

------------------------------------------------------------------------

  1        FEX0001                Online           N20-C6508   FCH17327EPD

UCS-FABRIC-A-B(nxos)#

UCS-FABRIC-A-B(nxos)# show int fex

     Fabric      Fabric       Fex                FEX          

Fex  Port      Port State    Uplink    Model         Serial   

---------------------------------------------------------------

  1   Eth1/23        Active     1         N20-C6508  FCH17327EPD

  1   Eth1/24        Active     2         N20-C6508  FCH17327EPD

  1   Eth1/25        Active     3         N20-C6508  FCH17327EPD

UCS-FABRIC-A-B(nxos)#

UCS-FABRIC-A-B(nxos)# show run int eth 1/23 - 26

!Command: show running-config interface Ethernet1/23-26

!Time: Wed Jan  8 03:27:19 2014

version 5.0(3)N2(2.11.3a)

interface Ethernet1/23

  description S: Server

  no pinning server sticky

  switchport mode fex-fabric

  fex associate 1 chassis-serial FOX1734GBBQ module-serial FCH17327EPD module-slot right

  no shutdown

interface Ethernet1/24

  description S: Server

  no pinning server sticky

  switchport mode fex-fabric

  fex associate 1 chassis-serial FOX1734GBBQ module-serial FCH17327EPD module-slot right

  no shutdown

interface Ethernet1/25

  description S: Server

  no pinning server sticky

  switchport mode fex-fabric

  fex associate 1 chassis-serial FOX1734GBBQ module-serial FCH17327EPD module-slot right

  no shutdown

interface Ethernet1/26

  description S: Server

  no pinning server sticky

  switchport mode trunk

  no shutdown

UCS-FABRIC-A-B(nxos)#