Solved: Re: Fex 1 Nexus 2148 to 2 Nexus 5010 problem?

hatv · ‎11-23-2010

hi all

I'm having trouble when fex(ing) 1 nexus 2000 to 2 nexus 5000.

I've configured as dual home from 1 nexus 2k. But after success config, just 1 nexus 5k can see 48 port on it. other cannot see it and it showed as module offline

Here's is results:

N5K-01(config-if)# sh int e1/4 fex-intf

Fabric FEX

Interface Interfaces

---------------------------------------------------

Eth1/4

N5K-01(config-if)#

N5K-02# sh int e1/4 fex-intf

Fabric FEX

Interface Interfaces

---------------------------------------------------

Eth1/4 Eth100/1/48 Eth100/1/47 Eth100/1/46 Eth100/1/45

Eth100/1/44 Eth100/1/43 Eth100/1/42 Eth100/1/41

Eth100/1/40 Eth100/1/39 Eth100/1/38 Eth100/1/37

Eth100/1/36 Eth100/1/35 Eth100/1/34 Eth100/1/33

Eth100/1/32 Eth100/1/31 Eth100/1/30 Eth100/1/29

Eth100/1/28 Eth100/1/27 Eth100/1/26 Eth100/1/25

Eth100/1/24 Eth100/1/23 Eth100/1/22 Eth100/1/21

Eth100/1/20 Eth100/1/19 Eth100/1/18 Eth100/1/17

Eth100/1/16 Eth100/1/15 Eth100/1/14 Eth100/1/13

Eth100/1/12 Eth100/1/11 Eth100/1/10 Eth100/1/9

Eth100/1/8 Eth100/1/7 Eth100/1/6 Eth100/1/5

Eth100/1/4 Eth100/1/3 Eth100/1/2 Eth100/1/1

===============================

N5K-01(config-if)# sh fex 100 detail

FEX: 100 Description: FEX0100 state: Offline

FEX version: 4.1(3)N2(1a) [Switch version: 4.1(3)N2(1a)]

FEX Interim version: 4.1(3)N2(1a)

Switch Interim version: 4.1(3)N2(1a)

Extender Model: N2K-C2148T-1GE, Extender Serial: JAF1405CKHC

Part No: 73-12009-06

Card Id: 70, Mac Addr: 00:0d:ec:fd:48:82, Num Macs: 64

Module Sw Gen: 12594 [Switch Sw Gen: 21]

pinning-mode: static Max-links: 1

Fabric port for control traffic: Eth1/4

Fabric interface state:

Eth1/4 - Interface Up. State: Active

Fex Port State Fabric Port Primary Fabric

Eth100/1/1 Down Eth1/4 Eth1/4

Eth100/1/2 Down Eth1/4 Eth1/4

Eth100/1/3 Down Eth1/4 Eth1/4

Eth100/1/4 Down Eth1/4 Eth1/4

Eth100/1/5 Down Eth1/4 Eth1/4

Eth100/1/6 Down Eth1/4 Eth1/4

Eth100/1/7 Down Eth1/4 Eth1/4

Eth100/1/8 Down Eth1/4 Eth1/4

Eth100/1/9 Down Eth1/4 Eth1/4

Eth100/1/10 Down Eth1/4 Eth1/4

Eth100/1/11 Down Eth1/4 Eth1/4

Eth100/1/12 Down Eth1/4 Eth1/4

Eth100/1/13 Down Eth1/4 Eth1/4

Eth100/1/14 Down Eth1/4 Eth1/4

Eth100/1/15 Down Eth1/4 Eth1/4

Eth100/1/16 Down Eth1/4 Eth1/4

Eth100/1/17 Down Eth1/4 Eth1/4

Eth100/1/18 Down Eth1/4 Eth1/4

Eth100/1/19 Down Eth1/4 Eth1/4

Eth100/1/20 Down Eth1/4 Eth1/4

Eth100/1/21 Down Eth1/4 Eth1/4

Eth100/1/22 Down Eth1/4 Eth1/4

Eth100/1/23 Down Eth1/4 Eth1/4

Eth100/1/24 Down Eth1/4 Eth1/4

Eth100/1/25 Down Eth1/4 Eth1/4

Eth100/1/26 Down Eth1/4 Eth1/4

Eth100/1/27 Down Eth1/4 Eth1/4

Eth100/1/28 Down Eth1/4 Eth1/4

Eth100/1/29 Down Eth1/4 Eth1/4

Eth100/1/30 Down Eth1/4 Eth1/4

Eth100/1/31 Down Eth1/4 Eth1/4

Eth100/1/32 Down Eth1/4 Eth1/4

Eth100/1/33 Down Eth1/4 Eth1/4

Eth100/1/34 Down Eth1/4 Eth1/4

Eth100/1/35 Down Eth1/4 Eth1/4

Eth100/1/36 Down Eth1/4 Eth1/4

Eth100/1/37 Down Eth1/4 Eth1/4

Eth100/1/38 Down Eth1/4 Eth1/4

Eth100/1/39 Down Eth1/4 Eth1/4

Eth100/1/40 Down Eth1/4 Eth1/4

Eth100/1/41 Down Eth1/4 Eth1/4

Eth100/1/42 Down Eth1/4 Eth1/4

Eth100/1/43 Down Eth1/4 Eth1/4

Eth100/1/44 Down Eth1/4 Eth1/4

Eth100/1/45 Down Eth1/4 Eth1/4

Eth100/1/46 Down Eth1/4 Eth1/4

Eth100/1/47 Down Eth1/4 Eth1/4

Eth100/1/48 Down Eth1/4 Eth1/4

Logs:

[11/24/2010 03:16:20.624283] Module register received

[11/24/2010 03:16:20.627639] Registration response sent

[11/24/2010 03:16:21.115021] Module Online Sequence

[11/24/2010 03:16:22.379395] Module Online

[11/24/2010 03:52:09.779773] Module disconnected

[11/24/2010 03:52:09.781691] Offlining Module

[11/24/2010 03:52:09.782231] Module Offline Sequence

[11/24/2010 03:52:11.735462] Module Offline

[11/24/2010 04:06:25.258659] Module disconnected

[11/24/2010 04:06:25.259890] Offlining Module

=================

N5K-02# sh fex 100 detail

FEX: 100 Description: FEX0100 state: Online

FEX version: 4.1(3)N2(1a) [Switch version: 4.1(3)N2(1a)]

FEX Interim version: 4.1(3)N2(1a)

Switch Interim version: 4.1(3)N2(1a)

Extender Model: N2K-C2148T-1GE, Extender Serial: JAF1405CKHC

Part No: 73-12009-06

Card Id: 70, Mac Addr: 00:0d:ec:fd:48:82, Num Macs: 64

Module Sw Gen: 12594 [Switch Sw Gen: 21]

pinning-mode: static Max-links: 1

Fabric port for control traffic: Eth1/4

Fabric interface state:

Eth1/4 - Interface Up. State: Active

Fex Port State Fabric Port Primary Fabric

Eth100/1/1 Down Eth1/4 Eth1/4

Eth100/1/2 Down Eth1/4 Eth1/4

Eth100/1/3 Down Eth1/4 Eth1/4

Eth100/1/4 Down Eth1/4 Eth1/4

Eth100/1/5 Down Eth1/4 Eth1/4

Eth100/1/6 Down Eth1/4 Eth1/4

Eth100/1/7 Down Eth1/4 Eth1/4

Eth100/1/8 Down Eth1/4 Eth1/4

Eth100/1/9 Down Eth1/4 Eth1/4

Eth100/1/10 Down Eth1/4 Eth1/4

Eth100/1/11 Down Eth1/4 Eth1/4

Eth100/1/12 Down Eth1/4 Eth1/4

Eth100/1/13 Down Eth1/4 Eth1/4

Eth100/1/14 Down Eth1/4 Eth1/4

Eth100/1/15 Down Eth1/4 Eth1/4

Eth100/1/16 Down Eth1/4 Eth1/4

Eth100/1/17 Down Eth1/4 Eth1/4

Eth100/1/18 Down Eth1/4 Eth1/4

Eth100/1/19 Down Eth1/4 Eth1/4

Eth100/1/20 Down Eth1/4 Eth1/4

Eth100/1/21 Down Eth1/4 Eth1/4

Eth100/1/22 Down Eth1/4 Eth1/4

Eth100/1/23 Down Eth1/4 Eth1/4

Eth100/1/24 Down Eth1/4 Eth1/4

Eth100/1/25 Down Eth1/4 Eth1/4

Eth100/1/26 Down Eth1/4 Eth1/4

Eth100/1/27 Down Eth1/4 Eth1/4

Eth100/1/28 Down Eth1/4 Eth1/4

Eth100/1/29 Down Eth1/4 Eth1/4

Eth100/1/30 Down Eth1/4 Eth1/4

Eth100/1/31 Down Eth1/4 Eth1/4

Eth100/1/32 Down Eth1/4 Eth1/4

Eth100/1/33 Down Eth1/4 Eth1/4

Eth100/1/34 Down Eth1/4 Eth1/4

Eth100/1/35 Down Eth1/4 Eth1/4

Eth100/1/36 Down Eth1/4 Eth1/4

Eth100/1/37 Down Eth1/4 Eth1/4

Eth100/1/38 Down Eth1/4 Eth1/4

Eth100/1/39 Down Eth1/4 Eth1/4

Eth100/1/40 Down Eth1/4 Eth1/4

Eth100/1/41 Down Eth1/4 Eth1/4

Eth100/1/42 Down Eth1/4 Eth1/4

Eth100/1/43 Down Eth1/4 Eth1/4

Eth100/1/44 Down Eth1/4 Eth1/4

Eth100/1/45 Down Eth1/4 Eth1/4

Eth100/1/46 Down Eth1/4 Eth1/4

Eth100/1/47 Down Eth1/4 Eth1/4

Eth100/1/48 Down Eth1/4 Eth1/4

Logs:

[11/24/2010 03:49:38.824900] Module timed out

[11/24/2010 03:54:08.225000] Module register received

[11/24/2010 03:54:08.226093] Registration response sent

[11/24/2010 03:54:08.540805] Module Online Sequence

[11/24/2010 03:54:10.7287] Module Online

Anyone can help me with this?

Thanks.

Ozden Karakok · ‎11-24-2010

Hi,

You can only have one FEX module active with a dual home from one Nexus 2K to two Nexus 5K if you DON'T configure vPC.

If you want to achieve Active/Active topology which means FEX module is online from both N5Ks,you have to configure vPC on both N5Ks

If we look at the FEX logs for N5K-01 and N5K-02, N5K-01 became offline as soon as the N5K-02 became online, this is an expected behaviour without vPC.

You can check the below design guide for the configuration and the design options. (start from page 23 for N2K)

http://www.cisco.com/en/US/prod/collateral/switches/ps9441/ps9670/C07-572829-01_Design_N5K_N2K_vPC_DG.pdf

I hope this answers your question.

Thanks,

Ozden

View solution in original post

Ozden Karakok · ‎11-24-2010

Hi,

You can only have one FEX module active with a dual home from one Nexus 2K to two Nexus 5K if you DON'T configure vPC.

If you want to achieve Active/Active topology which means FEX module is online from both N5Ks,you have to configure vPC on both N5Ks

If we look at the FEX logs for N5K-01 and N5K-02, N5K-01 became offline as soon as the N5K-02 became online, this is an expected behaviour without vPC.

You can check the below design guide for the configuration and the design options. (start from page 23 for N2K)

http://www.cisco.com/en/US/prod/collateral/switches/ps9441/ps9670/C07-572829-01_Design_N5K_N2K_vPC_DG.pdf

I hope this answers your question.

Thanks,

Ozden

hatv · ‎11-24-2010

I already configured vPC between 2 Nexus 5010

N5K-01# sh vpc brief
Legend:
(*) - local vPC is down, forwarding via vPC peer-link

vPC domain id                   : 1
Peer status                     : peer adjacency formed ok
vPC keep-alive status           : peer is alive
Configuration consistency status: success
vPC role                        : primary

vPC Peer-link status
---------------------------------------------------------------------
id   Port   Status Active vlans
--   ----   ------ --------------------------------------------------
1    Po1    up     1

vPC status
----------------------------------------------------------------------------
id Port Status Consistency Reason Active vlans
------ ----------- ------ ----------- -------------------------- -----------
100 Po100 down success success -

N5K-02# sh vpc
Legend:
(*) - local vPC is down, forwarding via vPC peer-link

vPC domain id                   : 1
Peer status                     : peer adjacency formed ok
vPC keep-alive status           : peer is alive
Configuration consistency status: success
vPC role                        : secondary

vPC Peer-link status
---------------------------------------------------------------------
id   Port   Status Active vlans
--   ----   ------ --------------------------------------------------
1    Po1    up     1

vPC status
----------------------------------------------------------------------------
id Port Status Consistency Reason Active vlans
------ ----------- ------ ----------- -------------------------- -----------
100 Po100 down* success success -

N5K-02#

may i miss some config ?

hatv · ‎11-24-2010

I've configured success. !

I've made mistake cause i used physical interface to FEX and not use Portchannel to fex.

Thanks.

Ozden Karakok · ‎11-24-2010

Super :-) , thanks for the confirmation.

hatv · ‎11-24-2010

Hi.

It work perfect like charm yesterday but today i've checked it again and i saw down( INACTIVE) in interface fex 100/1/1- 100/1/48 and my network cannot go thought.

I checked them with "sh vpc consistency-parameters interface e100/1/1" and no different between local and peer.

N5K-01# sh vpc consistency-parameters int e100/1/1

Legend:
Type 1 : vPC will be suspended in case of mismatch

Name                        Type Local Value            Peer Value
-------------               ---- ---------------------- -----------------------
Speed                       1     1000 Mb/s              1000 Mb/s
Duplex                      1     full                   full
Port Mode                   1     access                 access
Shut Lan                    1     No                     No
Allowed VLANs               -     21                   21

After that, i switched all port to vlan 1 default and all interface UP state, and i switched all interface to vlan 21 on 2 switch 5000 and i saw INACTIVE again?

What happened?

Vlan 1 work but vlan 21 Down ? May i wrong something ? It worked and became failed after 12h ?

Thanks.

Ming_Prince · ‎04-30-2014

I wonder if you have allowed vlan 21 in the peer link? if not, this can cause interface to go to inactive as well.