cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
1260
Views
25
Helpful
11
Replies

N7706 and VPC+

turklandbank
Level 1
Level 1

Hello

Which NxOS versions on Nexus 7706 switch support VPC+ ? There are so confusing information about this in relase notes. I could not find a clear answer. 

My version is 7.2(1)D1(1) . It looks it does not support in reality. But in Release notes of 7.2(1)D1(1) there are some paragraphs about VPC+. If it supports how can i turn it on?

Thanks for the answers, in advance. 

Regards.

11 Replies 11

Reza Sharifi
Hall of Fame
Hall of Fame

Hi,

vPC+ or enhanced vPC has been supported since NS-OS version 5. There is no need to turn on anything.  It is on by default.

HTH

Hi, thanks for the answer. 

Now the question changes to a different path. 

We have 2 2348TQ FEX switches cross connected on 2 nexus 7760.

It seems we are unable to make multi switch etherchannel ports on different 2348 unlike other ports on 7Ks itself. 

I read someting like for this feature are supported on N5K backbones and to be supported on 7K with VPC+. 

Is it correct? Does anyone have experience with this situation?

Regards. 

Hi -

Let's clarify terminology here as it's important to differentiate they types of vPC configurations you can do.

vPC - This configuration is the most common and requires a pair of Nexus switches.  The downstream device thinks that it is connected to one parent.

eVPC or Enhanced vPC - This is only available when connecting a Nexus 2000 to 2 parent Nexus 5000 switches (dual-homed FEX).  Downstream devices are connected to the Nx2K (or more than 1 Nx2K).

vPC+ - This is a vPC domain acting as a leaf switch in a FabricPath domain.

It is critically important to note that dual-homed FEX is only available on the Nx5K platform.  (I believe it was scheduled to be supported on Nx6K also, but that platform is being deprecated.)

PSC

Hi,

I addition to Paul's comments, I know that the replacement for the 6k series (5696Q series) support dual homing Fex. As for the 7k, have a look at this document, but before you do anything check with your Cisco SE to make sure it actually is supported. Sometimes documentations are not correct.

http://www.cisco.com/c/en/us/td/docs/switches/datacenter/nexus2000/sw/configuration/guide/b_Configuring_the_Cisco_Nexus_2000_Series_Fabric_Extender_rel_7_x/b_Configuring_the_Cisco_Nexus_2000_Series_Fabric_Extender_rel_7_x_chapter_010.html#concept_2A406D419D104BE685AFC6D43F6A5457

HTH

turklandbank
Level 1
Level 1

Hello again. Thanks for the information. My topology is as follows. Currently I am not able to connect a server to 2 N2Ks for redundancy.

- Bridge mode is not allowed (BPDU guard prevents and cannot be disabled).

- Teaming with etherchannel is not configurable on fex switches in this topology.

- Switch independent teaming on server is working a few hours then N2K ports become zombie. 

I am seeking for another option now. A patch or update or someting else?

Regards. 

Hi -

On the assumption that current N7K code supports AA-FEX (or dual-home FEX), please post the configurations related to the FEX and downstream server. Post configs from both 7K-A and 7K-B

show run fex
show run int pox member
show int pox status

PSC

Hello, thanks for your attention. 

Here are the command outputs for N7k-A (Herkul-1), and N7k-B (Herkul-2).

I am unable to make a port channel configuration on downstream server N2K ports on different N2Ks. 

Server is connected to ports E107/1/3, and E108/1/3 ports on both n7Ks. 

*************************************************************************************************
THIS IS A PRIVATE COMPUTER SYSTEM.
USAGE MAY BE MONITORED AND UNAUTHORIZED
ACCESS OR USE MAY RESULT IN CRIMINAL OR
CIVIL PROSECUTION
Cisco Nexus Operating System (NX-OS) Software
TAC support: http://www.cisco.com/tac
Copyright (c) 2002-2015, Cisco Systems, Inc. All rights reserved.
The copyrights to certain works contained in this software are
owned by other third parties and used and distributed under
license. Certain components of this software are licensed under
the GNU General Public License (GPL) version 2.0 or the GNU
Lesser General Public License (LGPL) Version 2.1. A copy of each
such license is available at
http://www.opensource.org/licenses/gpl-2.0.php and
http://www.opensource.org/licenses/lgpl-2.1.php
Herkul-1# show run fex

!Command: show running-config fex
!Time: Mon Nov 28 11:31:41 2016

version 7.2(1)D1(1)
install feature-set fex
feature-set fex

fex 107
pinning max-links 1
description FEX0107
fex 108
pinning max-links 1
description FEX0108

interface port-channel11
switchport mode fex-fabric
fex associate 108

interface port-channel12
switchport mode fex-fabric
fex associate 107

interface Ethernet1/1
switchport mode fex-fabric
fex associate 108

interface Ethernet1/2
switchport mode fex-fabric
fex associate 108

interface Ethernet1/3
switchport mode fex-fabric
fex associate 108

interface Ethernet1/4
switchport mode fex-fabric
fex associate 108

interface Ethernet1/5
switchport mode fex-fabric
fex associate 107

interface Ethernet1/6
switchport mode fex-fabric
fex associate 107

interface Ethernet1/7
switchport mode fex-fabric
fex associate 107

interface Ethernet1/8
switchport mode fex-fabric
fex associate 107

Herkul-1# show run int po11 membership

!Command: show running-config interface port-channel11 membership
!Time: Mon Nov 28 11:31:49 2016

version 7.2(1)D1(1)

interface port-channel11
description Fex108 uplink 1 (Eth1/1-4) 4x10Gbps - kabinet B108
switchport
switchport mode fex-fabric
fex associate 108
vpc 11

interface Ethernet1/1
description Fex108 uplink 1 1.baglanti
switchport
switchport mode fex-fabric
fex associate 108
channel-group 11
no shutdown

interface Ethernet1/2
description Fex108 uplink 1 2.baglanti
switchport
switchport mode fex-fabric
fex associate 108
channel-group 11
no shutdown

interface Ethernet1/3
description Fex108 uplink 1 3.baglanti
switchport
switchport mode fex-fabric
fex associate 108
channel-group 11
no shutdown

interface Ethernet1/4
description Fex108 uplink 1 4.baglanti
switchport
switchport mode fex-fabric
fex associate 108
channel-group 11
no shutdown

Herkul-1# show run int po12 membership

!Command: show running-config interface port-channel12 membership
!Time: Mon Nov 28 11:32:16 2016

version 7.2(1)D1(1)

interface port-channel12
description Fex107 uplink 1 (Eth1/5-8) 4x10Gbps - kabinet B107
switchport
switchport mode fex-fabric
fex associate 107
vpc 12

interface Ethernet1/5
description Fex107 uplink 1 1.baglanti
switchport
switchport mode fex-fabric
fex associate 107
channel-group 12
no shutdown

interface Ethernet1/6
description Fex107 uplink 1 2.baglanti
switchport
switchport mode fex-fabric
fex associate 107
channel-group 12
no shutdown

interface Ethernet1/7
description Fex107 uplink 1 3.baglanti
switchport
switchport mode fex-fabric
fex associate 107
channel-group 12
no shutdown

interface Ethernet1/8
description Fex107 uplink 1 4.baglanti
switchport
switchport mode fex-fabric
fex associate 107
channel-group 12
no shutdown

Herkul-1# show int po11 status

--------------------------------------------------------------------------------
Port Name Status Vlan Duplex Speed Type
--------------------------------------------------------------------------------
Po11 Fex108 uplink 1 connected 1 full a-10G --
Herkul-1# show int po12 status

--------------------------------------------------------------------------------
Port Name Status Vlan Duplex Speed Type
--------------------------------------------------------------------------------
Po12 Fex107 uplink 1 connected 1 full a-10G --
Herkul-1#

Herkul-1# show run int e107/1/3

!Command: show running-config interface Ethernet107/1/3
!Time: Mon Nov 28 11:40:45 2016

version 7.2(1)D1(1)

interface Ethernet107/1/3
description hypervtst1 port (2) 10G
switchport
switchport mode trunk
no shutdown

Herkul-1#

Herkul-1# show run int e108/1/3

!Command: show running-config interface Ethernet108/1/3
!Time: Mon Nov 28 11:44:14 2016

version 7.2(1)D1(1)

interface Ethernet108/1/3
description hypervtst1 port (1) 10G
switchport
switchport mode trunk
no shutdown

Herkul-1#

*******************************************************************************************

...
THIS IS A PRIVATE COMPUTER SYSTEM.
USAGE MAY BE MONITORED AND UNAUTHORIZED
ACCESS OR USE MAY RESULT IN CRIMINAL OR
CIVIL PROSECUTION
Cisco Nexus Operating System (NX-OS) Software
TAC support: http://www.cisco.com/tac
Copyright (c) 2002-2015, Cisco Systems, Inc. All rights reserved.
The copyrights to certain works contained in this software are
owned by other third parties and used and distributed under
license. Certain components of this software are licensed under
the GNU General Public License (GPL) version 2.0 or the GNU
Lesser General Public License (LGPL) Version 2.1. A copy of each
such license is available at
http://www.opensource.org/licenses/gpl-2.0.php and
http://www.opensource.org/licenses/lgpl-2.1.php
Herkul-2# show run fex

!Command: show running-config fex
!Time: Mon Nov 28 11:36:40 2016

version 7.2(1)D1(1)
install feature-set fex
feature-set fex

fex 107
pinning max-links 1
description FEX0107
fex 108
pinning max-links 1
description FEX0108

interface port-channel11
switchport mode fex-fabric
fex associate 108

interface port-channel12
switchport mode fex-fabric
fex associate 107

interface Ethernet1/1
switchport mode fex-fabric
fex associate 108

interface Ethernet1/2
switchport mode fex-fabric
fex associate 108

interface Ethernet1/3
switchport mode fex-fabric
fex associate 108

interface Ethernet1/4
switchport mode fex-fabric
fex associate 108

interface Ethernet1/5
switchport mode fex-fabric
fex associate 107

interface Ethernet1/6
switchport mode fex-fabric
fex associate 107

interface Ethernet1/7
switchport mode fex-fabric
fex associate 107

interface Ethernet1/8
switchport mode fex-fabric
fex associate 107

Herkul-2# show run int po11 membership

!Command: show running-config interface port-channel11 membership
!Time: Mon Nov 28 11:37:38 2016

version 7.2(1)D1(1)

interface port-channel11
description Fex108 uplink 2 (Eth1/1-4) 4x10Gbps - kabinet B108
switchport
switchport mode fex-fabric
fex associate 108
vpc 11

interface Ethernet1/1
description Fex108 uplink 2 1.baglanti
switchport
switchport mode fex-fabric
fex associate 108
channel-group 11
no shutdown

interface Ethernet1/2
description Fex108 uplink 2 2.baglanti
switchport
switchport mode fex-fabric
fex associate 108
channel-group 11
no shutdown

interface Ethernet1/3
description Fex108 uplink 2 3.baglanti
switchport
switchport mode fex-fabric
fex associate 108
channel-group 11
no shutdown

interface Ethernet1/4
description Fex108 uplink 2 4.baglanti
switchport
switchport mode fex-fabric
fex associate 108
channel-group 11
no shutdown

Herkul-2# show run int po12 membership

!Command: show running-config interface port-channel12 membership
!Time: Mon Nov 28 11:37:42 2016

version 7.2(1)D1(1)

interface port-channel12
description Fex107 uplink 2 (Eth1/5-8) 4x10Gbps - kabinet B107
switchport
switchport mode fex-fabric
fex associate 107
vpc 12

interface Ethernet1/5
description Fex107 uplink 2 1.baglanti
switchport
switchport mode fex-fabric
fex associate 107
channel-group 12
no shutdown

interface Ethernet1/6
description Fex107 uplink 2 2.baglanti
switchport
switchport mode fex-fabric
fex associate 107
channel-group 12
no shutdown

interface Ethernet1/7
description Fex107 uplink 2 3.baglanti
switchport
switchport mode fex-fabric
fex associate 107
channel-group 12
no shutdown

interface Ethernet1/8
description Fex107 uplink 2 4.baglanti
switchport
switchport mode fex-fabric
fex associate 107
channel-group 12
no shutdown

Herkul-2# show int po11 status

--------------------------------------------------------------------------------
Port Name Status Vlan Duplex Speed Type
--------------------------------------------------------------------------------
Po11 Fex108 uplink 2 connected 1 full a-10G --
Herkul-2# show int po12 status

--------------------------------------------------------------------------------
Port Name Status Vlan Duplex Speed Type
--------------------------------------------------------------------------------
Po12 Fex107 uplink 2 connected 1 full a-10G --
Herkul-2#

Herkul-2# show run int e107/1/3

!Command: show running-config interface Ethernet107/1/3
!Time: Mon Nov 28 11:45:11 2016

version 7.2(1)D1(1)

interface Ethernet107/1/3
description hypervtst1 port (2) 10G
switchport
switchport mode trunk
no shutdown

Herkul-2# show run int e108/1/3

!Command: show running-config interface Ethernet108/1/3
!Time: Mon Nov 28 11:45:15 2016

version 7.2(1)D1(1)

interface Ethernet108/1/3
description hypervtst1 port (1) 10G
switchport
switchport mode trunk
no shutdown

Herkul-2#

*******************************************

Hi -

Looks good so far.  Just a couple of follow up questions.

  1. Do the FEX's show as fully running in "show fex 107 detail" and "show fex 108 detail"?
  2. What OS is running on hypervtst1?

If the server is Microsoft Hyper-V and you are running the advanced NIC teaming driver, then I suggest aggregating the ports with 802.1ad (LACP).  Since you are effectively running eVPC, you just need to put the "channel-group x mode active" in the server ports and you're done. (The vpc command in the server port channel is not necessary because the parent FEXs are already vpc.)

PSC

Good morning Paul. Thanks again.

The answers are as follows:

1-

Herkul-1# show fex 107 detail
FEX: 107 Description: FEX0107 state: Online
FEX version: 7.2(1)D1(1) [Switch version: 7.2(1)D1(1)]
FEX Interim version: (1)FIP_0_91
Switch Interim version: 7.2(1)D1(1)
Extender Serial: FOC1937R1EC
Extender Model: N2K-C2348TQ-10GE, Part No: 73-16842-04
Card Id: 266, Mac Addr: 38:20:56:5c:b7:82, Num Macs: 64
Keepalive pending for 1 intervals
Module Sw Gen: 21 [Switch Sw Gen: 21]
Pinning-mode: static Max-links: 1
Fabric port for control traffic: Eth1/5
FCoE Admin: false
FCoE Oper: false
FCoE FEX AA Configured: false
Fabric interface state:
Po12 - Interface Up. State: Active
Eth1/5 - Interface Up. State: Active
Eth1/6 - Interface Up. State: Active
Eth1/7 - Interface Up. State: Active
Eth1/8 - Interface Up. State: Active
Fex Port State Fabric Port
Eth107/1/1 Down Po12
Eth107/1/2 Up Po12
Eth107/1/3 Up Po12
Eth107/1/4 Up Po12
Eth107/1/5 Down Po12
Eth107/1/6 Down Po12
Eth107/1/7 Down Po12
Eth107/1/8 Down Po12
Eth107/1/9 Down Po12
Eth107/1/10 Down Po12
Eth107/1/11 Down Po12
Eth107/1/12 Down Po12
Eth107/1/13 Down Po12
Eth107/1/14 Down Po12
Eth107/1/15 Down Po12
Eth107/1/16 Down Po12
Eth107/1/17 Down Po12
Eth107/1/18 Down Po12
Eth107/1/19 Down Po12
Eth107/1/20 Down Po12
Eth107/1/21 Down Po12
Eth107/1/22 Down Po12
Eth107/1/23 Down Po12
Eth107/1/24 Down Po12
Eth107/1/25 Down Po12
Eth107/1/26 Down Po12
Eth107/1/27 Down Po12
Eth107/1/28 Down Po12
Eth107/1/29 Down Po12
Eth107/1/30 Down Po12
Eth107/1/31 Down Po12
Eth107/1/32 Down Po12
Eth107/1/33 Down Po12
Eth107/1/34 Down Po12
Eth107/1/35 Down Po12
Eth107/1/36 Down Po12
Eth107/1/37 Down Po12
Eth107/1/38 Down Po12
Eth107/1/39 Down Po12
Eth107/1/40 Down Po12
Eth107/1/41 Down Po12
Eth107/1/42 Down Po12
Eth107/1/43 Up Po12
Eth107/1/44 Down Po12
Eth107/1/45 Down Po12
Eth107/1/46 Down Po12
Eth107/1/47 Down Po12
Eth107/1/48 Down Po12

Logs:
08/04/2016 14:37:49.454647: Module disconnected
08/04/2016 14:37:49.455958: Offlining Module
08/04/2016 14:37:49.648552: Deleting route to FEX
08/04/2016 14:37:49.675366: Module disconnected
08/04/2016 14:37:49.676508: Offlining Module
08/04/2016 14:39:09.444842: Module register received
08/04/2016 14:39:09.514502: Registration response sent
08/04/2016 14:39:11.517415: Registration response sent
08/04/2016 14:39:11.599028: Module Online Sequence
08/04/2016 14:39:17.961345: Module Online
11/23/2016 16:25:27.496929: Deleting route to FEX
11/23/2016 16:25:27.525103: Module disconnected
11/23/2016 16:25:27.525994: Deleting route to FEX
11/23/2016 16:25:27.552160: Module disconnected
11/23/2016 16:25:27.552672: Offlining Module
11/23/2016 16:25:27.553414: Module Offline Sequence
11/23/2016 16:25:28.526903: Module Offline
11/23/2016 16:25:54.590641: Deleting route to FEX
11/23/2016 16:25:54.618173: Module disconnected
11/23/2016 16:25:54.619231: Offlining Module
11/23/2016 16:25:54.812033: Deleting route to FEX
11/23/2016 16:25:54.839419: Module disconnected
11/23/2016 16:25:54.840428: Offlining Module
11/23/2016 16:27:03.792558: Module register received
11/23/2016 16:27:03.862160: Registration response sent
11/23/2016 16:27:05.863405: Registration response sent
11/23/2016 16:27:06.11097: Module Online Sequence
11/23/2016 16:27:12.799137: Module Online
11/24/2016 11:19:53.136868: Deleting route to FEX
11/24/2016 11:19:53.164917: Module disconnected
11/24/2016 11:19:53.165881: Deleting route to FEX
11/24/2016 11:19:53.192106: Module disconnected
11/24/2016 11:19:53.192571: Offlining Module
11/24/2016 11:19:53.193367: Module Offline Sequence
11/24/2016 11:19:54.75651: Module Offline
11/24/2016 11:20:20.193473: Deleting route to FEX
11/24/2016 11:20:20.220594: Module disconnected
11/24/2016 11:20:20.221970: Offlining Module
11/24/2016 11:20:20.412103: Deleting route to FEX
11/24/2016 11:20:20.458462: Module disconnected
11/24/2016 11:20:20.459418: Offlining Module
11/24/2016 11:21:29.442356: Module register received
11/24/2016 11:21:29.515877: Registration response sent
11/24/2016 11:21:31.520068: Registration response sent
11/24/2016 11:21:31.619200: Module Online Sequence
11/24/2016 11:21:40.801380: Module Online
11/25/2016 09:34:27.207514: Deleting route to FEX
11/25/2016 09:34:27.235261: Module disconnected
11/25/2016 09:34:27.236035: Deleting route to FEX
11/25/2016 09:34:27.261947: Module disconnected
11/25/2016 09:34:27.262427: Offlining Module
11/25/2016 09:34:27.411480: Module Offline Sequence
11/25/2016 09:34:28.919856: Module Offline
11/25/2016 09:34:54.90578: Deleting route to FEX
11/25/2016 09:34:54.118665: Module disconnected
11/25/2016 09:34:54.120049: Offlining Module
11/25/2016 09:34:54.583413: Deleting route to FEX
11/25/2016 09:34:54.611493: Module disconnected
11/25/2016 09:34:54.612859: Offlining Module
11/25/2016 09:36:13.463008: Module register received
11/25/2016 09:36:13.532624: Registration response sent
11/25/2016 09:36:15.534676: Registration response sent
11/25/2016 09:36:15.641278: Module Online Sequence
11/25/2016 09:36:23.617937: Module Online
Herkul-1#
Herkul-1#
Herkul-1#
Herkul-1#
Herkul-1#
Herkul-1#
Herkul-1#
Herkul-1#
Herkul-1#
Herkul-1#
Herkul-1#
Herkul-1#
Herkul-1#
Herkul-1# show fex 108 detail
FEX: 108 Description: FEX0108 state: Online
FEX version: 7.2(1)D1(1) [Switch version: 7.2(1)D1(1)]
FEX Interim version: (1)FIP_0_91
Switch Interim version: 7.2(1)D1(1)
Extender Serial: FOC1938R08H
Extender Model: N2K-C2348TQ-10GE, Part No: 73-16842-04
Card Id: 266, Mac Addr: 38:20:56:5c:fc:e2, Num Macs: 64
Keepalive pending for 1 intervals
Module Sw Gen: 21 [Switch Sw Gen: 21]
Pinning-mode: static Max-links: 1
Fabric port for control traffic: Eth1/4
FCoE Admin: false
FCoE Oper: false
FCoE FEX AA Configured: false
Fabric interface state:
Po11 - Interface Up. State: Active
Eth1/1 - Interface Up. State: Active
Eth1/2 - Interface Up. State: Active
Eth1/3 - Interface Up. State: Active
Eth1/4 - Interface Up. State: Active
Fex Port State Fabric Port
Eth108/1/1 Down Po11
Eth108/1/2 Up Po11
Eth108/1/3 Up Po11
Eth108/1/4 Up Po11
Eth108/1/5 Down Po11
Eth108/1/6 Down Po11
Eth108/1/7 Down Po11
Eth108/1/8 Down Po11
Eth108/1/9 Down Po11
Eth108/1/10 Down Po11
Eth108/1/11 Down Po11
Eth108/1/12 Down Po11
Eth108/1/13 Down Po11
Eth108/1/14 Down Po11
Eth108/1/15 Down Po11
Eth108/1/16 Down Po11
Eth108/1/17 Down Po11
Eth108/1/18 Down Po11
Eth108/1/19 Down Po11
Eth108/1/20 Down Po11
Eth108/1/21 Down Po11
Eth108/1/22 Down Po11
Eth108/1/23 Down Po11
Eth108/1/24 Down Po11
Eth108/1/25 Down Po11
Eth108/1/26 Down Po11
Eth108/1/27 Down Po11
Eth108/1/28 Down Po11
Eth108/1/29 Down Po11
Eth108/1/30 Down Po11
Eth108/1/31 Down Po11
Eth108/1/32 Down Po11
Eth108/1/33 Down Po11
Eth108/1/34 Down Po11
Eth108/1/35 Down Po11
Eth108/1/36 Down Po11
Eth108/1/37 Down Po11
Eth108/1/38 Down Po11
Eth108/1/39 Down Po11
Eth108/1/40 Down Po11
Eth108/1/41 Down Po11
Eth108/1/42 Down Po11
Eth108/1/43 Down Po11
Eth108/1/44 Down Po11
Eth108/1/45 Down Po11
Eth108/1/46 Down Po11
Eth108/1/47 Down Po11
Eth108/1/48 Down Po11

Logs:
08/11/2016 21:36:39.125282: Deleting route to FEX
08/11/2016 21:36:39.151760: Module disconnected
08/11/2016 21:36:39.152305: Offlining Module
08/11/2016 21:36:39.153130: Module Offline Sequence
08/11/2016 21:36:39.616130: Module Offline
08/11/2016 21:37:04.646889: Deleting route to FEX
08/11/2016 21:37:04.674486: Module disconnected
08/11/2016 21:37:04.675735: Offlining Module
08/11/2016 21:37:04.856526: Deleting route to FEX
08/11/2016 21:37:04.884110: Module disconnected
08/11/2016 21:37:04.885173: Offlining Module
08/11/2016 21:38:13.91935: Module register received
08/11/2016 21:38:13.162064: Registration response sent
08/11/2016 21:38:15.163525: Registration response sent
08/11/2016 21:38:15.281941: Module Online Sequence
08/11/2016 21:38:21.300434: Module Online
10/20/2016 20:02:30.76910: Deleting route to FEX
10/20/2016 20:02:30.105109: Module disconnected
10/20/2016 20:02:30.105866: Deleting route to FEX
10/20/2016 20:02:30.132210: Module disconnected
10/20/2016 20:02:30.132707: Offlining Module
10/20/2016 20:02:30.133546: Module Offline Sequence
10/20/2016 20:02:30.999388: Module Offline
10/20/2016 20:02:57.426460: Deleting route to FEX
10/20/2016 20:02:57.453656: Module disconnected
10/20/2016 20:02:57.455008: Offlining Module
10/20/2016 20:02:57.677299: Deleting route to FEX
10/20/2016 20:02:57.704755: Module disconnected
10/20/2016 20:02:57.706166: Offlining Module
10/20/2016 20:04:08.87565: Module register received
10/20/2016 20:04:08.157261: Registration response sent
10/20/2016 20:04:10.158693: Registration response sent
10/20/2016 20:04:10.263043: Module Online Sequence
10/20/2016 20:04:18.588893: Module Online
11/24/2016 09:52:19.37477: Deleting route to FEX
11/24/2016 09:52:19.65725: Module disconnected
11/24/2016 09:52:19.66621: Deleting route to FEX
11/24/2016 09:52:19.92825: Module disconnected
11/24/2016 09:52:19.93278: Offlining Module
11/24/2016 09:52:19.94068: Module Offline Sequence
11/24/2016 09:52:19.855155: Module Offline
11/24/2016 09:52:45.815383: Deleting route to FEX
11/24/2016 09:52:45.842782: Module disconnected
11/24/2016 09:52:45.843888: Offlining Module
11/24/2016 09:52:46.81112: Deleting route to FEX
11/24/2016 09:52:46.108116: Module disconnected
11/24/2016 09:52:46.109132: Offlining Module
11/24/2016 09:53:53.958150: Module register received
11/24/2016 09:53:54.27309: Registration response sent
11/24/2016 09:53:56.31680: Registration response sent
11/24/2016 09:53:56.139475: Module Online Sequence
11/24/2016 09:54:03.35993: Module Online
11/25/2016 09:34:27.356962: Deleting route to FEX
11/25/2016 09:34:27.383786: Module disconnected
11/25/2016 09:34:27.384493: Deleting route to FEX
11/25/2016 09:34:27.410688: Module disconnected
11/25/2016 09:34:27.413939: Offlining Module
11/25/2016 09:34:27.416268: Module Offline Sequence
11/25/2016 09:34:29.148121: Module Offline
11/25/2016 09:36:02.588105: Module register received
11/25/2016 09:36:02.658084: Registration response sent
11/25/2016 09:36:04.659493: Registration response sent
11/25/2016 09:36:04.835270: Module Online Sequence
11/25/2016 09:36:13.82289: Module Online
Herkul-1#

***************

Herkul-2# show fex 107 detail
FEX: 107 Description: FEX0107 state: Online
FEX version: 7.2(1)D1(1) [Switch version: 7.2(1)D1(1)]
FEX Interim version: (1)FIP_0_91
Switch Interim version: 7.2(1)D1(1)
Extender Serial: FOC1937R1EC
Extender Model: N2K-C2348TQ-10GE, Part No: 73-16842-04
Card Id: 266, Mac Addr: 38:20:56:5c:b7:82, Num Macs: 64
Keepalive pending for 1 intervals
Module Sw Gen: 21 [Switch Sw Gen: 21]
Pinning-mode: static Max-links: 1
Fabric port for control traffic: Eth1/5
FCoE Admin: false
FCoE Oper: false
FCoE FEX AA Configured: false
Fabric interface state:
Po12 - Interface Up. State: Active
Eth1/5 - Interface Up. State: Active
Eth1/6 - Interface Up. State: Active
Eth1/7 - Interface Up. State: Active
Eth1/8 - Interface Up. State: Active
Fex Port State Fabric Port
Eth107/1/1 Down Po12
Eth107/1/2 Up Po12
Eth107/1/3 Up Po12
Eth107/1/4 Up Po12
Eth107/1/5 Down Po12
Eth107/1/6 Down Po12
Eth107/1/7 Down Po12
Eth107/1/8 Down Po12
Eth107/1/9 Down Po12
Eth107/1/10 Down Po12
Eth107/1/11 Down Po12
Eth107/1/12 Down Po12
Eth107/1/13 Down Po12
Eth107/1/14 Down Po12
Eth107/1/15 Down Po12
Eth107/1/16 Down Po12
Eth107/1/17 Down Po12
Eth107/1/18 Down Po12
Eth107/1/19 Down Po12
Eth107/1/20 Down Po12
Eth107/1/21 Down Po12
Eth107/1/22 Down Po12
Eth107/1/23 Down Po12
Eth107/1/24 Down Po12
Eth107/1/25 Down Po12
Eth107/1/26 Down Po12
Eth107/1/27 Down Po12
Eth107/1/28 Down Po12
Eth107/1/29 Down Po12
Eth107/1/30 Down Po12
Eth107/1/31 Down Po12
Eth107/1/32 Down Po12
Eth107/1/33 Down Po12
Eth107/1/34 Down Po12
Eth107/1/35 Down Po12
Eth107/1/36 Down Po12
Eth107/1/37 Down Po12
Eth107/1/38 Down Po12
Eth107/1/39 Down Po12
Eth107/1/40 Down Po12
Eth107/1/41 Down Po12
Eth107/1/42 Down Po12
Eth107/1/43 Up Po12
Eth107/1/44 Down Po12
Eth107/1/45 Down Po12
Eth107/1/46 Down Po12
Eth107/1/47 Down Po12
Eth107/1/48 Down Po12

Logs:
11/23/2016 16:25:56.172793: Offlining Module
11/23/2016 16:25:56.376702: Deleting route to FEX
11/23/2016 16:25:56.403588: Module disconnected
11/23/2016 16:25:56.404724: Offlining Module
11/23/2016 16:27:07.141253: Module register received
11/23/2016 16:27:07.209884: Registration response sent
11/23/2016 16:27:09.211392: Registration response sent
11/23/2016 16:27:09.318761: Module Online Sequence
11/23/2016 16:27:15.218927: Aborting lc insert sequence
11/23/2016 16:27:15.218934: Deleting route to FEX
11/23/2016 16:27:15.245490: Module disconnected
11/23/2016 16:27:15.246459: Aborting lc insert sequence
11/23/2016 16:27:15.246470: Deleting route to FEX
11/23/2016 16:27:15.273146: Module disconnected
11/23/2016 16:27:15.273664: Module insert failed
11/23/2016 16:27:15.274519: Module Offline Sequence
11/23/2016 16:27:15.451666: Module Offline
11/23/2016 16:27:41.298158: Deleting route to FEX
11/23/2016 16:27:41.328287: Module disconnected
11/23/2016 16:27:41.329314: Offlining Module
11/23/2016 16:27:41.515995: Deleting route to FEX
11/23/2016 16:27:41.544255: Module disconnected
11/23/2016 16:27:41.545290: Offlining Module
11/23/2016 16:28:43.756131: Module register received
11/23/2016 16:28:43.826202: Registration response sent
11/23/2016 16:28:45.827678: Registration response sent
11/23/2016 16:28:45.895907: Module Online Sequence
11/23/2016 16:28:54.222520: Module Online
11/24/2016 11:19:50.68858: Deleting route to FEX
11/24/2016 11:19:50.96904: Module disconnected
11/24/2016 11:19:50.97781: Deleting route to FEX
11/24/2016 11:19:50.123865: Module disconnected
11/24/2016 11:19:50.124342: Offlining Module
11/24/2016 11:19:50.125128: Module Offline Sequence
11/24/2016 11:19:51.165519: Module Offline
11/24/2016 11:20:17.115184: Deleting route to FEX
11/24/2016 11:20:17.142937: Module disconnected
11/24/2016 11:20:17.143955: Offlining Module
11/24/2016 11:20:17.594594: Deleting route to FEX
11/24/2016 11:20:17.621480: Module disconnected
11/24/2016 11:20:17.622481: Offlining Module
11/24/2016 11:21:26.116652: Module register received
11/24/2016 11:21:26.187059: Registration response sent
11/24/2016 11:21:28.188405: Registration response sent
11/24/2016 11:21:28.298295: Module Online Sequence
11/24/2016 11:21:34.766420: Module Online
11/25/2016 09:34:25.128833: Deleting route to FEX
11/25/2016 09:34:25.157153: Module disconnected
11/25/2016 09:34:25.158106: Deleting route to FEX
11/25/2016 09:34:25.184114: Module disconnected
11/25/2016 09:34:25.184576: Offlining Module
11/25/2016 09:34:25.333357: Module Offline Sequence
11/25/2016 09:34:26.885056: Module Offline
11/25/2016 09:34:52.498353: Deleting route to FEX
11/25/2016 09:34:52.524769: Module disconnected
11/25/2016 09:34:52.525924: Offlining Module
11/25/2016 09:34:52.724821: Deleting route to FEX
11/25/2016 09:34:52.752733: Module disconnected
11/25/2016 09:34:52.753904: Offlining Module
11/25/2016 09:36:10.54688: Module register received
11/25/2016 09:36:10.123787: Registration response sent
11/25/2016 09:36:12.128502: Registration response sent
11/25/2016 09:36:12.227507: Module Online Sequence
11/25/2016 09:36:18.435974: Module Online
Herkul-2# show fex 108 detail
FEX: 108 Description: FEX0108 state: Online
FEX version: 7.2(1)D1(1) [Switch version: 7.2(1)D1(1)]
FEX Interim version: (1)FIP_0_91
Switch Interim version: 7.2(1)D1(1)
Extender Serial: FOC1938R08H
Extender Model: N2K-C2348TQ-10GE, Part No: 73-16842-04
Card Id: 266, Mac Addr: 38:20:56:5c:fc:e2, Num Macs: 64
Keepalive pending for 2 intervals
Module Sw Gen: 21 [Switch Sw Gen: 21]
Pinning-mode: static Max-links: 1
Fabric port for control traffic: Eth1/3
FCoE Admin: false
FCoE Oper: false
FCoE FEX AA Configured: false
Fabric interface state:
Po11 - Interface Up. State: Active
Eth1/1 - Interface Up. State: Active
Eth1/2 - Interface Up. State: Active
Eth1/3 - Interface Up. State: Active
Eth1/4 - Interface Up. State: Active
Fex Port State Fabric Port
Eth108/1/1 Down Po11
Eth108/1/2 Up Po11
Eth108/1/3 Up Po11
Eth108/1/4 Up Po11
Eth108/1/5 Down Po11
Eth108/1/6 Down Po11
Eth108/1/7 Down Po11
Eth108/1/8 Down Po11
Eth108/1/9 Down Po11
Eth108/1/10 Down Po11
Eth108/1/11 Down Po11
Eth108/1/12 Down Po11
Eth108/1/13 Down Po11
Eth108/1/14 Down Po11
Eth108/1/15 Down Po11
Eth108/1/16 Down Po11
Eth108/1/17 Down Po11
Eth108/1/18 Down Po11
Eth108/1/19 Down Po11
Eth108/1/20 Down Po11
Eth108/1/21 Down Po11
Eth108/1/22 Down Po11
Eth108/1/23 Down Po11
Eth108/1/24 Down Po11
Eth108/1/25 Down Po11
Eth108/1/26 Down Po11
Eth108/1/27 Down Po11
Eth108/1/28 Down Po11
Eth108/1/29 Down Po11
Eth108/1/30 Down Po11
Eth108/1/31 Down Po11
Eth108/1/32 Down Po11
Eth108/1/33 Down Po11
Eth108/1/34 Down Po11
Eth108/1/35 Down Po11
Eth108/1/36 Down Po11
Eth108/1/37 Down Po11
Eth108/1/38 Down Po11
Eth108/1/39 Down Po11
Eth108/1/40 Down Po11
Eth108/1/41 Down Po11
Eth108/1/42 Down Po11
Eth108/1/43 Down Po11
Eth108/1/44 Down Po11
Eth108/1/45 Down Po11
Eth108/1/46 Down Po11
Eth108/1/47 Down Po11
Eth108/1/48 Down Po11

Logs:
08/11/2016 21:38:19.188959: Module register received
08/11/2016 21:38:19.258225: Registration response sent
08/11/2016 21:38:21.263694: Registration response sent
08/11/2016 21:38:21.374716: Module Online Sequence
08/11/2016 21:38:27.907361: Module Online
10/20/2016 20:02:03.358919: Deleting route to FEX
10/20/2016 20:02:03.386091: Module disconnected
10/20/2016 20:02:03.386935: Deleting route to FEX
10/20/2016 20:02:03.413406: Module disconnected
10/20/2016 20:02:03.413917: Offlining Module
10/20/2016 20:02:03.414911: Module Offline Sequence
10/20/2016 20:02:04.328510: Module Offline
10/20/2016 20:02:55.421393: Module register received
10/20/2016 20:02:55.493257: Registration response sent
10/20/2016 20:02:57.494643: Registration response sent
10/20/2016 20:02:57.602619: Module Online Sequence
10/20/2016 20:03:03.754527: Module Online
11/24/2016 09:52:23.78842: Deleting route to FEX
11/24/2016 09:52:23.106960: Module disconnected
11/24/2016 09:52:23.107845: Deleting route to FEX
11/24/2016 09:52:23.133946: Module disconnected
11/24/2016 09:52:23.134432: Offlining Module
11/24/2016 09:52:23.135239: Module Offline Sequence
11/24/2016 09:52:23.996232: Module Offline
11/24/2016 09:52:50.129819: Deleting route to FEX
11/24/2016 09:52:50.158175: Module disconnected
11/24/2016 09:52:50.159567: Offlining Module
11/24/2016 09:52:50.446479: Deleting route to FEX
11/24/2016 09:52:50.473790: Module disconnected
11/24/2016 09:52:50.475200: Offlining Module
11/24/2016 09:53:57.270726: Module register received
11/24/2016 09:53:57.340428: Registration response sent
11/24/2016 09:53:59.342177: Registration response sent
11/24/2016 09:53:59.440339: Module Online Sequence
11/24/2016 09:54:10.125670: Module Online
11/24/2016 09:54:23.222140: Deleting route to FEX
11/24/2016 09:54:23.249262: Module disconnected
11/24/2016 09:54:23.250166: Deleting route to FEX
11/24/2016 09:54:23.276023: Module disconnected
11/24/2016 09:54:23.276677: Offlining Module
11/24/2016 09:54:23.277465: Module Offline Sequence
11/24/2016 09:54:45.173804: Module Offline
11/24/2016 09:54:52.507196: Module register received
11/24/2016 09:54:52.578316: Registration response sent
11/24/2016 09:54:54.579317: Registration response sent
11/24/2016 09:54:54.690051: Module Online Sequence
11/24/2016 09:55:00.897484: Module Online
11/25/2016 09:34:25.278839: Deleting route to FEX
11/25/2016 09:34:25.304920: Module disconnected
11/25/2016 09:34:25.305809: Deleting route to FEX
11/25/2016 09:34:25.331714: Module disconnected
11/25/2016 09:34:25.335069: Offlining Module
11/25/2016 09:34:25.345225: Module Offline Sequence
11/25/2016 09:34:27.120866: Module Offline
11/25/2016 09:35:58.449271: Module register received
11/25/2016 09:35:58.518414: Registration response sent
11/25/2016 09:36:00.519700: Registration response sent
11/25/2016 09:36:00.649768: Module Online Sequence
11/25/2016 09:36:12.149954: Module Online
Herkul-2#

2-
Yes the server is Microsoft HyperV 2012. We put server's ports to LACP mode HyperV type Active Active.
For the e107/1/3 on Herkul-1 and Herkul-2 we were able to submit the command "channel-group 110 mode active"
But for the e108/1/3 the same command failed (see below):

NOTE: It seems FEX AA mode with my topology does not work. Instead, when we change to Switch Independent Active / StandBy mode on HyperV, It starts working. Redundancy testings are fine at the beginning. After some time (1-2 hours or days sometimes), one of the ports become zombie. Up-Up but no traffic. At that time that port is working even if we connect a stand alone pc to that port, until resetting the fabric uplinks.

Regards.

Herkul-1(config-if)# int e107/1/3
Herkul-1(config-if)# channel-group 110 mode active ?
<CR>

Herkul-1(config-if)# channel-group 110 mode active
Herkul-1(config-if)# show int po110
port-channel110 is up
admin state is up
vPC Status: Up, vPC number: 12397
Hardware: Port-Channel, address: 3820.565c.b784 (bia 3820.565c.b784)
MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec
reliability 255/255, txload 112/255, rxload 50/255
Encapsulation ARPA, medium is broadcast
Port mode is trunk
full-duplex, 10 Gb/s
Input flow-control is off, output flow-control is on
Auto-mdix is turned off
Switchport monitor is off
EtherType is 0x8100
Members in this channel: Eth107/1/3
Last clearing of "show interface" counters never
1 interface resets
Load-Interval #1: 30 seconds
30 seconds input rate 1985473224 bits/sec, 2990864 packets/sec
30 seconds output rate 4425274912 bits/sec, 6315173 packets/sec
input rate 1.99 Gbps, 2.99 Mpps; output rate 4.43 Gbps, 6.32 Mpps
Load-Interval #2: 5 minute (300 seconds)
300 seconds input rate 1985674056 bits/sec, 2991280 packets/sec
300 seconds output rate 4425105584 bits/sec, 6314997 packets/sec
input rate 1.99 Gbps, 2.99 Mpps; output rate 4.43 Gbps, 6.31 Mpps
RX
463926453 unicast packets 8343779 multicast packets 41429839 broadcast packets
513700853 input packets 42625853770 bytes
0 jumbo packets 0 storm suppression packets
0 runts 0 giants 0 CRC/FCS 0 no buffer
0 input error 0 short frame 0 overrun 0 underrun 0 ignored
0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop
0 input with dribble 0 input discard
0 Rx pause
TX
152592172 unicast packets 195178999 multicast packets 736778659 broadcast packets
1084549830 output packets 94997220476 bytes
2 jumbo packets
0 output error 0 collision 0 deferred 0 late collision
0 lost carrier 0 no carrier 0 babble 0 output discard
0 Tx pause

Herkul-1(config-if)# int e108/1/3
Herkul-1(config-if)# channel-group 110 ?
<CR>
force Forcefully add a port
mode Specify channeling mode

Herkul-1(config-if)# channel-group 110 mode active ?
<CR>

Herkul-1(config-if)# channel-group 110 mode active
command failed: port not compatible [Members in multiple FEX]

** You can use force option to override the port's parameters
** (e.g. "channel-group X force")
** Use "show port-channel compatibility-parameters" to get more information on failure

Herkul-1(config-if)#

Hi -

Since FEX AA on N7K doesn't support the same topologies allowed by eVPC on N5K I recommend going with a more standard configuration.

Connect each FEX to a single parent switch with a standard port-channel (no vpc command in the Po interface).  You can then create standard vPCs to the Hyper-V server.  This is a typical setup for N7Ks.

PSC

Thank you very much for your all interests. I will go on with topology change probably.

Best regards. 

Getting Started

Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community:

Review Cisco Networking products for a $25 gift card