Solved: Not able to ping from the FEX 2k

smartboy2255 · ‎09-22-2011

Hi all,

I am unable to reach the gateway from FEX which is connected with Nexus 5k.But I am able to access gateway from the N5k switch.Fex is online and VPC also showing up.What could be the problem.Is there any configuration to fwd the traffic from nexus 2k to 5k.

N5K-PRI-BLR# sh fex

FEX         FEX           FEX                       FEX
Number    Description      State            Model            Serial
------------------------------------------------------------------------
102        FEX0102                Online     N2K-C2248TP-1GE   JAF1504ADQC
103        FEX0103               Online     N2K-C2248TP-1GE   JAF1504DMAP

N5K-PRI-BLR#

Thanks in advance

Regards,

Ajith

Jerry Ye · ‎09-23-2011

If you connect both N5Ks to core switch 1, it should work.

Regards,

jerry

View solution in original post

Jerry Ye · ‎09-23-2011

I don't have Nortel and not familiar with their product. All you have to configured on the Nortel is a regular PO using LACP.

Below is copied from your config, and it should be on both N5Ks:

interface port-channel20

description ***Uplink to CoreSwitch***

switchport mode trunk

vpc 20

interface Ethernet1/1
switchport mode trunk
speed 1000
channel-group 20 mode active <<< you enabled LACP, do the same on Nortel

interface Ethernet1/2
switchport mode trunk
channel-group 20 mode active <<< you enabled LACP, do the same on Nortel

HTH,

jerry

View solution in original post

Jerry Ye · ‎09-22-2011

Are they on the same VLAN?

Can you post a topology diagram and config? You've mentioned vPC, how is the other switch configured?

Regards,

jerry

smartboy2255 · ‎09-22-2011

Hi Jerry,

If I disconnect one fex link to Secondary 5K (ie fex 101) then I am able to ping from HostA the gateway .Same way if I disconnect fex link to primary 5K (ie fex 102) then I am able to ping from Host B.I am suspecting VPC 101 & 102 is not working properly.But VPC status & fex is showing up in both switches.

Pls find the topology & config file attached.

Regards,

Ajith

smartboy2255 · ‎09-22-2011

\

smartboy2255 · ‎09-22-2011

Primary Config

***********************************

N5K-PRI-BLR#

N5K-PRI-BLR# sh run

!Command: show running-config

version 5.0(2)N2(1)
feature fcoe

feature telnet
cfs eth distribute
feature udld
feature interface-vlan
feature lacp
feature vpc
feature lldp
feature fex

n
no password strength-check
ip domain-lookup
ip domain-lookup
hostname N5K-PRI-BLR
class-map type qos class-fcoe
class-map type queuing class-fcoe
[7m--More-- [m
match qos-group 1
class-map type queuing class-all-flood
match qos-group 2
class-map type queuing class-ip-multicast
match qos-group 2
class-map type network-qos class-fcoe
match qos-group 1
class-map type network-qos class-all-flood
match qos-group 2
class-map type network-qos class-ip-multicast
match qos-group 2
fex 101
pinning max-links 1
description "***N2K-Pri2K***"
fex 102
pinning max-links 1
description "***To -SEC2K**"
snmp-server user admin network-admin auth md5 0x3c47e8ce70ceb780b7ec0ccac5ac08be
priv 0x3c47e8ce70ceb780b7ec0ccac5ac08be localizedkey
snmp-server enable traps entity fru

vrf context management
ip route 0.0.0.0/0 10.10.10.2
[7m--More-- [m
vlan 1,133
vpc domain 133
role priority 4096
peer-keepalive destination 10.10.10.2 source 10.10.10.1

interface Vlan1
no shutdown

interface Vlan133
no shutdown
ip address 10.100.37.1/24

interface port-channel10
switchport mode trunk
vpc peer-link
spanning-tree port type network
speed 10000

interface port-channel20
description ***Uplink to CoreSwitch***
switchport mode trunk
vpc 20

[7m--More-- [m
interface port-channel101
description ***CONNT-N2K-1SEC***
switchport mode fex-fabric
vpc 101
fex associate 101

interface port-channel102
description ***CONNT-N2K-2SEC***
switchport mode fex-fabric
vpc 102
fex associate 102

interface fc2/1

interface fc2/2

interface fc2/3

interface fc2/4

interface fc2/5

interface fc2/6
[7m--More-- [m

[K
interface fc2/7

interface fc2/8

interface Ethernet1/1
switchport mode trunk
speed 1000
channel-group 20 mode active

interface Ethernet1/2
switchport mode trunk
channel-group 20 mode active

interface Ethernet1/3

interface Ethernet1/4

interface Ethernet1/5

interface Ethernet1/6

interface Ethernet1/7
[7m--More-- [m

[K
interface Ethernet1/8

interface Ethernet1/9

interface Ethernet1/10

interface Ethernet1/11

interface Ethernet1/12

interface Ethernet1/13

interface Ethernet1/14

interface Ethernet1/15

interface Ethernet1/16
speed 1000

interface Ethernet1/17

interface Ethernet1/18
[7m--More-- [m

[K
interface Ethernet1/19

interface Ethernet1/20

interface Ethernet1/21

interface Ethernet1/22

interface Ethernet1/23

interface Ethernet1/24

interface Ethernet1/25

interface Ethernet1/26

interface Ethernet1/27

interface Ethernet1/28

interface Ethernet1/29
switchport mode trunk
[7m--More-- [m

[K
interface Ethernet1/30

interface Ethernet1/31
description Connected to Nexus 5K
switchport mode trunk
channel-group 10 mode active

interface Ethernet1/32
description Connected to Nexus 5K
switchport mode trunk
channel-group 10 mode active

interface Ethernet2/1
description ***FEX 102***
fex associate 102
switchport mode fex-fabric
channel-group 102

interface Ethernet2/2
description ***Fex 101***
fex associate 101
switchport mode fex-fabric
[7m--More-- [m
channel-group 101

interface Ethernet2/3

interface Ethernet2/4

interface Ethernet2/5

interface Ethernet2/6
switchport mode trunk

interface Ethernet2/7

interface Ethernet2/8

interface mgmt0
ip address 10.10.10.1/30

interface Ethernet101/1/1

interface Ethernet101/1/2

interface Ethernet101/1/3
[7m--More-- [m

[K
interface Ethernet101/1/4

interface Ethernet101/1/5

interface Ethernet101/1/6

interface Ethernet101/1/7

interface Ethernet101/1/8

interface Ethernet101/1/9

interface Ethernet101/1/10

interface Ethernet101/1/11

interface Ethernet101/1/12

interface Ethernet101/1/13

interface Ethernet101/1/14

[7m--More-- [m
interface Ethernet101/1/15

interface Ethernet101/1/16

interface Ethernet101/1/17

interface Ethernet101/1/18

interface Ethernet101/1/19

interface Ethernet101/1/20

interface Ethernet101/1/21

interface Ethernet101/1/22

interface Ethernet101/1/23

interface Ethernet101/1/24

interface Ethernet101/1/25

interface Ethernet101/1/26
[7m--More-- [m

[K
interface Ethernet101/1/27

interface Ethernet101/1/28

interface Ethernet101/1/29

interface Ethernet101/1/30

interface Ethernet101/1/31

interface Ethernet101/1/32

interface Ethernet101/1/33

interface Ethernet101/1/34

interface Ethernet101/1/35

interface Ethernet101/1/36

interface Ethernet101/1/37

[7m--More-- [m
interface Ethernet101/1/38

interface Ethernet101/1/39

interface Ethernet101/1/40

interface Ethernet101/1/41

interface Ethernet101/1/42

interface Ethernet101/1/43

interface Ethernet101/1/44

interface Ethernet101/1/45

interface Ethernet101/1/46

interface Ethernet101/1/47

interface Ethernet101/1/48

interface Ethernet102/1/1
[7m--More-- [m

[K
interface Ethernet102/1/2

interface Ethernet102/1/3

interface Ethernet102/1/4

interface Ethernet102/1/5

interface Ethernet102/1/6

interface Ethernet102/1/7

interface Ethernet102/1/8

interface Ethernet102/1/9

interface Ethernet102/1/10

interface Ethernet102/1/11

interface Ethernet102/1/12

[7m--More-- [m
interface Ethernet102/1/13

interface Ethernet102/1/14

interface Ethernet102/1/15

interface Ethernet102/1/16

interface Ethernet102/1/17

interface Ethernet102/1/18

interface Ethernet102/1/19

interface Ethernet102/1/20

interface Ethernet102/1/21

interface Ethernet102/1/22

interface Ethernet102/1/23

interface Ethernet102/1/24
[7m--More-- [m

[K
interface Ethernet102/1/25

interface Ethernet102/1/26

interface Ethernet102/1/27

interface Ethernet102/1/28

interface Ethernet102/1/29

interface Ethernet102/1/30

interface Ethernet102/1/31

interface Ethernet102/1/32

interface Ethernet102/1/33

interface Ethernet102/1/34

interface Ethernet102/1/35

[7m--More-- [m
interface Ethernet102/1/36

interface Ethernet102/1/37

interface Ethernet102/1/38

interface Ethernet102/1/39

interface Ethernet102/1/40

interface Ethernet102/1/41

interface Ethernet102/1/42

interface Ethernet102/1/43

interface Ethernet102/1/44

interface Ethernet102/1/45

interface Ethernet102/1/46

interface Ethernet102/1/47
[7m--More-- [m

[K
interface Ethernet102/1/48
line console
line vty
boot kickstart bootflash:/n5000-uk9-kickstart.5.0.2.N2.1.bin
boot system bootflash:/n5000-uk9.5.0.2.N2.1.bin
interface fc2/1
interface fc2/2
interface fc2/3
interface fc2/4
interface fc2/5
interface fc2/6
interface fc2/7
interface fc2/8

N5K-PRI-BLR#

N5K-PRI-BLR# sh fex 101

FEX: 101 Description: ***N2K-Pri2K***   state: Online
FEX version: 5.0(2)N2(1) [Switch version: 5.0(2)N2(1)]
Extender Model: N2K-C2248TP-1GE, Extender Serial: JAF1504ADQC
Part No: 73-13232-01
pinning-mode: static    Max-links: 1
Fabric port for control traffic: Eth2/2
Fabric interface state:
    Po101 - Interface Up. State: Active
    Eth2/2 - Interface Up. State: Active

N5K-PRI-BLR#

N5K-PRI-BLR# [13D [J
N5K-PRI-BLR# sh fex 101 [J2

FEX: 102 Description: ***To -SEC2K**   state: Online
FEX version: 5.0(2)N2(1) [Switch version: 5.0(2)N2(1)]
Extender Model: N2K-C2248TP-1GE, Extender Serial: JAF1504DMAP
Part No: 73-13232-01
pinning-mode: static    Max-links: 1
Fabric port for control traffic: Eth2/1
Fabric interface state:
    Po102 - Interface Up. State: Active
    Eth2/1 - Interface Up. State: Active

N5K-PRI-BLR#

N5K-PRI-BLR# sh vpc bri [23D [J
N5K-PRI-BLR# sh vpc bri [Jef

Legend:
(*) - local vPC is down, forwarding via vPC peer-link

vPC domain id                   : 133
Peer status                     : peer adjacency formed ok
vPC keep-alive status           : peer is alive
Configuration consistency status: success
Per-vlan consistency status     : success
Type-2 consistency status       : success
vPC role                        : primary
Number of vPCs configured       : 99
Peer Gateway                    : Disabled
Dual-active excluded VLANs      : -
Graceful Consistency Check      : Enabled

vPC Peer-link status
---------------------------------------------------------------------
id   Port   Status Active vlans
--   ----   ------ --------------------------------------------------
1    Po10   up     1,133

vPC status
----------------------------------------------------------------------------
[7m--More-- [m
id     Port        Status Consistency Reason                     Active vlans
------ ----------- ------ ----------- -------------------------- -----------
20     Po20        down* failed      Consistency Check Not      -
                                      Performed
101    Po101       up     success     success                    -
102    Po102       up     success     success                    -
102400 Eth101/1/1 down* failed      Consistency Check Not      -
                                      Performed
102401 Eth101/1/2 up     success     success                    1

102402 Eth101/1/3 down* failed      Consistency Check Not      -
                                      Performed
102403 Eth101/1/4 down* failed      Consistency Check Not      -
                                      Performed
102404 Eth101/1/5 down* failed      Consistency Check Not      -
                                      Performed
102405 Eth101/1/6 down* failed      Consistency Check Not      -
                                      Performed
102406 Eth101/1/7 down* failed      Consistency Check Not      -
                                      Performed
102407 Eth101/1/8 down* failed      Consistency Check Not      -
                                      Performed
102408 Eth101/1/9 down* failed      Consistency Check Not      -
[7m--More-- [m
                                      Performed
102409 Eth101/1/10 down* failed      Consistency Check Not      -
                                      Performed
102410 Eth101/1/11 down* failed      Consistency Check Not      -
                                      Performed
102411 Eth101/1/12 down* failed      Consistency Check Not      -
                                      Performed
102412 Eth101/1/13 down* failed      Consistency Check Not      -
                                      Performed
102413 Eth101/1/14 down* failed      Consistency Check Not      -
                                      Performed
102414 Eth101/1/15 down* failed      Consistency Check Not      -
                                      Performed
102415 Eth101/1/16 down* failed      Consistency Check Not      -
                                      Performed
102416 Eth101/1/17 down* failed      Consistency Check Not      -
                                      Performed
102417 Eth101/1/18 down* failed      Consistency Check Not      -
                                      Performed
102418 Eth101/1/19 down* failed      Consistency Check Not      -
                                      Performed
102419 Eth101/1/20 down* failed      Consistency Check Not      -
                                      Performed
[7m--More-- [m
102420 Eth101/1/21 down* failed      Consistency Check Not      -
                                      Performed
102421 Eth101/1/22 down* failed      Consistency Check Not      -
                                      Performed
102422 Eth101/1/23 down* failed      Consistency Check Not      -
                                      Performed
102423 Eth101/1/24 down* failed      Consistency Check Not      -
                                      Performed
102424 Eth101/1/25 down* failed      Consistency Check Not      -
                                      Performed
102425 Eth101/1/26 down* failed      Consistency Check Not      -
                                      Performed
102426 Eth101/1/27 down* failed      Consistency Check Not      -
                                      Performed
102427 Eth101/1/28 down* failed      Consistency Check Not      -
                                      Performed
102428 Eth101/1/29 down* failed      Consistency Check Not      -
                                      Performed
102429 Eth101/1/30 down* failed      Consistency Check Not      -
                                      Performed
102430 Eth101/1/31 down* failed      Consistency Check Not      -
                                      Performed
102431 Eth101/1/32 down* failed      Consistency Check Not      -
[7m--More-- [m
                                      Performed
102432 Eth101/1/33 down* failed      Consistency Check Not      -
                                      Performed
102433 Eth101/1/34 down* failed      Consistency Check Not      -
                                      Performed
102434 Eth101/1/35 down* failed      Consistency Check Not      -
                                      Performed
102435 Eth101/1/36 down* failed      Consistency Check Not      -
                                      Performed
102436 Eth101/1/37 down* failed      Consistency Check Not      -
                                      Performed
102437 Eth101/1/38 down* failed      Consistency Check Not      -
                                      Performed
102438 Eth101/1/39 down* failed      Consistency Check Not      -
                                      Performed
102439 Eth101/1/40 down* failed      Consistency Check Not      -
                                      Performed
102440 Eth101/1/41 down* failed      Consistency Check Not      -
                                      Performed
102441 Eth101/1/42 down* failed      Consistency Check Not      -
                                      Performed
102442 Eth101/1/43 down* failed      Consistency Check Not      -
                                      Performed
[7m--More-- [m
102443 Eth101/1/44 down* failed      Consistency Check Not      -
                                      Performed
102444 Eth101/1/45 down* failed      Consistency Check Not      -
                                      Performed
102445 Eth101/1/46 down* failed      Consistency Check Not      -
                                      Performed
102446 Eth101/1/47 down* failed      Consistency Check Not      -
                                      Performed
102447 Eth101/1/48 down* failed      Consistency Check Not      -
                                      Performed
103424 Eth102/1/1 down* failed      Consistency Check Not      -
                                      Performed
103425 Eth102/1/2 down* failed      Consistency Check Not      -
                                      Performed
103426 Eth102/1/3 down* failed      Consistency Check Not      -
                                      Performed
103427 Eth102/1/4 down* failed      Consistency Check Not      -
                                      Performed
103428 Eth102/1/5 down* failed      Consistency Check Not      -
                                      Performed
103429 Eth102/1/6 down* failed      Consistency Check Not      -
                                      Performed
103430 Eth102/1/7 down* failed      Consistency Check Not      -
[7m--More-- [m
                                      Performed
103431 Eth102/1/8 down* failed      Consistency Check Not      -
                                      Performed
103432 Eth102/1/9 down* failed      Consistency Check Not      -
                                      Performed
103433 Eth102/1/10 down* failed      Consistency Check Not      -
                                      Performed
103434 Eth102/1/11 down* failed      Consistency Check Not      -
                                      Performed
103435 Eth102/1/12 down* failed      Consistency Check Not      -
                                      Performed
103436 Eth102/1/13 down* failed      Consistency Check Not      -
                                      Performed
103437 Eth102/1/14 down* failed      Consistency Check Not      -
                                      Performed
103438 Eth102/1/15 down* failed      Consistency Check Not      -
                                      Performed
103439 Eth102/1/16 down* failed      Consistency Check Not      -
                                      Performed
103440 Eth102/1/17 down* failed      Consistency Check Not      -
                                      Performed
103441 Eth102/1/18 down* failed      Consistency Check Not      -
                                      Performed
[7m--More-- [m
103442 Eth102/1/19 down* failed      Consistency Check Not      -
                                      Performed
103443 Eth102/1/20 down* failed      Consistency Check Not      -
                                      Performed
103444 Eth102/1/21 down* failed      Consistency Check Not      -
                                      Performed
103445 Eth102/1/22 down* failed      Consistency Check Not      -
                                      Performed
103446 Eth102/1/23 down* failed      Consistency Check Not      -
                                      Performed
103447 Eth102/1/24 down* failed      Consistency Check Not      -
                                      Performed
103448 Eth102/1/25 down* failed      Consistency Check Not      -
                                      Performed
103449 Eth102/1/26 down* failed      Consistency Check Not      -
                                      Performed
103450 Eth102/1/27 down* failed      Consistency Check Not      -
                                      Performed
103451 Eth102/1/28 down* failed      Consistency Check Not      -
                                      Performed
103452 Eth102/1/29 down* failed      Consistency Check Not      -
                                      Performed
103453 Eth102/1/30 down* failed      Consistency Check Not      -
[7m--More-- [m
                                      Performed
103454 Eth102/1/31 down* failed      Consistency Check Not      -
                                      Performed
103455 Eth102/1/32 down* failed      Consistency Check Not      -
                                      Performed
103456 Eth102/1/33 down* failed      Consistency Check Not      -
                                      Performed
103457 Eth102/1/34 down* failed      Consistency Check Not      -
                                      Performed
103458 Eth102/1/35 down* failed      Consistency Check Not      -
                                      Performed
103459 Eth102/1/36 down* failed      Consistency Check Not      -
                                      Performed
103460 Eth102/1/37 down* failed      Consistency Check Not      -
                                      Performed
103461 Eth102/1/38 down* failed      Consistency Check Not      -
                                      Performed
103462 Eth102/1/39 down* failed      Consistency Check Not      -
                                      Performed
103463 Eth102/1/40 down* failed      Consistency Check Not      -
                                      Performed
103464 Eth102/1/41 down* failed      Consistency Check Not      -
                                      Performed
[7m--More-- [m
103465 Eth102/1/42 down* failed      Consistency Check Not      -
                                      Performed
103466 Eth102/1/43 down* failed      Consistency Check Not      -
                                      Performed
103467 Eth102/1/44 down* failed      Consistency Check Not      -
                                      Performed
103468 Eth102/1/45 down* failed      Consistency Check Not      -
                                      Performed
103469 Eth102/1/46 down* failed      Consistency Check Not      -
                                      Performed
103470 Eth102/1/47 down* failed      Consistency Check Not      -
                                      Performed
103471 Eth102/1/48 down* failed      Consistency Check Not      -
                                      Performed

N5K-PRI-BLR#

Jerry Ye · ‎09-23-2011

I think I know the problem. You have vPC between the FEX and N5Ks, this set up requires configuration of the host port from both N5Ks.

On N5K1

interface Ethernet101/1/5

switchport

switchport mode access

switchport access vlan 133

On N5K2

interface Ethernet101/1/5

switchport

switchport mode access

switchport access vlan 133

Another way to do it is to use config-sync:

http://www.cisco.com/en/US/docs/switches/datacenter/nexus5000/sw/system_management/502_n1_1/Cisco_n5k_system_mgmt_cg_rel_502_n1_1_chapter3.html

HTH,

jerry

smartboy2255 · ‎09-23-2011

HI Jerry,

Thanks for valuable suggestions.I have configured Vlan in interface. Eventhough If I connected two Fex links from 2k then I am not able to ping.If I disconnect one llink ,I am able to ping the gateway.

Regards,

Ajith

Jerry Ye · ‎09-23-2011

So, did you tested what my suggestion?

Regards,

jerry

smartboy2255 · ‎09-23-2011

Yes I have tested with Vlan 133 & access port ..but still same issue..

Jerry Ye · ‎09-23-2011

Wait, your PO20 is a vPC? And it is not up. You need to connect your N5K2 to the core switch also.

Regards,

jerry

smartboy2255 · ‎09-23-2011

Yes Vpc 20 is for coreswitch.But as of now we have only one Core Switch.So we have connected Primary N5K to CoreSwitch1.Whether this design will work or not/

Regards,

Ajith

Jerry Ye · ‎09-23-2011

If you connect both N5Ks to core switch 1, it should work.

Regards,

jerry

smartboy2255 · ‎09-23-2011

So I can connect both N5K's to the same Core Switch.Can you pls share me the config for the same ?I am using nortel switch as core switch.Is it possible configure VPC towards the Same Core switch

Regards,

Ajith

Jerry Ye · ‎09-23-2011

I don't have Nortel and not familiar with their product. All you have to configured on the Nortel is a regular PO using LACP.

Below is copied from your config, and it should be on both N5Ks:

interface port-channel20

description ***Uplink to CoreSwitch***

switchport mode trunk

vpc 20

interface Ethernet1/1
switchport mode trunk
speed 1000
channel-group 20 mode active <<< you enabled LACP, do the same on Nortel

interface Ethernet1/2
switchport mode trunk
channel-group 20 mode active <<< you enabled LACP, do the same on Nortel

HTH,

jerry

smartboy2255 · ‎09-23-2011

Thanks a lot for timely help...I will test the same and let u know

Regards,

Ajith