nexus fex (Link not connected)

[billybong]

Hi All, can some one please help me before i go crazy

i have a Nexus N5K-C5596UP connected to a N2K-C2248TP-1GE 

N5K-C5596UP, ports Eth 1 - 2 connected to the N2K-C2248TP-1GE uplink ports 1 - 2 via a pair of SFP-H10GB-CU3M cables

The problem i'm having is i can't connect to the C2248 i have added my config below if some one could take alook and tell what i'm missing i would appreciate it

switch# sh fex
switch#

interface port-channel101
switchport mode fex-fabric
fex associate 101

interface Ethernet1/1
switchport mode fex-fabric
fex associate 101
channel-group 101

interface Ethernet1/2
switchport mode fex-fabric
fex associate 101
channel-group 101

switch# sh int fex
Fabric Fabric Fex FEX
Fex Port Port State Uplink Model Serial
---------------------------------------------------------------
101 Eth1/1 Configured 0
101 Eth1/2 Configured 0
switch#

switch# sh int e1/1
Ethernet1/1 is down (Link not connected)
Dedicated Interface
Belongs to Po101
Hardware: 1000/10000 Ethernet, address: 002a.6a10.7388 (bia 002a.6a10.7388)
MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA
Port mode is fex-fabric
auto-duplex, 10 Gb/s, media type is 10G
Beacon is turned off
Input flow-control is off, output flow-control is off
Rate mode is dedicated
Switchport monitor is off
EtherType is 0x8100
Last link flapped never
Last clearing of "show interface" counters never
30 seconds input rate 0 bits/sec, 0 packets/sec
30 seconds output rate 0 bits/sec, 0 packets/sec
Load-Interval #2: 5 minute (300 seconds)
input rate 0 bps, 0 pps; output rate 0 bps, 0 pps
RX
0 unicast packets 0 multicast packets 0 broadcast packets
0 input packets 0 bytes
0 jumbo packets 0 storm suppression bytes
0 runts 0 giants 0 CRC 0 no buffer
0 input error 0 short frame 0 overrun 0 underrun 0 ignored
0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop
0 input with dribble 0 input discard
0 Rx pause
TX
0 unicast packets 0 multicast packets 0 broadcast packets
0 output packets 0 bytes
0 jumbo packets
0 output errors 0 collision 0 deferred 0 late collision
0 lost carrier 0 no carrier 0 babble 0 output discard
0 Tx pause
0 interface resets

switch# sh int e1/2
Ethernet1/2 is down (Link not connected)
Dedicated Interface
Belongs to Po101
Hardware: 1000/10000 Ethernet, address: 002a.6a10.7389 (bia 002a.6a10.7389)
MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA
Port mode is fex-fabric
auto-duplex, 10 Gb/s, media type is 10G
Beacon is turned off
Input flow-control is off, output flow-control is off
Rate mode is dedicated
Switchport monitor is off
EtherType is 0x8100
Last link flapped never
Last clearing of "show interface" counters never
30 seconds input rate 0 bits/sec, 0 packets/sec
30 seconds output rate 0 bits/sec, 0 packets/sec
Load-Interval #2: 5 minute (300 seconds)
input rate 0 bps, 0 pps; output rate 0 bps, 0 pps
RX
0 unicast packets 0 multicast packets 0 broadcast packets
0 input packets 0 bytes
0 jumbo packets 0 storm suppression bytes
0 runts 0 giants 0 CRC 0 no buffer
0 input error 0 short frame 0 overrun 0 underrun 0 ignored
0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop
0 input with dribble 0 input discard
0 Rx pause
TX
0 unicast packets 0 multicast packets 0 broadcast packets
0 output packets 0 bytes
0 jumbo packets
0 output errors 0 collision 0 deferred 0 late collision
0 lost carrier 0 no carrier 0 babble 0 output discard
0 Tx pause
0 interface resets

switch#
switch#

[Mark Malone]

Is there only 1 5k or are they paired at all , if there paired config needs to be made on both 5ks before it will come up and vpc 101 under your po101 interface

[billybong]

Hi Mark, thanks for getting back to me i only have one 5K

when i try to issue the vpc 101 command i get the below error

switch(config)#
switch(config)# int po101
switch(config-if)# vpc 101
^
% Invalid command at '^' marker.
switch(config-if)# vpc101
^
% Invalid command at '^' marker.
switch(config-if)# vpc ?
*** No matching command found in current mode, matching in (config) mode ***
bind-vrf Bind vrf

[Mark Malone]

you dont need it if only 1 5k switch , just for future ref you need to turn the feature on first in Nexus switches for vpc , vpc shares port-channel over 2 5k switches, if one side is configured but the others not it can cause link down

have you got your fex config in as below in global config other tahn that your config looks ok if just 1 5k - 2k

fex 101
  pinning max-links 1
  description "FEX0101"

can you post show fex 101

[billybong]

Yes i have

switch# sh fex 101
FEX 101 not found
switch#

switch#
switch# sh run

!Command: show running-config
!Time: Tue Nov 10 13:46:31 2015

version 5.2(1)N1(1)
hostname switch

feature telnet
feature lldp
feature fex

username admin password 5 $1$hkEssjeo$KPArM.MrfxfAXpGLaqNij/ role network-admin

no password strength-check

banner motd #Nexus 5000 Switch
#

ip domain-lookup
class-map type qos class-fcoe
class-map type queuing class-fcoe
match qos-group 1
class-map type queuing class-all-flood
match qos-group 2
class-map type queuing class-ip-multicast
match qos-group 2
class-map type network-qos class-fcoe
match qos-group 1
class-map type network-qos class-all-flood
match qos-group 2
class-map type network-qos class-ip-multicast
match qos-group 2
fex 101
pinning max-links 1
description "FEX0101"
snmp-server user admin network-admin auth md5 0x58d3626e68792f94bcce0dcfcefedc4f

priv 0x58d3626e68792f94bcce0dcfcefedc4f localizedkey

vrf context management
vlan 1
port-profile default max-ports 512

interface port-channel101
switchport mode fex-fabric
fex associate 101

--More--
interface Ethernet1/1
switchport mode fex-fabric
fex associate 101
channel-group 101

interface Ethernet1/2
switchport mode fex-fabric
fex associate 101
channel-group 101

interface Ethernet1/3

interface Ethernet1/4

interface Ethernet1/5

interface Ethernet1/6

interface Ethernet1/7

interface Ethernet1/8

interface Ethernet1/9

interface Ethernet1/10

interface Ethernet1/11

interface Ethernet1/12

interface Ethernet1/13

interface Ethernet1/14

interface Ethernet1/15

interface Ethernet1/16

interface Ethernet1/17

interface Ethernet1/18

interface Ethernet1/19

interface Ethernet1/20

--More--
interface Ethernet1/21

interface Ethernet1/22

interface Ethernet1/23

interface Ethernet1/24

interface Ethernet1/25

interface Ethernet1/26

interface Ethernet1/27

interface Ethernet1/28

interface Ethernet1/29

interface Ethernet1/30

interface Ethernet1/31

interface Ethernet1/32

interface Ethernet1/33

interface Ethernet1/34

interface Ethernet1/35

interface Ethernet1/36

interface Ethernet1/37

interface Ethernet1/38

interface Ethernet1/39

interface Ethernet1/40

interface Ethernet1/41

interface Ethernet1/42

interface Ethernet1/43

interface Ethernet1/44

interface Ethernet1/45

interface Ethernet1/46

interface Ethernet1/47

interface Ethernet1/48

interface mgmt0
line console
line vty
boot kickstart bootflash:/n5000-uk9-kickstart.5.2.1.N1.1.bin
boot system bootflash:/n5000-uk9.5.2.1.N1.1.bin

[Mark Malone]

config looks ok , are you getting any messages on the 5k when you try connect it up and power on  the fex , something usually shows up in the loggs

do you have any other cables in case the FETs on that one are dodgy or have you confirmed there ok

[billybong]

Thanks for confirming my config is ok, i have tried 2 other cables, i'm beginning to think the 2248 is faulty the Status LED is Amber

[Mark Malone · Accepted solution]

ye strange i would have thought your stat light on left was green once it was in working order whether uplinks are up or not

does anything appear in console loggs to show it even trying to form with 2k

can you see the cable present on 5k side show int e1/1 transciever fex

thiose cables are definitly supported on 5-2ks in doc for 2248s

http://www.cisco.com/c/en/us/products/collateral/switches/nexus-2000-series-fabric-extenders/data_sheet_c78-507093.html

[billybong]

Thanks for your all help Mark, it was driving me carzy

I have borrowed a N2K-C2148T-1GE and that is working fine
switch# sh fex
FEX FEX FEX FEX
Number Description State Model Serial
------------------------------------------------------------------------
101 FEX0101 Online N2K-C2148T-1GE FOX1414GJXK
switch#

With the 2248 i never recieved any logs or cli loggs refering to the extender, so it can only be faulty, i have given 5 stars

thanks again

[Mark Malone]

ah thats good to know at least it was the device itself and thanks