Solved: Cisco FI 6248UP to Nexus 5Ks connectivity

Luke Akpor · ‎03-17-2013

Hi Guys,

Can someone please advise me the best way to implement the following connections?

I am trying to connect a pair of Fabric Interconnect (6248UP with 32ports) to a pair of Nexus 5Ks (5548UP) with the 5Ks connecting directly to the Storage (EMC). This is for a small deployment. The 5Ks will be running the full Fabric Services such as configuring the zoning, etc. By the way vPC will running between the FIs and the 5Ks for ethernet traffic only.

My question are:

1. What type of connection should I use between the 6248UP-FIs and the pair of 5Ks. Should I configure say 2 of the ports on the FIs as FC Uplink ports and use an FC SFP (e.g DS-SFP-FC8G-SW) for the connections? This way both the 5K and the FI will be running native FC in-between at 8G. Is this the best practice?

2. Is it possible to run FCoE from the FI directly to the 5Ks and just running the native FC from the 5K to the EMC Storage?

3. Is there any Cisco doc or someone's blog I can be pointed to that could help in the best practice for such scenario?

Any answers or further suggestions will be appreciated.

Thanks in advance.....

padramas · ‎03-17-2013

Hello Luke,

You can upgrade UCSM to 2.1.1a

Here is sample config for FCoE between FI and N5K switch.

##### On UCSM 2.1 ######

1) FC end mode

2) Configure a port as FCoE uplink and assign the interface to VSAN 10

http://www.cisco.com/en/US/products/ps10281/products_installation_and_configuration_guides_list.html

## Verifying the output

6248-01-A(nxos)# show run int vfc 1255

interface vfc1255

bind interface Ethernet1/24

switchport mode NP

no shutdown

##### Configuration on N5K #####

1) Enable NPIV,fcoe and lldp features

2) Create vlan, configure ethernet and VFC interfaces

----------- sample configuration ----------------

conf t

vlan 1001

fcoe vsan 10

interface Ethernet1/19

switchport mode trunk

spanning-tree port type edge

spanning-tree bpdufilter enable

no shutdown

int vfc 14

bind interface Ethernet1/19

switchport trunk allowed vsan 1

switchport trunk allowed vsan add 10

no shutdown

vsan database

vsan 10 interface vfc 119

------------------------------------

#### Comands to verify the configuration #####

show feature

show vlan

show fcoe vlan

show int vfc 119

show fcoe database

show flogi table

Padma

View solution in original post

Robert Burns · ‎03-26-2013

Add your second boot target "fc1" (guessing at the vHBA name) with the WWN of Fabric B's target.

Robert

View solution in original post

padramas · ‎03-17-2013

Hello Luke,

With UCSM 2.1.1, we can have FCoE between FI and N5K.

We have Flexpod design guide ( Netapp storage ) and you make use of information that fits your deployment.

http://www.cisco.com/en/US/docs/solutions/Enterprise/Data_Center/Virtualization/flexpod_deploy.html

HTH

Padma

Luke Akpor · ‎03-17-2013

Thanks Padma for the response and for the useful link,

I will have a good read through the doc later on, but one thing I did notice in the diargam is the FIs where still connected to the N5Ks using native FC which I guess is due to the FI being the order model running the older code which is fine.

Now that the UCSM2.1.1 supports FCOE between the FI and the N5K, I think my first step will be to upgrade to this latest code and test.

Are you abel to confirm what a possible configuration will be needed on the FI to support FCoE basically carrying the VSAN traffic accross to the N5Ks? Would I need to configure vfc, VSANs, VLANs on the FIs just the same way I would on the N5Ks?

Any possible link to this latest depolyment scenario will be appreciated.

Please note my intended plan is FI -----(FCoE)-----N5K-------(FC)------EMC.

Thanks for your help

Luke

padramas · ‎03-17-2013

Hello Luke,

You can upgrade UCSM to 2.1.1a

Here is sample config for FCoE between FI and N5K switch.

##### On UCSM 2.1 ######

1) FC end mode

2) Configure a port as FCoE uplink and assign the interface to VSAN 10

http://www.cisco.com/en/US/products/ps10281/products_installation_and_configuration_guides_list.html

## Verifying the output

6248-01-A(nxos)# show run int vfc 1255

interface vfc1255

bind interface Ethernet1/24

switchport mode NP

no shutdown

##### Configuration on N5K #####

1) Enable NPIV,fcoe and lldp features

2) Create vlan, configure ethernet and VFC interfaces

----------- sample configuration ----------------

conf t

vlan 1001

fcoe vsan 10

interface Ethernet1/19

switchport mode trunk

spanning-tree port type edge

spanning-tree bpdufilter enable

no shutdown

int vfc 14

bind interface Ethernet1/19

switchport trunk allowed vsan 1

switchport trunk allowed vsan add 10

no shutdown

vsan database

vsan 10 interface vfc 119

------------------------------------

#### Comands to verify the configuration #####

show feature

show vlan

show fcoe vlan

show int vfc 119

show fcoe database

show flogi table

Padma

Luke Akpor · ‎03-17-2013

Thanks Padma,

Trully appreciate your response and support.

Thanks

Luke

Luke Akpor · ‎03-25-2013

Hi Padma,

Just to give you some heads up on what I have done so far and to seek some more advice

I have upgraded the FIs to version 2.1.1b the lastest code and now running FCoE from the FI to both Nexus 5Ks with the config as below.

This issue now is for some reasons I can see all the vhba WWPN on Fabric A but not on Fabric B and the config is exactly the same. Is there anything i need to do on the UCS side of things to enable the initiators to login to fabic B.

Show flogi database on N5K1 shows as below:

N5K-SW1(config)# sh flogi database

--------------------------------------------------------------------------------

INTERFACE VSAN FCID PORT NAME NODE NAME

--------------------------------------------------------------------------------

fc1/31 1010 0x3b00ef 50:06:01:68:3e:e0:1c:e0 50:06:01:60:be:e0:1c:e0

fc1/32 1010 0x3b01ef 50:06:01:61:3e:e0:1c:e0 50:06:01:60:be:e0:1c:e0

vfc1010 1010 0x3b0000 22:d0:54:7f:ee:c0:74:bf 23:f2:54:7f:ee:c0:74:81

vfc1010 1010 0x3b0004 20:00:00:25:b5:00:02:0f 20:01:00:25:b5:00:01:6f

vfc1010 1010 0x3b0005 20:00:00:25:b5:00:02:2f 20:01:00:25:b5:00:01:9f

vfc1010 1010 0x3b0006 20:00:00:25:b5:00:01:ff 20:01:00:25:b5:00:01:7f

vfc1010 1010 0x3b0007 20:00:00:25:b5:00:00:9f 20:01:00:25:b5:00:01:8f

Total number of flogi = 7.

N5K-SW1(config)#

N5K-SW2(config-if)# sh flogi database

--------------------------------------------------------------------------------

INTERFACE VSAN FCID PORT NAME NODE NAME

--------------------------------------------------------------------------------

fc1/31 1020 0x7900ef 50:06:01:69:3e:e0:1c:e0 50:06:01:60:be:e0:1c:e0

fc1/32 1020 0x7901ef 50:06:01:60:3e:e0:1c:e0 50:06:01:60:be:e0:1c:e0

vfc1020 1020 0x790000 22:d1:54:7f:ee:c0:73:ff 23:fc:54:7f:ee:c0:73:c1

Total number of flogi = 3.

N5K-SW2(config-if)#

See configs as below, and thanks for your help in advance:

N5K1

vlan 1010

fcoe vsan 1010

name SAN_A_VLAN

vsan database

vsan 1010 name "SAN_A"

interface port-channel10

switchport mode trunk

switchport trunk allowed vlan 1010

speed 10000

interface port-channel11

switchport mode trunk

switchport trunk allowed vlan 1-1009,1021-4094

speed 10000

vpc 11

interface port-channel21

switchport mode trunk

switchport trunk allowed vlan 1-1009,1021-4094

speed 10000

vpc 21

interface vfc1010

bind interface port-channel10

switchport trunk allowed vsan 1010

no shutdown

vsan database

vsan 1010 interface vfc1010

vsan 1010 interface fc1/31

vsan 1010 interface fc1/32

N5K2

vlan 1020

fcoe vsan 1020

name SAN_B_VLAN

vsan database

vsan 1020 name "SAN_B"

interface port-channel11

switchport mode trunk

switchport trunk allowed vlan 1-1009,1021-4094

speed 10000

vpc 11

interface port-channel20

switchport mode trunk

switchport trunk allowed vlan 1020

speed 10000

interface port-channel21

switchport mode trunk

switchport trunk allowed vlan 1-1009,1021-4094

speed 10000

vpc 21

interface vfc1020

bind interface port-channel20

switchport trunk allowed vsan 1020

vsan database

vsan 1020 interface vfc1020

vsan 1020 interface fc1/31

vsan 1020 interface fc1/32

padramas · ‎03-26-2013

Hello Luke,

Please share the output of following command for a server where HBA configured for Fabric B has not logged in.

UCS-FI# show service-profile circuit server x/y ==> X and Y are Chassis & Blade numbers

UCS-FI# connect nxos b

UCS-FI(nxos) # show npv flogi-table

UCS-FI(nxos) # show int vfc

Padma

Luke Akpor · ‎03-26-2013

Hi Padma,

Thanks for your response. Please see below info as requested.

I could see the link state is error on fabric B but not sure why. The configs on both is the same?

Thanks

N6K-FI1-B# show service-profile circuit server 1/1

Service Profile: esx1_1

Server: 1/1

Fabric ID: A

VIF vNIC Link State Oper State Prot State Prot Role Admin Pin Oper Pin Transport

---------- --------------- ----------- ---------- ------------- ----------- ---------- ---------- ---------

728 eth0 Error Error No Protection Primary 0/0 0/0 Ether

730 eth1 Error Error No Protection Primary 0/0 0/0 Ether

732 fc0 Up Active No Protection Unprotected 0/0 0/0 Fc

8924 Up Active No Protection Unprotected 0/0 0/0 Ether

Fabric ID: B

VIF vNIC Link State Oper State Prot State Prot Role Admin Pin Oper Pin Transport

---------- --------------- ----------- ---------- ------------- ----------- ---------- ---------- ---------

729 eth0 Error Error No Protection Backup 0/0 0/0 Ether

731 eth1 Error Error No Protection Backup 0/0 0/0 Ether

733 fc1 Error Error No Protection Unprotected 0/0 0/0 Fc

8925 Error Error No Protection Unprotected 0/0 0/0 Ether

N6K-FI1-B# show service-profile circuit server 1/2

Service Profile: esx1_2

Server: 1/2

Fabric ID: A

VIF vNIC Link State Oper State Prot State Prot Role Admin Pin Oper Pin Transport

---------- --------------- ----------- ---------- ------------- ----------- ---------- ---------- ---------

699 eth0 Error Error No Protection Primary 0/0 0/0 Ether

701 eth1 Error Error No Protection Primary 0/0 0/0 Ether

703 fc0 Up Active No Protection Unprotected 0/0 0/10 Fc

8895 Up Active No Protection Unprotected 0/0 0/0 Ether

Fabric ID: B

VIF vNIC Link State Oper State Prot State Prot Role Admin Pin Oper Pin Transport

---------- --------------- ----------- ---------- ------------- ----------- ---------- ---------- ---------

700 eth0 Error Error No Protection Backup 0/0 0/0 Ether

702 eth1 Error Error No Protection Backup 0/0 0/0 Ether

704 fc1 Error Error No Protection Unprotected 0/0 0/0 Fc

8896 Error Error No Protection Unprotected 0/0 0/0 Ether

N6K-FI1-B# show service-profile circuit server 2/1

Service Profile: esx2_1

Server: 2/1

Fabric ID: A

VIF vNIC Link State Oper State Prot State Prot Role Admin Pin Oper Pin Transport

---------- --------------- ----------- ---------- ------------- ----------- ---------- ---------- ---------

705 eth0 Error Error No Protection Primary 0/0 0/0 Ether

707 eth1 Error Error No Protection Primary 0/0 0/0 Ether

709 fc0 Up Active No Protection Unprotected 0/0 0/10 Fc

8901 Up Active No Protection Unprotected 0/0 0/0 Ether

Fabric ID: B

VIF vNIC Link State Oper State Prot State Prot Role Admin Pin Oper Pin Transport

---------- --------------- ----------- ---------- ------------- ----------- ---------- ---------- ---------

706 eth0 Error Error No Protection Backup 0/0 0/0 Ether

708 eth1 Error Error No Protection Backup 0/0 0/0 Ether

710 fc1 Error Error No Protection Unprotected 0/0 0/0 Fc

8902 Error Error No Protection Unprotected 0/0 0/0 Ether

N6K-FI1-B# show service-profile circuit server 2/2

Service Profile: esx2_2

Server: 2/2

Fabric ID: A

VIF vNIC Link State Oper State Prot State Prot Role Admin Pin Oper Pin Transport

---------- --------------- ----------- ---------- ------------- ----------- ---------- ---------- ---------

711 eth0 Error Error No Protection Primary 0/0 0/0 Ether

713 eth1 Error Error No Protection Primary 0/0 0/0 Ether

715 fc0 Up Active No Protection Unprotected 0/0 0/10 Fc

8907 Up Active No Protection Unprotected 0/0 0/0 Ether

Fabric ID: B

VIF vNIC Link State Oper State Prot State Prot Role Admin Pin Oper Pin Transport

---------- --------------- ----------- ---------- ------------- ----------- ---------- ---------- ---------

712 eth0 Error Error No Protection Backup 0/0 0/0 Ether

714 eth1 Error Error No Protection Backup 0/0 0/0 Ether

716 fc1 Error Error No Protection Unprotected 0/0 0/0 Fc

8908 Error Error No Protection Unprotected 0/0 0/0 Ether

N6K-FI1-B#

N6K-FI1-B(nxos)# show npv flogi-table

No flogi sessions found.

N6K-FI1-B(nxos)#

vsan database

vsan 1020 interface vfc704

vsan 1020 interface vfc710

vsan 1020 interface vfc716

vsan 1020 interface vfc722

vsan 1020 interface vfc733

interface Ethernet1/5

description U: Uplink

pinning border

switchport mode trunk

switchport trunk allowed vlan 1-3

channel-group 21 mode active

no shutdown

N6K-FI1-B(nxos)# sh int vfc 704

vfc704 is down (Bound Physical Interface Down)

Bound interface is Vethernet8896

Port description is server 1/2, VHBA fc1

Hardware is Virtual Fibre Channel

Port WWN is 22:bf:54:7f:ee:c0:73:ff

Admin port mode is F, trunk mode is on

snmp link state traps are enabled

Port vsan is 1020

1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

0 frames input, 0 bytes

0 discards, 0 errors

0 frames output, 0 bytes

0 discards, 0 errors

last clearing of "show interface" counters never

N6K-FI1-B(nxos)# sh int vfc 716

vfc716 is down (Bound Physical Interface Down)

Bound interface is Vethernet8908

Port description is server 2/2, VHBA fc1

Hardware is Virtual Fibre Channel

Port WWN is 22:cb:54:7f:ee:c0:73:ff

Admin port mode is F, trunk mode is on

snmp link state traps are enabled

Port vsan is 1020

1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

0 frames input, 0 bytes

0 discards, 0 errors

0 frames output, 0 bytes

0 discards, 0 errors

last clearing of "show interface" counters never

N6K-FI1-B(nxos)# sh int vfc 710

vfc710 is down (Bound Physical Interface Down)

Bound interface is Vethernet8902

Port description is server 2/1, VHBA fc1

Hardware is Virtual Fibre Channel

Port WWN is 22:c5:54:7f:ee:c0:73:ff

Admin port mode is F, trunk mode is on

snmp link state traps are enabled

Port vsan is 1020

1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

0 frames input, 0 bytes

0 discards, 0 errors

0 frames output, 0 bytes

0 discards, 0 errors

last clearing of "show interface" counters never

N6K-FI1-B(nxos)# sh int vfc 733

vfc733 is down (Bound Physical Interface Down)

Bound interface is Vethernet8925

Port description is server 1/1, VHBA fc1

Hardware is Virtual Fibre Channel

Port WWN is 22:dc:54:7f:ee:c0:73:ff

Admin port mode is F, trunk mode is on

snmp link state traps are enabled

Port vsan is 1020

1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

0 frames input, 0 bytes

0 discards, 0 errors

0 frames output, 0 bytes

0 discards, 0 errors

last clearing of "show interface" counters never

N6K-FI1-B(nxos)# sh int vfc 722

vfc722 is trunking (Not all VSANs UP on the trunk)

Bound interface is port-channel20

Hardware is Virtual Fibre Channel

Port WWN is 22:d1:54:7f:ee:c0:73:ff

Admin port mode is NP, trunk mode is on

snmp link state traps are enabled

Port mode is TNP

Port vsan is 1020

Trunk vsans (admin allowed and active) (1,1020)

Trunk vsans (up) (1020)

Trunk vsans (isolated) ()

Trunk vsans (initializing) (1)

1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

165 frames input, 73020 bytes

0 discards, 0 errors

150 frames output, 17404 bytes

0 discards, 0 errors

last clearing of "show interface" counters never

Interface last changed at Tue Mar 26 00:20:40 2013

N6K-FI1-B(nxos)#

Thanks once again.

padramas · ‎03-26-2013

Since all vNIC / vHBA of all servers are in down state for Fabric B, can you verify the whether the links between FI B and IOM are up and active ?

Padma

Luke Akpor · ‎03-26-2013

Hi Padma,

Yes, I can confirm that the links between FI-B and IOM are all up and active.

Not really sure what the issue is here as the configs is the same on both FIs and N5Ks.

Is there any other area I need to check please?

Thanks

padramas · ‎03-26-2013

FI and IOM model ?

Number of links between FI and IOM

From FI B NX-OS

sh int bri

show int veth 8925

Padma

Luke Akpor · ‎03-26-2013

FI - 6248

IOM - 2204

Number of links between FI and IOM - 1 uplink from each IOM to each FI

N6K-FI1-B(nxos)# sh int bri

--------------------------------------------------------------------------------

Ethernet VLAN Type Mode Status Reason Speed Port

Interface Ch #

--------------------------------------------------------------------------------

Eth1/1 1 eth fabric up none 10G(D) --

Eth1/2 1 eth fabric up none 10G(D) --

Eth1/3 1 eth trunk up none 10G(D) 21

Eth1/4 1 eth access down SFP not inserted 10G(D) --

Eth1/5 1 eth trunk down Link not connected 10G(D) 21

Eth1/6 1 eth access down SFP not inserted 10G(D) --

Eth1/7 1 eth access down SFP not inserted 10G(D) --

Eth1/8 1 eth access down SFP not inserted 10G(D) --

Eth1/9 1 eth access down SFP not inserted 10G(D) --

Eth1/10 1 eth access down SFP not inserted 10G(D) --

Eth1/11 1 eth access down SFP not inserted 10G(D) --

Eth1/12 1 eth access down SFP not inserted 10G(D) --

Eth1/13 1 eth access down SFP not inserted 10G(D) --

Eth1/14 1 eth access down SFP not inserted 10G(D) --

Eth1/15 1 eth access down SFP not inserted 10G(D) --

Eth1/16 1 eth access down SFP not inserted 10G(D) --

Eth1/17 4049 eth trunk up none 10G(D) 20

Eth1/18 4049 eth trunk up none 10G(D) 20

Eth1/19 1 eth access down SFP not inserted 10G(D) --

Eth1/20 1 eth access down SFP not inserted 10G(D) --

Eth1/21 1 eth access down SFP not inserted 10G(D) --

Eth1/22 1 eth access down SFP not inserted 10G(D) --

Eth1/23 1 eth access down SFP not inserted 10G(D) --

Eth1/24 1 eth access down SFP not inserted 10G(D) --

Eth1/25 1 eth access down SFP not inserted 10G(D) --

Eth1/26 1 eth access down SFP not inserted 10G(D) --

Eth1/27 1 eth access down SFP not inserted 10G(D) --

Eth1/28 1 eth access down SFP not inserted 10G(D) --

Eth1/29 1 eth access down SFP not inserted 10G(D) --

Eth1/30 1 eth access down SFP not inserted 10G(D) --

Eth1/31 1 eth access down SFP not inserted 10G(D) --

Eth1/32 1 eth access down SFP not inserted 10G(D) --

--------------------------------------------------------------------------------

Port-channel VLAN Type Mode Status Reason Speed Protocol

Interface

--------------------------------------------------------------------------------

Po20 4049 eth trunk up none a-10G(D) lacp

Po21 1 eth trunk up none a-10G(D) lacp

Po1283 1 eth vntag up none a-10G(D) none

Po1285 1 eth vntag up none a-10G(D) none

Po1286 1 eth vntag up none a-10G(D) none

Po1287 1 eth vntag up none a-10G(D) none

--------------------------------------------------------------------------------

Port VRF Status IP Address Speed MTU

--------------------------------------------------------------------------------

mgmt0 -- down 10.167.11.233 100 1500

--------------------------------------------------------------------------------

Vethernet VLAN Type Mode Status Reason Speed

--------------------------------------------------------------------------------

Veth700 1 eth trunk down nonPartcipating auto

Veth702 1 eth trunk down nonPartcipating auto

Veth706 1 eth trunk down nonPartcipating auto

Veth708 1 eth trunk down nonPartcipating auto

Veth712 1 eth trunk down nonPartcipating auto

Veth714 1 eth trunk down nonPartcipating auto

Veth729 1 eth trunk down nonPartcipating auto

Veth731 1 eth trunk down nonPartcipating auto

Veth8896 1020 eth access down nonPartcipating auto

Veth8902 1020 eth access down nonPartcipating auto

Veth8908 1020 eth access down nonPartcipating auto

Veth8925 1020 eth access down nonPartcipating auto

-------------------------------------------------------------------------------

Interface Vsan Admin Admin Status SFP Oper Oper Port

Mode Trunk Mode Speed Channel

Mode (Gbps)

-------------------------------------------------------------------------------

vfc704 1020 F on BoundIfDown -- -- --

vfc710 1020 F on BoundIfDown -- -- --

vfc716 1020 F on BoundIfDown -- -- --

vfc722 1020 NP on trunking -- TNP auto --

vfc733 1020 F on BoundIfDown -- -- --

--------------------------------------------------------------------------------

Ethernet VLAN Type Mode Status Reason Speed Port

Interface Ch #

--------------------------------------------------------------------------------

Eth1/1/1 1 eth vntag up none 10G(D) 1286

Eth1/1/2 1 eth vntag up none 10G(D) 1286

Eth1/1/3 1 eth vntag up none 10G(D) 1286

Eth1/1/4 1 eth vntag up none 10G(D) 1286

Eth1/1/5 1 eth vntag up none 10G(D) 1287

Eth1/1/6 1 eth vntag up none 10G(D) 1287

Eth1/1/7 1 eth vntag up none 10G(D) 1287

Eth1/1/8 1 eth vntag up none 10G(D) 1287

Eth1/1/9 1 eth access down Administratively down 10G(D) --

Eth1/1/10 1 eth access down Administratively down 10G(D) --

Eth1/1/11 1 eth access down Administratively down 10G(D) --

Eth1/1/12 1 eth access down Administratively down 10G(D) --

Eth1/1/13 1 eth access down Administratively down 10G(D) --

Eth1/1/14 1 eth access down Administratively down 10G(D) --

Eth1/1/15 1 eth access down Administratively down 10G(D) --

Eth1/1/16 1 eth access down Administratively down 10G(D) --

Eth1/1/17 1 eth access down Administratively down 10G(D) --

Eth1/1/18 1 eth access down Administratively down 10G(D) --

Eth1/1/19 1 eth access down Administratively down 10G(D) --

Eth1/1/20 1 eth access down Administratively down 10G(D) --

Eth1/1/21 1 eth access down Administratively down 10G(D) --

Eth1/1/22 1 eth access down Administratively down 10G(D) --

Eth1/1/23 1 eth access down Administratively down 10G(D) --

Eth1/1/24 1 eth access down Administratively down 10G(D) --

Eth1/1/25 1 eth access down Administratively down 10G(D) --

Eth1/1/26 1 eth access down Administratively down 10G(D) --

Eth1/1/27 1 eth access down Administratively down 10G(D) --

Eth1/1/28 1 eth access down Administratively down 10G(D) --

Eth1/1/29 1 eth access down Administratively down 10G(D) --

Eth1/1/30 1 eth access down Administratively down 10G(D) --

Eth1/1/31 1 eth access down Administratively down 10G(D) --

Eth1/1/32 1 eth access down Administratively down 10G(D) --

Eth1/1/33 4044 eth trunk up none 1000(D) --

Eth2/1/1 1 eth vntag up none 10G(D) 1283

Eth2/1/2 1 eth vntag up none 10G(D) 1283

Eth2/1/3 1 eth vntag up none 10G(D) 1285

Eth2/1/4 1 eth vntag up none 10G(D) 1285

Eth2/1/5 1 eth access down Administratively down 10G(D) --

Eth2/1/6 1 eth access down Administratively down 10G(D) --

Eth2/1/7 1 eth access down Administratively down 10G(D) --

Eth2/1/8 1 eth access down Administratively down 10G(D) --

Eth2/1/9 1 eth access down Administratively down 10G(D) --

Eth2/1/10 1 eth access down Administratively down 10G(D) --

Eth2/1/11 1 eth access down Administratively down 10G(D) --

Eth2/1/12 1 eth access down Administratively down 10G(D) --

Eth2/1/13 1 eth access down Administratively down 10G(D) --

Eth2/1/14 1 eth access down Administratively down 10G(D) --

Eth2/1/15 1 eth access down Administratively down 10G(D) --

Eth2/1/16 1 eth access down Administratively down 10G(D) --

Eth2/1/17 4044 eth trunk up none 1000(D) --

N6K-FI1-B(nxos)#

N6K-FI1-B(nxos)# show int veth 8925

Vethernet8925 is down (nonPartcipating)

Bound Interface is --

Hardware: Virtual, address: 547f.eec0.73a0 (bia 547f.eec0.73a0)

Description: server 1/1, VHBA fc1

Encapsulation ARPA

Port mode is access

EtherType is 0x8100

Rx

0 unicast packets 0 multicast packets 0 broadcast packets

0 input packets 0 bytes

0 input packet drops

Tx

0 unicast packets 0 multicast packets 0 broadcast packets

0 output packets 0 bytes

0 flood packets

0 output packet drops

N6K-FI1-B(nxos)#

Thank once again

padramas · ‎03-26-2013

Are these servers in production ?

If not, rebooting the server or dis-associating / re-associating service profile might resolve the issue. However, if you could collect UCSM and Chassis 1 tech support before making any changes so that we can figure out following state.

N6K-FI1-B(nxos)# show int veth 8925

Vethernet8925 is down (nonPartcipating)

Bound Interface is --

Please open TAC Service request for further investigation.

Padma

Luke Akpor · ‎03-26-2013

Hi Padma,

Can you please confirm what exact commands I need to collect the info prior to rebooting the servers?

The server are not yet in production but should be soon if I could resolve this issue.

Thanks very much for your help.

I will raise a TAC case as advised too.

Luke

padramas · ‎03-26-2013

The following guide includes screen shots on how to collect UCSM and Chassis tech support bundle.

http://www.cisco.com/en/US/products/ps10281/products_tech_note09186a0080bdf11c.shtml