VIF Path - State Qual showing - Non Participating

Amit Vyas · ‎05-29-2013

Hi,

I have come across this problem / issue and need a help to resolve this issue.

Few days back we have setup new Cisco UCS System in our envinorment with 2xCisoc UCS 6248UP Fabirc Interconnect and 2xChasis with total 15 servers (Chassis-1 have 8 servers and Chassis-2 have 7 servers)

Problem: On Chassis 2 few blade servers are showing following error message when I see the VIP path option in UCSM. I want to know why I am facing this problem

Regards,

Amit Vyas

padramas · ‎05-29-2013

Hello Amit,

You can start with following checklist

Whether FI uplinks ( Eth and FC ) are active or not

Necessary VLANs are created on FI or not

Padma

Amit Vyas · ‎05-29-2013

I can only see this error on few blade servers on chassis-2. I am seeing this error on Chassis-1 at all for all 8 blades

-Amit

padramas · ‎05-29-2013

Hello Amit,

Please provide the output of following commands from xn-os prompt

show int bri

show int veth 968

sh int vfc 969

sh npv status

Padma

Amit Vyas · ‎05-29-2013

Thanks Padam for your help so far.. This problem got resolved after intalling ESXi on the blade.

Actullay we associated Service Profile and didn't installed any operating system on it

Following is the results of commands

--------------------------------------------------------------------------------

B(nxos)# show int bri

-------------------------------------------------------------------------------

Interface Vsan Admin Admin Status SFP Oper Oper Port

Mode Trunk Mode Speed Channel

Mode (Gbps)

-------------------------------------------------------------------------------

fc1/27 1 NP off sfpAbsent -- -- --

fc1/28 1 NP off sfpAbsent -- -- --

fc1/29 101 NP off up swl NP 8 --

fc1/30 101 NP off up swl NP 8 --

fc1/31 1 NP off sfpAbsent -- -- --

fc1/32 1 NP off sfpAbsent -- -- --

--------------------------------------------------------------------------------

Ethernet VLAN Type Mode Status Reason Speed Port

Interface Ch #

--------------------------------------------------------------------------------

Eth1/1 1 eth fabric up none 10G(D) --

Eth1/2 1 eth fabric up none 10G(D) --

Eth1/3 1 eth fabric up none 10G(D) --

Eth1/4 1 eth fabric up none 10G(D) --

Eth1/5 1 eth fabric up none 10G(D) --

Eth1/6 1 eth fabric up none 10G(D) --

Eth1/7 1 eth fabric up none 10G(D) --

Eth1/8 1 eth fabric up none 10G(D) --

Eth1/9 1 eth access down SFP not inserted 10G(D) --

Eth1/10 1 eth access down SFP not inserted 10G(D) --

Eth1/11 1 eth access down SFP not inserted 10G(D) --

Eth1/12 1 eth access down SFP not inserted 10G(D) --

Eth1/13 1 eth access down SFP not inserted 10G(D) --

Eth1/14 1 eth access down SFP not inserted 10G(D) --

Eth1/15 1 eth access down SFP not inserted 10G(D) --

Eth1/16 1 eth access down SFP not inserted 10G(D) --

Eth1/17 1 eth access down SFP not inserted 10G(D) --

Eth1/18 1 eth access down SFP not inserted 10G(D) --

Eth1/19 1 eth access down SFP not inserted 10G(D) --

Eth1/20 1 eth access down SFP not inserted 10G(D) --

Eth1/21 1 eth access down SFP not inserted 10G(D) --

Eth1/22 1 eth access down SFP not inserted 10G(D) --

Eth1/23 1 eth access down SFP not inserted 10G(D) --

Eth1/24 1 eth access down SFP not inserted 10G(D) --

Eth1/25 1 eth trunk up none 10G(D) --

Eth1/26 1 eth trunk up none 10G(D) --

--------------------------------------------------------------------------------

Port-channel VLAN Type Mode Status Reason Speed Protocol

Interface

--------------------------------------------------------------------------------

Po1284 1 eth vntag up none a-10G(D) none

Po1285 1 eth vntag up none a-10G(D) none

Po1288 1 eth vntag up none a-10G(D) none

Po1290 1 eth vntag up none a-10G(D) none

Po1292 1 eth vntag up none a-10G(D) none

Po1293 1 eth vntag up none a-10G(D) none

Po1294 1 eth vntag up none a-10G(D) none

Po1295 1 eth vntag up none a-10G(D) none

Po1308 1 eth vntag up none a-10G(D) none

Po1309 1 eth vntag up none a-10G(D) none

Po1315 1 eth vntag up none a-10G(D) none

Po1316 1 eth vntag up none a-10G(D) none

Po1317 1 eth vntag up none a-10G(D) none

Po1319 1 eth vntag up none a-10G(D) none

--------------------------------------------------------------------------------

Port VRF Status IP Address Speed MTU

--------------------------------------------------------------------------------

mgmt0 -- down 10.65.91.12 1000 1500

--------------------------------------------------------------------------------

Vethernet VLAN Type Mode Status Reason Speed

--------------------------------------------------------------------------------

Veth722 1 eth trunk up none auto

Veth723 1 eth trunk up none auto

Veth726 1 eth trunk up none auto

Veth727 1 eth trunk up none auto

Veth730 1 eth trunk up none auto

Veth731 1 eth trunk up none auto

Veth736 1 eth trunk up none auto

Veth737 1 eth trunk up none auto

Veth740 1 eth trunk up none auto

Veth741 1 eth trunk up none auto

Veth744 1 eth trunk up none auto

Veth745 1 eth trunk up none auto

Veth750 1 eth trunk up none auto

Veth751 1 eth trunk up none auto

Veth754 1 eth trunk up none auto

Veth755 1 eth trunk up none auto

Veth758 1 eth trunk up none auto

Veth759 1 eth trunk up none auto

Veth764 1 eth trunk up none auto

Veth765 1 eth trunk up none auto

Veth768 1 eth trunk up none auto

Veth769 1 eth trunk up none auto

Veth772 1 eth trunk up none auto

Veth773 1 eth trunk up none auto

Veth778 1 eth trunk up none auto

Veth779 1 eth trunk up none auto

Veth782 1 eth trunk up none auto

Veth783 1 eth trunk up none auto

Veth786 1 eth trunk up none auto

Veth787 1 eth trunk up none auto

Veth792 1 eth trunk up none auto

Veth793 1 eth trunk up none auto

Veth796 1 eth trunk up none auto

Veth797 1 eth trunk up none auto

Veth800 1 eth trunk up none auto

Veth801 1 eth trunk up none auto

Veth806 1 eth trunk up none auto

Veth807 1 eth trunk up none auto

Veth810 1 eth trunk up none auto

Veth811 1 eth trunk up none auto

Veth814 1 eth trunk up none auto

Veth815 1 eth trunk up none auto

Veth820 1 eth trunk up none auto

Veth821 1 eth trunk up none auto

Veth824 1 eth trunk up none auto

Veth825 1 eth trunk up none auto

Veth828 1 eth trunk up none auto

Veth829 1 eth trunk up none auto

Veth958 1 eth trunk up none auto

Veth959 1 eth trunk up none auto

Veth962 1 eth trunk up none auto

Veth963 1 eth trunk up none auto

Veth966 1 eth trunk up none auto

Veth967 1 eth trunk up none auto

Veth972 1 eth trunk up none auto

Veth973 1 eth trunk up none auto

Veth976 1 eth trunk up none auto

Veth977 1 eth trunk up none auto

Veth980 1 eth trunk up none auto

Veth981 1 eth trunk up none auto

Veth986 1 eth trunk down nonPartcipating auto

Veth987 1 eth trunk down nonPartcipating auto

Veth990 1 eth trunk down nonPartcipating auto

Veth991 1 eth trunk down nonPartcipating auto

Veth994 1 eth trunk down nonPartcipating auto

Veth995 1 eth trunk down nonPartcipating auto

Veth1000 1 eth trunk down nonPartcipating auto

Veth1001 1 eth trunk down nonPartcipating auto

Veth1004 1 eth trunk down nonPartcipating auto

Veth1005 1 eth trunk down nonPartcipating auto

Veth1008 1 eth trunk down nonPartcipating auto

Veth1009 1 eth trunk down nonPartcipating auto

Veth1014 1 eth trunk down nonPartcipating auto

Veth1015 1 eth trunk down nonPartcipating auto

Veth1018 1 eth trunk down nonPartcipating auto

Veth1019 1 eth trunk down nonPartcipating auto

Veth1022 1 eth trunk down nonPartcipating auto

Veth1023 1 eth trunk down nonPartcipating auto

Veth1042 1 eth trunk down nonPartcipating auto

Veth1043 1 eth trunk down nonPartcipating auto

Veth1046 1 eth trunk down nonPartcipating auto

Veth1047 1 eth trunk down nonPartcipating auto

Veth1050 1 eth trunk down nonPartcipating auto

Veth1051 1 eth trunk down nonPartcipating auto

Veth8926 71 eth access up none auto

Veth8940 71 eth access up none auto

Veth8954 71 eth access up none auto

Veth8968 71 eth access up none auto

Veth8982 71 eth access up none auto

Veth8996 71 eth access up none auto

Veth9010 71 eth access up none auto

Veth9024 71 eth access up none auto

Veth9162 71 eth access up none auto

Veth9176 71 eth access up none auto

Veth9190 71 eth access down nonPartcipating auto

Veth9204 71 eth access down nonPartcipating auto

Veth9218 71 eth access down nonPartcipating auto

Veth9246 71 eth access down nonPartcipating auto

-------------------------------------------------------------------------------

Interface Vsan Admin Admin Status SFP Oper Oper Port

Mode Trunk Mode Speed Channel

Mode (Gbps)

-------------------------------------------------------------------------------

vfc1026 101 F on BoundIfDown -- -- --

vfc776 101 F on trunking -- TF auto --

vfc790 101 F on trunking -- TF auto --

vfc1054 101 F on BoundIfDown -- -- --

vfc804 101 F on trunking -- TF auto --

vfc818 101 F on trunking -- TF auto --

vfc832 101 F on trunking -- TF auto --

vfc970 101 F on trunking -- TF auto --

vfc984 101 F on trunking -- TF auto --

vfc734 101 F on trunking -- TF auto --

vfc998 101 F on BoundIfDown -- -- --

vfc748 101 F on trunking -- TF auto --

vfc1012 101 F on BoundIfDown -- -- --

vfc762 101 F on trunking -- TF auto --

--------------------------------------------------------------------------------

Ethernet VLAN Type Mode Status Reason Speed Port

Interface Ch #

--------------------------------------------------------------------------------

Eth1/1/1 1 eth vntag up none 10G(D) 1284

Eth1/1/2 1 eth access down Administratively down 10G(D) --

Eth1/1/3 1 eth vntag up none 10G(D) 1288

Eth1/1/4 1 eth access down Administratively down 10G(D) --

Eth1/1/5 1 eth vntag up none 10G(D) 1290

Eth1/1/6 1 eth access down Administratively down 10G(D) --

Eth1/1/7 1 eth vntag up none 10G(D) 1285

Eth1/1/8 1 eth access down Administratively down 10G(D) --

Eth1/1/9 1 eth vntag up none 10G(D) 1294

Eth1/1/10 1 eth access down Administratively down 10G(D) --

Eth1/1/11 1 eth vntag up none 10G(D) 1295

Eth1/1/12 1 eth access down Administratively down 10G(D) --

Eth1/1/13 1 eth vntag up none 10G(D) 1292

Eth1/1/14 1 eth access down Administratively down 10G(D) --

Eth1/1/15 1 eth vntag up none 10G(D) 1293

Eth1/1/16 1 eth access down Administratively down 10G(D) --

Eth1/1/17 4044 eth trunk up none 1000(D) --

Eth2/1/1 1 eth access down Administratively down 10G(D) --

Eth2/1/2 1 eth access down Administratively down 10G(D) --

Eth2/1/3 1 eth vntag up none 10G(D) 1319

Eth2/1/4 1 eth access down Administratively down 10G(D) --

Eth2/1/5 1 eth vntag up none 10G(D) 1317

Eth2/1/6 1 eth access down Administratively down 10G(D) --

Eth2/1/7 1 eth vntag up none 10G(D) 1308

Eth2/1/8 1 eth access down Administratively down 10G(D) --

Eth2/1/9 1 eth vntag up none 10G(D) 1316

Eth2/1/10 1 eth access down Administratively down 10G(D) --

Eth2/1/11 1 eth vntag up none 10G(D) 1309

Eth2/1/12 1 eth access down Administratively down 10G(D) --

Eth2/1/13 1 eth access down Administratively down 10G(D) --

Eth2/1/14 1 eth access down Administratively down 10G(D) --

Eth2/1/15 1 eth vntag up none 10G(D) 1315

Eth2/1/16 1 eth access down Administratively down 10G(D) --

Eth2/1/17 4044 eth trunk up none 1000(D) --

--------------------------------------------------------------------------------

A(nxos)# show interface vethernet 968

Vethernet968 is up

Bound Interface is port-channel1318

Hardware: Virtual, address: 002a.6a0c.13c0 (bia 002a.6a0c.13c0)

Description: server 2/2, VNIC VM_Heart_Beat

Encapsulation ARPA

Port mode is trunk

EtherType is 0x8100

Rx

0 unicast packets 0 multicast packets 0 broadcast packets

0 input packets 0 bytes

0 input packet drops

Tx

0 unicast packets 0 multicast packets 0 broadcast packets

0 output packets 0 bytes

0 flood packets

0 output packet drops

--------------------------------------------------------------------------------

-A(nxos)# sh int vfc 969

vfc969 is trunking

Bound interface is Vethernet9161

Port description is server 2/2, VHBA FC_vHBA_1

Hardware is Virtual Fibre Channel

Port WWN is 23:c8:00:2a:6a:0c:13:ff

Admin port mode is F, trunk mode is on

snmp link state traps are enabled

Port mode is TF

Port vsan is 100

Trunk vsans (admin allowed and active) (100)

Trunk vsans (up) (100)

Trunk vsans (isolated) ()

Trunk vsans (initializing) ()

1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

48 frames input, 4800 bytes

0 discards, 0 errors

96 frames output, 11296 bytes

0 discards, 0 errors

last clearing of "show interface" counters never

Interface last changed at Wed May 29 22:40:53 2013

--------------------------------------------------------------------------------

A(nxos)# sh npv status

npiv is enabled

disruptive load balancing is disabled

External Interfaces:

====================

Interface: fc1/29, VSAN: 100, FCID: 0x011600, State: Up

Interface: fc1/30, VSAN: 100, FCID: 0x011700, State: Up

Number of External Interfaces: 2

Server Interfaces:

==================

Interface: vfc733, VSAN: 100, State: Up

Interface: vfc747, VSAN: 100, State: Up

Interface: vfc761, VSAN: 100, State: Up

Interface: vfc775, VSAN: 100, State: Up

Interface: vfc789, VSAN: 100, State: Up

Interface: vfc803, VSAN: 100, State: Up

Interface: vfc817, VSAN: 100, State: Up

Interface: vfc831, VSAN: 100, State: Up

Interface: vfc969, VSAN: 100, State: Up

Interface: vfc983, VSAN: 100, State: Up

Interface: vfc997, VSAN: 4094, State: Down

Interface: vfc1011, VSAN: 4094, State: Down

Interface: vfc1025, VSAN: 4094, State: Down

Interface: vfc1053, VSAN: 4094, State: Down

Number of Server Interfaces: 14

--------------------------------------------------------------------------------

rivabe123 · ‎10-16-2013

Hello Amit,

Did you get any feedback on this one?

Regards

Richard

Keny Perez · ‎10-16-2013

Richard,

This is an expected behavior (the "Non participating" message) when you have a Service Profile associated and there is no OS installed in the server...

Let me know if you have an OS installed and/OR see any other message.

-Kenny

rivabe123 · ‎10-16-2013

Hello Kenny,

This is indeed the case for me. Service porfiles are associated and no OS installed.

However, I have a second data center with the same setup and no OS installed. This one is not giving the errors Non Participating.

So that's a bit strange then right?

Richard

Keny Perez · ‎10-17-2013

Richard,

It is definitely weird but there are 2 conditions that need to be checked:

1-Both Data Centers have the same firmware?

2-Is one or both DCs running UCSM 2.1 by any chance?

In UCSM 2.1, there was a new feature added that is called Fault Suppression where you can actually tell the system to "know" it should not report this type of issue for reason A and/or B.

http://www.cisco.com/en/US/docs/unified_computing/ucs/sw/gui/config/guide/2.1/b_UCSM_GUI_Configuration_Guide_2_1.pdf <<<< Look for:

*Fault Suppression, and then

*Suppression Policies << I think "default-server-maint" would work — Suppresses faults for blade servers and/or rack servers. This policy applies to chassis, organizations, and service profiles."

Please check on that and let us know.

Rate all helpful answers

-Kenny

rivabe123 · ‎10-17-2013

Hello Kenny,

Both DC's have the same firmware and I know about the fault suppression. However that's only going to suppress the issue.

Both DC's are on version 2.1(3a).

No suppression policy has been defined.

Tomorrow I will install both locattions on site and will see what the status will be.

Let me know if you have any other info I can check.

Regards

Richard

Keny Perez · ‎10-17-2013

Richard,

Thanks for the info, then I think that what is weird is that the "Non participating" is not showing up on one of those DCs.

Only think I would recommend is basic troubleshooting, check for differences between one and the other and that will give you the culprit.

Try to post what you find tomorrow and if I am at the office I will give you a hand.

-Kenny