cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
9446
Views
5
Helpful
10
Replies

VIF Path - State Qual showing - Non Participating

Amit Vyas
Level 1
Level 1

Hi,

I have come across this problem / issue and need a help to resolve this issue.

Few days back we have setup new Cisco UCS System in our envinorment with 2xCisoc UCS 6248UP Fabirc Interconnect and 2xChasis with total 15 servers (Chassis-1 have 8 servers and Chassis-2 have 7 servers)

Problem: On Chassis 2 few blade servers are showing following error message when I see the VIP path option in UCSM. I want to know why I am facing this problem

Capture.PNG

Regards,

Amit Vyas

10 Replies 10

padramas
Cisco Employee
Cisco Employee

Hello Amit,

You can start with following checklist

Whether FI uplinks ( Eth and FC ) are active or not

Necessary VLANs are created on FI or not

Padma

I can only see this error on few blade servers on chassis-2. I am seeing this error on Chassis-1 at all for all 8 blades

-Amit

Hello Amit,

Please provide the output of following commands from xn-os prompt

show int bri

show int veth 968

sh int vfc 969

sh npv status

Padma

Thanks Padam for your help so far.. This problem got resolved after intalling ESXi on the blade.

Actullay we associated Service Profile and didn't installed any operating system on it

Following is the results of commands

--------------------------------------------------------------------------------

B(nxos)# show int bri

-------------------------------------------------------------------------------

Interface  Vsan   Admin  Admin   Status          SFP    Oper  Oper   Port

                  Mode   Trunk                          Mode  Speed  Channel

                         Mode                                 (Gbps)

-------------------------------------------------------------------------------

fc1/27     1      NP     off     sfpAbsent        --     --           --

fc1/28     1      NP     off     sfpAbsent        --     --           --

fc1/29     101    NP     off     up               swl    NP      8    --

fc1/30     101    NP     off     up               swl    NP      8    --

fc1/31     1      NP     off     sfpAbsent        --     --           --

fc1/32     1      NP     off     sfpAbsent        --     --           --

--------------------------------------------------------------------------------

Ethernet      VLAN   Type Mode   Status  Reason                   Speed     Port

Interface                                                                   Ch #

--------------------------------------------------------------------------------

Eth1/1        1      eth  fabric up      none                        10G(D) --

Eth1/2        1      eth  fabric up      none                        10G(D) --

Eth1/3        1      eth  fabric up      none                        10G(D) --

Eth1/4        1      eth  fabric up      none                        10G(D) --

Eth1/5        1      eth  fabric up      none                        10G(D) --

Eth1/6        1      eth  fabric up      none                        10G(D) --

Eth1/7        1      eth  fabric up      none                        10G(D) --

Eth1/8        1      eth  fabric up      none                        10G(D) --

Eth1/9        1      eth  access down    SFP not inserted            10G(D) --

Eth1/10       1      eth  access down    SFP not inserted            10G(D) --

Eth1/11       1      eth  access down    SFP not inserted            10G(D) --

Eth1/12       1      eth  access down    SFP not inserted            10G(D) --

Eth1/13       1      eth  access down    SFP not inserted            10G(D) --

Eth1/14       1      eth  access down    SFP not inserted            10G(D) --

Eth1/15       1      eth  access down    SFP not inserted            10G(D) --

Eth1/16       1      eth  access down    SFP not inserted            10G(D) --

Eth1/17       1      eth  access down    SFP not inserted            10G(D) --

Eth1/18       1      eth  access down    SFP not inserted            10G(D) --

Eth1/19       1      eth  access down    SFP not inserted            10G(D) --

Eth1/20       1      eth  access down    SFP not inserted            10G(D) --

Eth1/21       1      eth  access down    SFP not inserted            10G(D) --

Eth1/22       1      eth  access down    SFP not inserted            10G(D) --

Eth1/23       1      eth  access down    SFP not inserted            10G(D) --

Eth1/24       1      eth  access down    SFP not inserted            10G(D) --

Eth1/25       1      eth  trunk  up      none                        10G(D) --

Eth1/26       1      eth  trunk  up      none                        10G(D) --

--------------------------------------------------------------------------------

Port-channel VLAN  Type Mode   Status  Reason                    Speed  Protocol

Interface

--------------------------------------------------------------------------------

Po1284       1     eth  vntag  up      none                       a-10G(D)  none

Po1285       1     eth  vntag  up      none                       a-10G(D)  none

Po1288       1     eth  vntag  up      none                       a-10G(D)  none

Po1290       1     eth  vntag  up      none                       a-10G(D)  none

Po1292       1     eth  vntag  up      none                       a-10G(D)  none

Po1293       1     eth  vntag  up      none                       a-10G(D)  none

Po1294       1     eth  vntag  up      none                       a-10G(D)  none

Po1295       1     eth  vntag  up      none                       a-10G(D)  none

Po1308       1     eth  vntag  up      none                       a-10G(D)  none

Po1309       1     eth  vntag  up      none                       a-10G(D)  none

Po1315       1     eth  vntag  up      none                       a-10G(D)  none

Po1316       1     eth  vntag  up      none                       a-10G(D)  none

Po1317       1     eth  vntag  up      none                       a-10G(D)  none

Po1319       1     eth  vntag  up      none                       a-10G(D)  none

--------------------------------------------------------------------------------

Port   VRF          Status IP Address                              Speed    MTU

--------------------------------------------------------------------------------

mgmt0  --           down   10.65.91.12                             1000     1500

--------------------------------------------------------------------------------

Vethernet     VLAN   Type Mode   Status  Reason                   Speed

--------------------------------------------------------------------------------

Veth722       1      eth  trunk  up      none                       auto

Veth723       1      eth  trunk  up      none                       auto

Veth726       1      eth  trunk  up      none                       auto

Veth727       1      eth  trunk  up      none                       auto

Veth730       1      eth  trunk  up      none                       auto

Veth731       1      eth  trunk  up      none                       auto

Veth736       1      eth  trunk  up      none                       auto

Veth737       1      eth  trunk  up      none                       auto

Veth740       1      eth  trunk  up      none                       auto

Veth741       1      eth  trunk  up      none                       auto

Veth744       1      eth  trunk  up      none                       auto

Veth745       1      eth  trunk  up      none                       auto

Veth750       1      eth  trunk  up      none                       auto

Veth751       1      eth  trunk  up      none                       auto

Veth754       1      eth  trunk  up      none                       auto

Veth755       1      eth  trunk  up      none                       auto

Veth758       1      eth  trunk  up      none                       auto

Veth759       1      eth  trunk  up      none                       auto

Veth764       1      eth  trunk  up      none                       auto

Veth765       1      eth  trunk  up      none                       auto

Veth768       1      eth  trunk  up      none                       auto

Veth769       1      eth  trunk  up      none                       auto

Veth772       1      eth  trunk  up      none                       auto

Veth773       1      eth  trunk  up      none                       auto

Veth778       1      eth  trunk  up      none                       auto

Veth779       1      eth  trunk  up      none                       auto

Veth782       1      eth  trunk  up      none                       auto

Veth783       1      eth  trunk  up      none                       auto

Veth786       1      eth  trunk  up      none                       auto

Veth787       1      eth  trunk  up      none                       auto

Veth792       1      eth  trunk  up      none                       auto

Veth793       1      eth  trunk  up      none                       auto

Veth796       1      eth  trunk  up      none                       auto

Veth797       1      eth  trunk  up      none                       auto

Veth800       1      eth  trunk  up      none                       auto

Veth801       1      eth  trunk  up      none                       auto

Veth806       1      eth  trunk  up      none                       auto

Veth807       1      eth  trunk  up      none                       auto

Veth810       1      eth  trunk  up      none                       auto

Veth811       1      eth  trunk  up      none                       auto

Veth814       1      eth  trunk  up      none                       auto

Veth815       1      eth  trunk  up      none                       auto

Veth820       1      eth  trunk  up      none                       auto

Veth821       1      eth  trunk  up      none                       auto

Veth824       1      eth  trunk  up      none                       auto

Veth825       1      eth  trunk  up      none                       auto

Veth828       1      eth  trunk  up      none                       auto

Veth829       1      eth  trunk  up      none                       auto

Veth958       1      eth  trunk  up      none                       auto

Veth959       1      eth  trunk  up      none                       auto

Veth962       1      eth  trunk  up      none                       auto

Veth963       1      eth  trunk  up      none                       auto

Veth966       1      eth  trunk  up      none                       auto

Veth967       1      eth  trunk  up      none                       auto

Veth972       1      eth  trunk  up      none                       auto

Veth973       1      eth  trunk  up      none                       auto

Veth976       1      eth  trunk  up      none                       auto

Veth977       1      eth  trunk  up      none                       auto

Veth980       1      eth  trunk  up      none                       auto

Veth981       1      eth  trunk  up      none                       auto

Veth986       1      eth  trunk  down    nonPartcipating            auto

Veth987       1      eth  trunk  down    nonPartcipating            auto

Veth990       1      eth  trunk  down    nonPartcipating            auto

Veth991       1      eth  trunk  down    nonPartcipating            auto

Veth994       1      eth  trunk  down    nonPartcipating            auto

Veth995       1      eth  trunk  down    nonPartcipating            auto

Veth1000      1      eth  trunk  down    nonPartcipating            auto

Veth1001      1      eth  trunk  down    nonPartcipating            auto

Veth1004      1      eth  trunk  down    nonPartcipating            auto

Veth1005      1      eth  trunk  down    nonPartcipating            auto

Veth1008      1      eth  trunk  down    nonPartcipating            auto

Veth1009      1      eth  trunk  down    nonPartcipating            auto

Veth1014      1      eth  trunk  down    nonPartcipating            auto

Veth1015      1      eth  trunk  down    nonPartcipating            auto

Veth1018      1      eth  trunk  down    nonPartcipating            auto

Veth1019      1      eth  trunk  down    nonPartcipating            auto

Veth1022      1      eth  trunk  down    nonPartcipating            auto

Veth1023      1      eth  trunk  down    nonPartcipating            auto

Veth1042      1      eth  trunk  down    nonPartcipating            auto

Veth1043      1      eth  trunk  down    nonPartcipating            auto

Veth1046      1      eth  trunk  down    nonPartcipating            auto

Veth1047      1      eth  trunk  down    nonPartcipating            auto

Veth1050      1      eth  trunk  down    nonPartcipating            auto

Veth1051      1      eth  trunk  down    nonPartcipating            auto

Veth8926      71     eth  access up      none                       auto

Veth8940      71     eth  access up      none                       auto

Veth8954      71     eth  access up      none                       auto

Veth8968      71     eth  access up      none                       auto

Veth8982      71     eth  access up      none                       auto

Veth8996      71     eth  access up      none                       auto

Veth9010      71     eth  access up      none                       auto

Veth9024      71     eth  access up      none                       auto

Veth9162      71     eth  access up      none                       auto

Veth9176      71     eth  access up      none                       auto

Veth9190      71     eth  access down    nonPartcipating            auto

Veth9204      71     eth  access down    nonPartcipating            auto

Veth9218      71     eth  access down    nonPartcipating            auto

Veth9246      71     eth  access down    nonPartcipating            auto

-------------------------------------------------------------------------------

Interface  Vsan   Admin  Admin   Status          SFP    Oper  Oper   Port

                  Mode   Trunk                          Mode  Speed  Channel

                         Mode                                 (Gbps)

-------------------------------------------------------------------------------

vfc1026    101    F      on      BoundIfDown      --     --           --

vfc776     101    F      on      trunking         --     TF      auto --

vfc790     101    F      on      trunking         --     TF      auto --

vfc1054    101    F      on      BoundIfDown      --     --           --

vfc804     101    F      on      trunking         --     TF      auto --

vfc818     101    F      on      trunking         --     TF      auto --

vfc832     101    F      on      trunking         --     TF      auto --

vfc970     101    F      on      trunking         --     TF      auto --

vfc984     101    F      on      trunking         --     TF      auto --

vfc734     101    F      on      trunking         --     TF      auto --

vfc998     101    F      on      BoundIfDown      --     --           --

vfc748     101    F      on      trunking         --     TF      auto --

vfc1012    101    F      on      BoundIfDown      --     --           --

vfc762     101    F      on      trunking         --     TF      auto --

--------------------------------------------------------------------------------

Ethernet      VLAN   Type Mode   Status  Reason                   Speed     Port

Interface                                                                   Ch #

--------------------------------------------------------------------------------

Eth1/1/1      1      eth  vntag  up      none                        10G(D) 1284

Eth1/1/2      1      eth  access down    Administratively down       10G(D) --

Eth1/1/3      1      eth  vntag  up      none                        10G(D) 1288

Eth1/1/4      1      eth  access down    Administratively down       10G(D) --

Eth1/1/5      1      eth  vntag  up      none                        10G(D) 1290

Eth1/1/6      1      eth  access down    Administratively down       10G(D) --

Eth1/1/7      1      eth  vntag  up      none                        10G(D) 1285

Eth1/1/8      1      eth  access down    Administratively down       10G(D) --

Eth1/1/9      1      eth  vntag  up      none                        10G(D) 1294

Eth1/1/10     1      eth  access down    Administratively down       10G(D) --

Eth1/1/11     1      eth  vntag  up      none                        10G(D) 1295

Eth1/1/12     1      eth  access down    Administratively down       10G(D) --

Eth1/1/13     1      eth  vntag  up      none                        10G(D) 1292

Eth1/1/14     1      eth  access down    Administratively down       10G(D) --

Eth1/1/15     1      eth  vntag  up      none                        10G(D) 1293

Eth1/1/16     1      eth  access down    Administratively down       10G(D) --

Eth1/1/17     4044   eth  trunk  up      none                       1000(D) --

Eth2/1/1      1      eth  access down    Administratively down       10G(D) --

Eth2/1/2      1      eth  access down    Administratively down       10G(D) --

Eth2/1/3      1      eth  vntag  up      none                        10G(D) 1319

Eth2/1/4      1      eth  access down    Administratively down       10G(D) --

Eth2/1/5      1      eth  vntag  up      none                        10G(D) 1317

Eth2/1/6      1      eth  access down    Administratively down       10G(D) --

Eth2/1/7      1      eth  vntag  up      none                        10G(D) 1308

Eth2/1/8      1      eth  access down    Administratively down       10G(D) --

Eth2/1/9      1      eth  vntag  up      none                        10G(D) 1316

Eth2/1/10     1      eth  access down    Administratively down       10G(D) --

Eth2/1/11     1      eth  vntag  up      none                        10G(D) 1309

Eth2/1/12     1      eth  access down    Administratively down       10G(D) --

Eth2/1/13     1      eth  access down    Administratively down       10G(D) --

Eth2/1/14     1      eth  access down    Administratively down       10G(D) --

Eth2/1/15     1      eth  vntag  up      none                        10G(D) 1315

Eth2/1/16     1      eth  access down    Administratively down       10G(D) --

Eth2/1/17     4044   eth  trunk  up      none                       1000(D) --

--------------------------------------------------------------------------------

--------------------------------------------------------------------------------

A(nxos)# show interface vethernet 968

Vethernet968 is up

    Bound Interface is port-channel1318

  Hardware: Virtual, address: 002a.6a0c.13c0 (bia 002a.6a0c.13c0)

  Description: server 2/2, VNIC VM_Heart_Beat

  Encapsulation ARPA

  Port mode is trunk

  EtherType is 0x8100

  Rx

    0 unicast packets  0 multicast packets  0 broadcast packets

    0 input packets  0 bytes

    0 input packet drops

  Tx

    0 unicast packets  0 multicast packets  0 broadcast packets

    0 output packets  0 bytes

    0 flood packets

    0 output packet drops

--------------------------------------------------------------------------------

--------------------------------------------------------------------------------   

-A(nxos)# sh int vfc 969

vfc969 is trunking

    Bound interface is Vethernet9161

    Port description is server 2/2, VHBA FC_vHBA_1

    Hardware is Virtual Fibre Channel

    Port WWN is 23:c8:00:2a:6a:0c:13:ff

    Admin port mode is F, trunk mode is on

    snmp link state traps are enabled

    Port mode is TF

    Port vsan is 100

    Trunk vsans (admin allowed and active) (100)

    Trunk vsans (up)                       (100)

    Trunk vsans (isolated)                 ()

    Trunk vsans (initializing)             ()

    1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

    1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

      48 frames input, 4800 bytes

        0 discards, 0 errors

      96 frames output, 11296 bytes

        0 discards, 0 errors

    last clearing of "show interface" counters never

    Interface last changed at Wed May 29 22:40:53 2013

--------------------------------------------------------------------------------

--------------------------------------------------------------------------------

A(nxos)# sh npv status

npiv is enabled

disruptive load balancing is disabled

External Interfaces:

====================

  Interface: fc1/29, VSAN:  100, FCID: 0x011600, State: Up

  Interface: fc1/30, VSAN:  100, FCID: 0x011700, State: Up

  Number of External Interfaces: 2

Server Interfaces:

==================

  Interface: vfc733, VSAN:  100, State: Up

  Interface: vfc747, VSAN:  100, State: Up

  Interface: vfc761, VSAN:  100, State: Up

  Interface: vfc775, VSAN:  100, State: Up

  Interface: vfc789, VSAN:  100, State: Up

  Interface: vfc803, VSAN:  100, State: Up

  Interface: vfc817, VSAN:  100, State: Up

  Interface: vfc831, VSAN:  100, State: Up

  Interface: vfc969, VSAN:  100, State: Up

  Interface: vfc983, VSAN:  100, State: Up

  Interface: vfc997, VSAN: 4094, State: Down

  Interface: vfc1011, VSAN: 4094, State: Down

  Interface: vfc1025, VSAN: 4094, State: Down

  Interface: vfc1053, VSAN: 4094, State: Down

  Number of Server Interfaces: 14

--------------------------------------------------------------------------------

Hello Amit,

Did you get any feedback on this one?

Regards

Richard

Richard,

This is an expected behavior (the "Non participating" message) when you have a Service Profile associated and there is no OS installed in the server...

Let me know if you have an OS installed and/OR see any other message.

-Kenny

Hello Kenny,

This is indeed the case for me. Service porfiles are associated and no OS installed.

However, I have a second data center with the same setup and no OS installed. This one is not giving the errors Non Participating.

So that's a bit strange then right?

Richard

Richard,

It is definitely weird but there are 2 conditions that need to be checked:

1-Both Data Centers have the same firmware?

2-Is one or both DCs running UCSM 2.1 by any chance?

In UCSM 2.1, there was a new feature added that is called Fault Suppression where you can actually tell the system to "know" it should not report this type of issue for reason A and/or B.

http://www.cisco.com/en/US/docs/unified_computing/ucs/sw/gui/config/guide/2.1/b_UCSM_GUI_Configuration_Guide_2_1.pdf  <<<< Look for:

*Fault Suppression, and then

*Suppression Policies  << I think "default-server-maint" would work — Suppresses faults for blade servers and/or rack servers. This policy applies to chassis, organizations, and service profiles."

Please check on that and let us know.

Rate all helpful answers

-Kenny

Hello Kenny,

Both DC's have the same firmware and I know about the fault suppression. However that's only going to suppress the issue.

Both DC's are on version 2.1(3a).

No suppression policy has been defined.

Tomorrow I will install both locattions on site and will see what the status will be.

Let me know if you have any other info I can check.

Regards

Richard

Richard,

Thanks for the info, then I think that what is weird is that the "Non participating" is not showing up on one of those DCs.

Only think I would recommend is basic troubleshooting, check for differences between one and the other and that will give you the culprit.

Try to post what you find tomorrow and if I am at the office I will give you a hand.

-Kenny

Getting Started

Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community:

Review Cisco Networking products for a $25 gift card