UCS C-Series Server discovery with UCSM integration failed

alois.heilmaier · ‎06-11-2013

Hi, i try to install C460M2 and a C260M2 via fex 2232PP
Because we are waiting for delivery of VIC Cards I have to install the Servers via 2 wire.
This means I connected each Server with the 2 LOM gigabit ports to the nexus 2232PP (one port ono each nexus), and I also connected the 10 ge LOM to each of the nexus 2232PP.

My problem is the nexus 2232 are discovered, but no one of my servers get discovered. All Ports have link up, I can not find any log message on discovery error.
I know the 10 GE Server Ports are not supported, but I think the servers should get discovered.

Does anybody have an idea, wherecan I find all logg information and what filter ist suggested ?

Best Regards Alois

Sent from Cisco Technical Support iPad App

padramas · ‎06-11-2013

Hello Alois,

UCSM version ?

Make sure that the rack server firmware matches required version ( 1.4.3c for C460 ) for UCSM integration.

Preparing rack server for UCSM integration

http://www.cisco.com/en/US/customer/docs/unified_computing/ucs/c-series_integration/ucsm2.1/b_UCSM2-1_C-Integration_chapter_0100.html#task_564A203D8BB24341B8C72936358556DC

[EDIT] Supported adapters for Dual wire management ( UCSM 2.1 integration guide )

http://www.cisco.com/en/US/customer/docs/unified_computing/ucs/c-series_integration/ucsm2.1/b_UCSM2-1_C-Integration_chapter_011.html#concept_8C9C2163EF3346799BB76865C1B810D6

If you are not able to view the server in UCSM, power cycle the server ( by removing the power cord ).

After couple of minutes, rack server should appear under FEX and you can monitor the discovery process via FSM tab.

Padma

Message was edited by: padramas

Keny Perez · ‎06-11-2013

Alois,

"This means I connected each Server with the 2 LOM gigabit ports to the nexus 2232PP (one port ono each nexus), and I also connected the 10 ge LOM to each of the nexus 2232PP"

As Padma asked, we need to know the UCSM version cause it varies in 1.4 to 2.x.

If you check the link below, you see the different conections for those servers in UCSM 2.1, please let us if that matches 100%, cause the 10Gb ports are actually used.

http://www.cisco.com/en/US/docs/unified_computing/ucs/c-series_integration/ucsm2.1/b_UCSM2-1_C-Integration_chapter_011.html

Could you also please confirm that in UCSM under Equipment > Equipment> Global Policies > Rack Server Discovery Policy you have "Action" set as "Immediate" ???

-Kenny

alois.heilmaier · ‎06-11-2013

Hi Keny,

I tried to powercycle both servers (c260M2 and C460M2) but still no discovered server and also no logg.

I checked

Rack Server Discovery Policy == immediate

Rack management Connecton Policy == Auto Achnowledged

Chassis/Fex Doscovery Policy == 2 Link and Port-Channel (As I installed 2232PP I moved to Port Channel)

I am running UCSM Version 2.1(1e)

FI 6248 Version 5.0(3)N2(2.11e)

2232PP run on same as FI

I also have a connected 5108 with IOM 2104 running on 2.1(1e) Version.

CIMC Version of C260M2 and C460M2 will be checked tomorrow when my kolleague is in the datacenter.

Server Connection is not really the same like in http://www.cisco.com/en/US/docs/unified_computing/ucs/c-series_integration/ucsm2.1/b_UCSM2-1_C-Integration_chapter_011.html

Because I still have no VIC Card but the connections are the same.

C260 GE LOM1 <-> FEX2 Port 11
C260 GE LOM2 <-> FEX3 Port 11
C260 10 GE LOM1 (PCIE Slot4) <-> FEX2 Port 12
C260 10 GE LOM2 (PCIE Slot4) <-> FEX3 Port 12

GE LOM ist position 13 and 10 GE LOM is position 11 in the techspech of c260

http://www.cisco.com/en/US/docs/unified_computing/ucs/c/hw/C260/install/overview.html#wp1243740

C460 GE LOM1 <-> FEX2 Port 10

C460 GE LOM2 <-> FEX3 Port 10

C460 10 GE LOM1 <-> FEX2 Port 9

C460 10 GE LOM2 <-> FEX3 Port 9

GE LOM ist postion 8 and 10 GE LOM ist position 7

http://www.cisco.com/en/US/docs/unified_computing/ucs/c/hw/C460/install/overview.html#wp1243740

With C260 I also tried a reboot with disconnected 10 GE Ports, but also no discoverd Server until now.

Regards Alois

Keny Perez · ‎06-11-2013

Alois,

Could you please confirm type of cables you are using ? if possible, share the PID.

-Kenny

alois.heilmaier · ‎06-11-2013

Hi Keny,

I use on both fabrics same cable type, but I see a difference in the GLC-T Types (CISCO-AGILENT vs. CISCO-AVAGO) But only for the C460. C260 has the same GLC-T types:

FI<-> 2232PP:
# sh int eth 1/3 transceiver
Ethernet1/3
    transceiver is present
    type is SFP-H10GB-CU3M
    name is CISCO-TYCO
    part number is 1-2053783-2
    revision is R
    serial number is TED1703B1MV
    nominal bitrate is 10300 MBit/sec
    Link length supported for copper is 3 m
    cisco id is --
    cisco extended id number is 4

# sh int eth 1/4 transceiver
Ethernet1/4
    transceiver is present
    type is SFP-H10GB-CU3M
    name is CISCO-TYCO
    part number is 1-2053783-2
    revision is R
    serial number is TED1703B18P
    nominal bitrate is 10300 MBit/sec
    Link length supported for copper is 3 m
    cisco id is --
    cisco extended id number is 4

cables from 2232PP to Server

alois.heilmaier · ‎06-12-2013

Hi all,

now we found the problem, as my colleague was in the datacenter and had kvm access to the servers.
There was no factory default configuration of CIMC.

NIC mode was set to dedicated.

Now we have set to factory default, so both servers are now listet in UCSM.

Thank's to all, best regards

Alois

Keny Perez · ‎06-12-2013

Alois,

thanks for coming back with the solution.

You may mark your post as "answered"for future users having the same issue

-Kenny