Ask the Expert: C-Series Integration with Cisco Unified Computing System Manager

[ciscomoderator]

Welcome to the Cisco Support Community Ask the Expert conversation. This conversation is an opportunity to learn and ask questions about Cisco C-Series Integration with Cisco Unified Computing System® Manager (Cisco UCS® Manager) with Cisco experts Vishal Mehta and Manuel Velasco.

Cisco UCS C-Series Rack-Mount Servers are managed by the built-in standalone software, Cisco Integrated Management Controller (Cisco IMC). When a C-Series rack-mount server is integrated with Cisco UCS Manager, the IMC no longer manages the server. Instead you will manage the server using the Cisco UCS Manager GUI or Cisco UCS Manager command-line interface (CLI).

Cisco UCS Manager 2.2 provides three connectivity modes for Cisco UCS C-Series Rack-Mount Server management. The following are the connectivity modes:

• Dual-wire management (shared LAN On Motherboard [LOM]): Shared LOM ports on the rack server are used exclusively for carrying management traffic.A separate cable connected to one of the ports on the Payment Card Industry Express (PCIe) card carries the data traffic.

• SingleConnect (Sideband): Using Network Controller Sideband Interface (NC-SI), the Cisco UCS Virtual Interface Card 1225 (VIC1225) connects one cable that can carry both data and management traffic.

• Direct Connect Mode: Cisco UCS Manager Version 2.2 introduces an additional rack server management mode using direct connection to the Fabric Interconnect.

Vishal Mehta is a customer support engineer for Cisco’s Data Center Server Virtualization Technical Assistance Center (TAC) team based in San Jose, California. He has been working in the TAC for the past 3 years with a primary focus on data center technologies such as Cisco Nexus® 5000, Cisco UCS, Cisco Nexus 1000V, and virtualization. He presented at Cisco Live in Orlando 2013 and will present at Cisco Live Milan 2014 (BRKCOM-3003, BRKDCT-3444, and LABDCT-2333). He holds a master’s degree from Rutgers University in electrical and computer engineering and has CCIE® certification (number 37139) in routing and switching and service provider.

Manuel Velasco is a customer support engineer for Cisco’s Data Center Server Virtualization TAC team based in San Jose, California.  He has been working in the TAC for the past 3 years with a primary focus on data center technologies such as Cisco UCS, Cisco Nexus 1000V, and virtualization.  Manuel holds a master’s degree in electrical engineering from California Polytechnic State University (Cal Poly) and CCNA® and VMware VCP certifications. Remember to use the rating system to let Vishal and Manuel know if you have received an adequate response. 

Because of the volume expected during this event, our experts might not be able to answer every question. Remember that you can continue the conversation in the Data Center, under subcommunity, Unified Computing, shortly after the event. This event lasts through May 23, 2014. Visit this forum often to view responses to your questions and the questions of other Cisco Support Community members.

[Brad_80]

Is it possible to run multiple VIC 1225s in a UCSM-integrated C-series server for applications with greater bandwidth requirements? What about running additional VIC 1225s or another 10GbE NIC option that uplinks directly into a Nexus 5K for a dedicated VMware VSAN network, while still running the primary VIC 1225 into the FIs for manageability?

[Manuel Velasco]

Is it possible to run multiple VIC 1225s in a UCSM-integrated C-series server for applications with greater bandwidth requirements?

Yes, it is possible to have multiple VIC 1225 adapters to be manage by UCSM for additional bandwidth. Note that not all the UCS server support multiple VIC 1225, so only those servers with multi-VIC support will allow this particular configuration.

Cautions and Limitations for Adapter Cards (page 60)

http://www.cisco.com/c/en/us/td/docs/unified_computing/ucs/c-series_integration/ucsm2-2/b_C-Series-Integration_UCSM2-2.pdf

What about running additional VIC 1225s or another 10GbE NIC option that uplinks directly into a Nexus 5K for a dedicated VMware VSAN network, while still running the primary VIC 1225 into the FIs for manageability?

This is possible just note that you won’t be able to manage these adapters on UCSM, as there will be no link for data traffic through the fabric interconnects.   These adapters would need to be managed by the OS directly. Also note that if you decided to go with this configuration, the only way to upgrade the firmware for these devices you is by running the HUU utility as UCSM won't be able to upgrade them.

Please let me know if you have any other questions

[tenaro.gusatu.novici]

Hi guys,

I noticed that you are mentioning three different ways to integrate C series into UCS B. For someone that didn't play with that part at all but is familiar with UCS B series, can you first clarify if it is possible to C200 (or similar server) into existing UCS B installation so that new C200 behaves as another blade? What I mean by that is to allow FI6xxx to completely control new C200 via one cable, i.e. exchange ethernet and management traffic (and possibly fibre channel) between FI6xxx and C200.

Thanks,

Tenaro

[Vishal Mehta]

Hello Tenaro

Thank you for asking this question. 

Only mode supported for C200 with FI 6XXX is Dual-wire Management. The reason is C200 does not support VIC 1225 card which is essential for Single-wire connect

All the possible C-Series server integration and supported modes are listed on the link below (in table 1):

http://www.cisco.com/c/en/us/td/docs/unified_computing/ucs/c-series_integration/ucsm2-2/b_C-Series-Integration_UCSM2-2/b_C-Series-Integration_UCSM2-2_chapter_01.html

Hope this helps!

Thanks,

Vishal

[Sebastian Garcia]

Hello Vishal and Manuel,

Could you please tell me what is the difference between the modes of connecting C-Series with UCSM?

Thank you,

Sebastian

[Vishal Mehta]

Hello Sebastian,

The different modes of connecting C-Series with UCSM come into play depending on the type of infrastructure you already have along with C-Series and NIC model.

Cisco UCS C-Series Rack-Mount Servers are managed by the built-in standalone software, Cisco Integrated Management Controller (CIMC) .

Powerful features provided by Cisco UCS Manager can be leveraged to manage C-Series server by integrating  C-Series Rack-Mount Server with UCSM.

This not only gives you rich-feature set but also one management plane to operate UCS-B Series Chassis and UCS-C Series Rack Server.

You will manage the server using the Cisco UCS Manager GUI or Cisco UCS Manager CLI.

Cisco UCS Manager 2.2 provides three connectivity modes for Cisco UCS C-Series Rack-Mount Server management.

The following are the connectivity modes:

•  Dual-wire Management (Shared LOM):

Shared LAN on Motherboard (LOM) ports on the rack server are used exclusively for carrying management traffic. A separate cable connected to one of the ports on the PCIe card carries the data traffic. Using two separate cables for managing data traffic and management traffic is also referred to as dual-wire management.

http://www.cisco.com/c/en/us/td/docs/unified_computing/ucs/c-series_integration/ucsm2-2/b_C-Series-Integration_UCSM2-2/b_C-Series-Integration_UCSM2-2_chapter_0100.html

This mode is recommended when you have C-Server which does not  have or cannot support VIC 1225 card (such C-200 server)

•  SingleConnect (Sideband):

Using Network Controller Sideband Interface (NC-SI), Cisco UCS VIC1225 Virtual Interface Card (VIC) connects one cable that can carry both data traffic and management traffic.

This feature is referred to as SingleConnect.

http://www.cisco.com/c/en/us/td/docs/unified_computing/ucs/c-series_integration/ucsm2-2/b_C-Series-Integration_UCSM2-2/b_C-Series-Integration_UCSM2-2_chapter_011.html

This most recommended Integration model when using FEX and VIC 1225 card

•  Direct Connect Mode:

Cisco UCS Manager release version 2.2 introduces an additional rack server management mode using direct connection to the Fabric Interconnect.

This mode will eliminate the need for FEX module as Servers are directly plugged into the base ports of Fabric Interconnect

http://www.cisco.com/c/en/us/td/docs/unified_computing/ucs/c-series_integration/ucsm2-2/b_C-Series-Integration_UCSM2-2/b_C-Series-Integration_UCSM2-2_chapter_0110.html

Please let us know if you need more information. Thank you!

Thanks,

Vishal

[irina.shishkina.23]

Hello,

Please can you tell me is it possible to integrate UCS-C directly to the UCS Fabric Interconnect?  

Thank you

Irina

[Manuel Velasco]

Hi Irina,

Now with UCSM firmware 2.2 it is possible to directly connect your C-Series server to the fabric interconnects for UCSM integration.  Note that not every c-series server supports this feature and for those servers that support it, it is required to have one 1225 VIC card installed. Take a look at table 1 of the document below with a complete list of the server that support direct connect mode

Integrating C-Series Rack Mount Server with Cisco UCS Manager (page 2)

http://www.cisco.com/c/en/us/td/docs/unified_computing/ucs/c-series_integration/ucsm2-2/b_C-Series-Integration_UCSM2-2.pdf

[egordon310]

Hi Vishal, Manuel,

Good to see you guys doing another discussion.  I would like to know if it's possible to configure a server with a virtual interface card UCS P81E mode Single-Wire Management?

Thanks.

Evan

[Manuel Velasco]

Hi egordon,

Thank you for your questions we are also glad to hear from you.  Now we respect to you question:

it's possible to configure a server with a virtual interface card UCS P81E mode Single-Wire Management?

The answer to you question is "No" the reason for this is because the P81E can only carry data traffic and not management traffic. The only adapter that supports this mode is the VIC 1225. Please take a look at the document below on page 6.

UCS C-Series integration 2.1

http://www.cisco.com/c/en/us/td/docs/unified_computing/ucs/c-series_integration/ucsm2-1/b_UCSM2-1_C-Integration.pdf

Let me know if you have any questions.

[Christopher Duarte]

Hello - 

How can I configure multiple RAID volumes on UCSM if the "Service Profile" only lets me choose one? 

Thank you,

Chris

[Manuel Velasco]

Hi Chris,

You can’t configure multiple raid volumes in UCSM only one is allow.  For C-series server if you want to configure multiple raid volumes, you would have to configure them through the WebBIOS utility of the RAID adapter. For UCSM not to overwrite this configuration, you must create a local disk policy set to “Any Configuration” and assigned to the service profile of your c-series integrated server.    See below for configuration assistance using the WebBIOS utility

LSI MegaRAID SAS Controller Tasks

http://www.cisco.com/c/en/us/td/docs/unified_computing/ucs/c/sw/raid/configuration/guide/RAID_GUIDE/MegaRAID.html

[akhan0002]

Can you please explain what all the ports at the back are for? I find the multiplicity of ports confusing.

from the Left at the bottom, you have 4 'Shared LOM' Ports

then to the right of that you have a dedicated management port

then there is another port which i am not sure what it does.

for dual wire management do you connect the 'shared lom ports' as well as the data ports on the 1225?

[Vishal Mehta]

Hello A.Khan

Thank you for asking this question.

The left bottom 4 Shared LOM ports on the rack server are used exclusively for carrying management traffic in dual-wire management mode.

The right of that is RJ-45 10/100/1000 Ethernet management port excusilvely used for Cisco Integrated Management Controller (CIMC) firmware only.
This port will not be used in any of the modes of C-Series Integration (CIMC has to be disabled for integration)

Yes for the dual wire management - the data traffic will utilize only PCIE card ports (such as VIC 1225 or other vendors)
and for the management traffic the shared lom ports need to be used.

Thanks,
Vishal