How to bring up a brand new WS-C6509-E

[danny.lee]

Hi All,

Network newbie need to verify all necessary services and protocols on a new WS-C6509-E are turned on.  This layer 3 switch will be used to connect to servers

Thanks!

Cisco IOS Software, s72033_rp Software (s72033_rp-ADVIPSERVICESK9_WAN-M), Version 12.2(33)SXI9, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2012 by Cisco Systems, Inc.
Compiled Fri 24-Feb-12 21:38 by prod_rel_team

ROM: System Bootstrap, Version 12.2(17r)SX7, RELEASE SOFTWARE (fc1)

cisco WS-C6509-E (R7000) processor (revision 1.5) with 983008K/65536K bytes of memory.
Processor board ID xxxxxxxx
SR71000 CPU at 600Mhz, Implementation 0x504, Rev 1.2, 512KB L2 Cache
Last reset from s/w reset
4 Virtual Ethernet interfaces
307 Gigabit Ethernet interfaces
2 Ten Gigabit Ethernet interfaces
1917K bytes of non-volatile configuration memory.
8192K bytes of packet buffer memory.

65536K bytes of Flash internal SIMM (Sector size 512K).
Configuration register is 0x2102

WS-6509-E#sh mod
Mod Ports Card Type                              Model              Serial No.
--- ----- -------------------------------------- ------------------ -----------
  1   16  SFM-capable 16 port 1000mb GBIC        WS-X6516A-GBIC     xxxxxxxxxxx
  2   48  48-port 10/100/1000 RJ45 EtherModule   WS-X6148A-GE-45AF  xxxxxxxxxxx
  3   48  48-port 10/100/1000 RJ45 EtherModule   WS-X6148A-GE-45AF  xxxxxxxxxxx
  4   48  48-port 10/100/1000 RJ45 EtherModule   WS-X6148A-GE-45AF  xxxxxxxxxxx
  5    5  Supervisor Engine 720 10GE (Active)    VS-S720-10G        xxxxxxxxxxx
  7   48  48-port 10/100/1000 RJ45 EtherModule   WS-X6148A-GE-45AF  xxxxxxxxxxx
  8   48  48-port 10/100/1000 RJ45 EtherModule   WS-X6148A-GE-45AF  xxxxxxxxxxx
  9   48  48-port 10/100/1000 RJ45 EtherModule   WS-X6148A-GE-45AF  xxxxxxxxxxx

Mod MAC addresses                       Hw    Fw           Sw           Status
--- ---------------------------------- ------ ------------ ------------ -------
  1  2894.0fac.6c90 to 2894.0fac.6c9f   4.7   7.2(1)       12.2(33)SXI9 Ok
  2  5057.a80d.03a0 to 5057.a80d.03cf   4.2   8.4(1)       12.2(33)SXI9 Ok
  3  c464.13f0.2c88 to c464.13f0.2cb7   4.2   8.4(1)       12.2(33)SXI9 Ok
  4  5057.a80c.fe90 to 5057.a80c.febf   4.2   8.4(1)       12.2(33)SXI9 Ok
  5  e05f.b947.c881 to e05f.b947.c888   4.1   8.5(4)       12.2(33)SXI9 Ok
  7  c464.13f0.2bc8 to c464.13f0.2bf7   4.2   8.4(1)       12.2(33)SXI9 Ok
  8  5057.a80c.fb30 to 5057.a80c.fb5f   4.2   8.4(1)       12.2(33)SXI9 Ok
  9  442b.0378.3f00 to 442b.0378.3f2f   4.2   8.4(1)       12.2(33)SXI9 Ok

Mod  Sub-Module                  Model              Serial       Hw     Status
---- --------------------------- ------------------ ----------- ------- -------
  2  IEEE Voice Daughter Card    WS-F6K-48-AF       xxxxxxxxxxx  2.5    Ok
  3  IEEE Voice Daughter Card    WS-F6K-48-AF       xxxxxxxxxxx  2.5    Ok
  4  IEEE Voice Daughter Card    WS-F6K-48-AF       xxxxxxxxxxx  2.5    Ok
  5  Policy Feature Card 3       VS-F6K-PFC3C       xxxxxxxxxxx  1.1    Ok
  5  MSFC3 Daughterboard         VS-F6K-MSFC3       xxxxxxxxxxx  5.1    Ok
  7  IEEE Voice Daughter Card    WS-F6K-48-AF       xxxxxxxxxxx  2.5    Ok
  8  IEEE Voice Daughter Card    WS-F6K-48-AF       xxxxxxxxxxx  2.5    Ok
  9  IEEE Voice Daughter Card    WS-F6K-48-AF       xxxxxxxxxxx  2.5    Ok

[stephenshaw]

Hi,

a "show ver" will tell you what software version is active. From that you can determine the features available in the code via the Cisco web site.

Specific features require specific configurations in order to "activate" them. i.e. you won't need to "enable ospf" but you will need to configure "router ospf " as an example.

The 6148A modules may not be the best to use for actual server connections due to the oversubscription ratio of 8:1. This could cause connectivity problems for the servers. In my company we've run into this a couple of times over the years. A 6748 module allows 40 out of 48 ports to run without any oversubscription and would be a better choice for server connections.

It would be best to arrange to have someone (i.e. a consultant) with Cisco knowledge to sit with you and explain what you need to configure.

Regards,

Steve

[danny.lee]

Hi Stephen,

Thanks for the reply. 

I don't have a choice regarding 6148A modules being used for servers; however, what can I do configuration wise to resolve the oversubscription problem

Regards,

Network Newbie

[stephenshaw · Accepted solution]

Hi Danny,

the modules share buffer memory in groups of 8 on the 6148A modules as follows:

WS-X6148A-GE-TX: 1-8, 9-16, 17-24, 25-32, 33-40, 41-48

You cannot resolve the oversubscription problem because it is the design of the module itself. You can try to minimize it by ensuring you don't have the Top Talker servers all in the same port grouping.

It would be best to spread the Top Talker server connections between the different modules to ensure that no specific module has all of the top talking servers on it. Even within a module, connecting to different port groups can help.

It just depends upon how many servers and how much they are utilized.

As an example, I had to move one MAN connection (it was a 1G connection) onto a totally different module (and that was a 6748). As soon as I did that, the dropped packets problem went away.

This link provides the information on the 6148A module.

http://www.cisco.com/en/US/docs/switches/lan/catalyst6500/hardware/Module_Installation/Mod_Install_Guide/02ethern.html#wp1042813

Regards,

Steve

[danny.lee]

Hi Steve,

Thanks for the work around!

Regards,

Danny Lee

[stephenshaw · Accepted solution]

Hi Danny,

the easy way to figure out if you've run into server problems due to oversubscription is to make note of the following when server problems start occuring:

Which servers are reporting the problem?

Is there a common VLAN?

Is there a common switch?

Is there a common module?

What specific ports are the servers connected to?

Are they in a specific port group on a module?

How much bandwidth was being utilized by each affected server?

Like you, changing out the 8:1 oversubscription modules hasn't been an option for us but at least we are aware of it and know what to do if future server problems occur. And, as a go forward, we now only use 8:1 modules for User connections, not servers.

Cheers,

Steve

[danny.lee]

Hi Steve,

Thanks for the additional troubleshooting tips!

Regards,

Danny Lee