Solved: Failure on boot

Rosa Ladeira · ‎07-22-2011

I have bougth a new supervisor WS-SUP32-10GE-3B.

I am using an old chassis (WS-C6509) and an old fan (WS-C6K-9SLOT-FAN).

boot fails !

Any suggestion ?

Hardware configuration:

Router#sh module

Mod Ports Card Type Model Serial No.

--- -

-

5 3 Supervisor Engine 32 10GE (Active) WS-SUP32-10GE-3B SAL15056BAB

Mod MAC addresses Hw Fw Sw Status

--- -

-

5 68ef.bd85.0814 to 68ef.bd85.0819 1.8 12.2(18r)SX9 12.2(33)SXI5 Ok

Mod Sub-Module Model Serial Hw Status

-

5 Policy Feature Card 3 WS-F6K-PFC3B SAL15056A6Z 2.6 Ok

5 Cat6k MSFC 2A daughterboard WS-F6K-MSFC2A SAL15066UHJ 4.1 Ok

Mod Online Diag Status

-

5 Pass

Router#show inventory

NAME: "WS-C6509", DESCR: "Cisco Systems Catalyst 6500 9-slot Chassis System"

PID: WS-C6509 , VID: , SN: TBM06124103

NAME: "WS-C6K-VTT 1", DESCR: "VTT FRU 1"

PID: WS-C6K-VTT , VID: , SN: SMT0609D809

NAME: "WS-C6K-VTT 2", DESCR: "VTT FRU 2"

PID: WS-C6K-VTT , VID: , SN: SMT0609C421

NAME: "WS-C6K-VTT 3", DESCR: "VTT FRU 3"

PID: WS-C6K-VTT , VID: , SN: SMT0609C394

NAME: "WS-C6000-CL 1", DESCR: "C6K Clock FRU 1"

PID: WS-C6000-CL , VID: , SN: SMT0607C685

NAME: "WS-C6000-CL 2", DESCR: "C6K Clock FRU 2"

PID: WS-C6000-CL , VID: , SN: SMT0609B897

NAME: "5", DESCR: "WS-SUP32-10GE-3B 3 ports Supervisor Engine 32 10GE Rev. 1.8"

PID: WS-SUP32-10GE-3B , VID: V10, SN: SAL15056BAB

NAME: "msfc sub-module of 5", DESCR: "WS-F6K-MSFC2A Cat6k MSFC 2A daughterboard"

PID: WS-F6K-MSFC2A , VID: , SN: SAL15066UHJ

NAME: "WS-F6K-PFC3B Policy Feature Card 3 sub-module of 5", DESCR: "WS-F6K-PFC3"

PID: WS-F6K-PFC3B , VID: V02, SN: SAL15056A6Z

NAME: "fan-tray 1", DESCR: "Chassis fan-tray 1"

PID: WS-C6K-9SLOT-FAN , VID: , SN:

NAME: "PS 1 WS-CAC-3000W", DESCR: "AC power supply, 3000 watt 1"

PID: WS-CAC-3000W , VID: V01, SN: SNI1028AWHC

NAME: "PS 2 WS-CAC-3000W", DESCR: "AC power supply, 3000 watt 2"

PID: WS-CAC-3000W , VID: V01, SN: SNI1028AWNV

Router#

-

crashes after boot -

System Bootstrap, Version 12.2(17r)SX3, RELEASE SOFTWARE (fc1)

Technical Support: http://www.cisco.com/techsupport

Cat6k-MSFC2A platform with 524288 Kbytes of main memory

Download Start

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

Download Completed! Booting the image.

Self decompressing the image : ################################################]

Restricted Rights Legend

Use, duplication, or disclosure by the Government is

subject to restrictions as set forth in subparagraph

(c) of the Commercial Computer Software - Restricted

Rights clause at FAR sec. 52.227-19 and subparagraph

(c) (1) (ii) of the Rights in Technical Data and Computer

Software clause at DFARS sec. 252.227-7013.

cisco Systems, Inc.

170 West Tasman Drive

San Jose, California 95134-1706

Cisco IOS Software, s3223_rp Software (s3223_rp-IPBASEK9-M), Version 12.2(33)SX)

Technical Support: http://www.cisco.com/techsupport

Compiled Fri 22-Oct-10 14:31 by prod_rel_team

Image text-base: 0x40101328, data-base: 0x4350E450

This product contains cryptographic features and is subject to United

States and local country laws governing import, export, transfer and

use. Delivery of Cisco cryptographic products does not imply

third-party authority to import, export, distribute or use encryption.

Importers, exporters, distributors and users are responsible for

compliance with U.S. and local country laws. By using this product you

agree to comply with applicable laws and regulations. If you are unable

to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:

http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to

export@cisco.com.

cisco WS-C6509 (R7000) processor (revision 3.0) with 458752K/65536K bytes of me.

Processor board ID TBM06124103

R7000 CPU at 300Mhz, Implementation 0x27, Rev 3.3, 256KB L2, 1024KB L3 Cache

Last reset from power-on

1 Virtual Ethernet interface

1 Gigabit Ethernet interface

2 Ten Gigabit Ethernet interfaces

1915K bytes of non-volatile configuration memory.

65536K bytes of Flash internal SIMM (Sector size 512K).

Press RETURN to get started!

All pannel leds are red

Router#show bootflash: all

-#- ED -

type---- ~~crc~~- -seek-- nlen -length- -

date/time----

e

1 .. crashinfo 5931195C C8750 29 296653 Jul 22 2011 17:50:50 +00:00 C

65239216 bytes available (296784 bytes used)

-

F I L E S Y S T E M S T A T U S -

Device Number = 2

DEVICE INFO BLOCK: bootflash

Magic Number = 6887635 File System Vers = 10000 (1.0)

Length = 4000000 Sector Size = 80000

Programming Algorithm = F Erased State = FFFFFFFF

File System Offset = 80000 Length = 3E80000

MONLIB Offset = 100 Length = 1DAB8

Bad Sector Map Offset = 7FFF0 Length = 10

Squeeze Log Offset = 3F00000 Length = 80000

Squeeze Buffer Offset = 3F80000 Length = 80000

MONLIB Version = 0 (0.0)

Num Spare Sectors = 0

Spares:

STATUS INFO:

Writable

NO File Open for Write

Complete Stats

No Unrecovered Errors

No Squeeze in progress

USAGE INFO:

Bytes Used = 48750 Bytes Available = 3E378B0

Bad Sectors = 0 Spared Sectors = 0

OK Files = 1 Bytes = 486D0

Deleted Files = 0 Bytes = 0

Files w/Errors = 0 Bytes = 0

Intel SCS Status/Register Dump ********

COMMON MEMORY REGISTERS: Bank 0

Intelligent ID Code : 89898989

Compatible Status Reg: 80808080

DEVICE TYPE:

Layout : Quad x8 Mode

Write Queue Size : 64

Queued Erase Supported : No

%Software-forced reload

Early Notification of crash condition..

18:16:47 UTC Fri Jul 22 2011: Breakpoint exception, CPU signal 23, PC = 0x410C

-

Possible software fault. Upon reccurence, please collect

crashinfo, "show tech" and contact Cisco Technical Support.

-

-Traceback= 410FAA3C 410F8590 40DAC978 40DAC9A4 40BE7FE8 40C3E3BC 40C3E418 41A

$0 : 00000000, AT : 1E020000, v0 : 44690000, v1 : 00000050

a0 : 50B09940, a1 : 5000DB88, a2 : 00000001, a3 : FFFFFFFC

t0 : 00000016, t1 : 00000001, t2 : 0000008F, t3 : 00000003

t4 : 5000DB40, t5 : 00000000, t6 : 0001010F, t7 : 5000DB38

s0 : 00000000, s1 : 436F0000, s2 : 505E5FC8, s3 : 0000001F

s4 : 505E5FC8, s5 : 45CC9138, s6 : 00000000, s7 : 08788D08

t8 : 08028FEC, t9 : 00000000, k0 : 00000000, k1 : 00000000

gp : 43A0F7AC, sp : 5000DBB0, s8 : 00000000, ra : 410F8590

EPC : 410FAA3C, ErrorEPC : FDFFFFFF, SREG : 3401F103

MDLO : 66666707, MDHI : 00000282, BadVaddr : F5FAFBEE

CacheErr : 903FFFFB, DErrAddr0 : 1E02000C, DErrAddr1 : 05D69888

DATA_START : 0x4350E450

Cause 00000824 (Code 0x9): Breakpoint exception

Writing crashinfo to bootflash:crashinfo_20110722-181647-UTC

=== Flushing messages (18:16:47 UTC Fri Jul 22 2011) ===

Buffered messages:

*Jul 22 18:11:07.155: RP: Currently running ROMMON from S (Gold) region

*Jul 22 18:11:12.311: %SYS-5-CONFIG_I: Configured from memory by console

*Jul 22 18:11:16.771: %SYS-5-RESTART: System restarted --

Cisco IOS Software, s3223_rp Software (s3223_rp-IPBASEK9-M), Version 12.2(33)S)

Technical Support: http://www.cisco.com/techsupport

Compiled Fri 22-Oct-10 14:31 by prod_rel_team

*Jul 22 17:58:08.799: %SYS-SP-3-LOGGER_FLUSHED: System was paused for 00:00:00.

*Jul 22 18:11:16.059: %SYS-SP-5-RESTART: System restarted --

Cisco IOS Software, s3223_sp Software (s3223_sp-IPBASEK9-M), Version 12.2(33)S)

Technical Support: http://www.cisco.com/techsupport

Compiled Fri 22-Oct-10 14:56 by prod_rel_team

*Jul 22 18:11:16.087: SP: Currently running ROMMON from S (Gold) region

*Jul 22 18:11:16.999: %OIR-SP-6-INSPS: Power supply inserted in slot 1

*Jul 22 18:11:16.999: %C6KPWR-SP-4-PSOK: power supply 1 turned on.

*Jul 22 18:11:17.063: %OIR-SP-6-INSPS: Power supply inserted in slot 2

*Jul 22 18:11:17.087: %C6KPWR-SP-4-PSOK: power supply 2 turned on.

*Jul 22 18:11:17.087: %C6KPWR-SP-4-PSREDUNDANTBOTHSUPPLY: in power-redundancy .

*Jul 22 18:11:21.012: %DIAG-SP-6-RUN_MINIMUM: Module 5: Running Minimal Diagno.

*Jul 22 18:11:45.639:k

*Jul 22 18:16:50.939: %SYS-SP-3-LOGGER_FLUSHING: System .

*Jul 22 18:16:50.939: %OIR-SP-6-CONSOLE: Changing console ownership to switch r

System received an unknown failure ***

signal= 0x0, code= 0x0, context= 0x43b28da4

PC = 0x417aae3c, SP = 0x50714490, RA = 0x40a289fc

Cause Reg = 0x00001420, Status Reg = 0x34008102

rommon 4 >

Reza Sharifi · ‎07-24-2011

Rosa,

It apears that there are 2 options:

Option-1 6509 with WS-C6K-9SLOT-FAN2 I understand that the replacment for number 1 option is number 2, but in this case if you go with number 2 you also need a 6509-E chassis.

or

option-2 6509-E with WS-C6509-E-FAN

so E chassis with E fan

HTH

Reza

View solution in original post

Reza Sharifi · ‎07-24-2011

You can use any of the IOS (SXI version) on this sup. For example, I know SXI2a is good and so is SXI4 and 4a.

I would try differnt IOS version and see if you get a different results. Of course, if the fan tray and/or power supply is the problem, no IOS is going to fix it.

HTH

Reza

View solution in original post

Reza Sharifi · ‎07-22-2011

You need the high speed fan for and 6500-E for Sup-32

Supervisor Engine 32 Highlights

Supervisor Engine 32 offers a robust feature set at a low cost entry point for the wiring closet. Because it comes standard with the PFC3B, Supervisor Engine 32 offers feature consistency with the Supervisor Engine 720. Supervisor Engine 32 comes in two versions: 8x1 Gigabit Ethernet (GE) Small Form-Factor Pluggable (SFP)-based ports or 2x10 GE XENPAK-based ports.

Supervisor Engine 32 requires the high-speed fan tray when operating in the Cisco Catalyst 6500 chassis. As such, a minimum of 2500W AC (in either 110V or 220V mode) or DC power supply is required for operation in a 6-, 9-, and 13-slot chassis. It requires a minimum of 950W in the 3-slot chassis. Supervisor Engine 32 also can operate in the E-Series chassis or a Cisco 7600 Series Router.

ou

http://www.cisco.com/en/US/prod/collateral/switches/ps5718/ps708/prod_bulletin0900aecd801ff3ee.html

HTH

Reza

Rosa Ladeira · ‎07-23-2011

Thanks, Reza for your answer.

What does it meam :

It requires a minimum of 950W in the 3-slot chassis.

Supervisor should be plugged on 3-slot ? Chassis does not have connector on 3-slot for this.

I have a new fan. Are you talking about WS-C6509-E-FAN ?

Regards,

Rosa

Rosa Ladeira · ‎07-23-2011

Reza,

I have being lookoig for more informations about fan trays.

First of all, I tried Cisco Power Calculator that indicates WS-C6k-9SLOT-FAN2 as fan tray module to use with

Cisco Systems Catalyst 6500 9-slot Chassis System and WS-SUP32-10GE-3B 3 ports Supervisor Engine 32 10GE Rev. 1.8 models.

The next step I saw, was cisco documentation above which confirms Cisco Power Calculator.

http://www.cisco.com/en/US/docs/switches/lan/catalyst6500/hardware/Chassis_Installation/Cat6500/01over.html#wp1085653

And at last I found Cisco document End-of-Sale and End-of-Life Announcement for the Select Cisco

Catalyst 6503, 6506, and 6509 Chassis which includes WS-C6k-9SLOT-FAN2 and suggests WS-C6509-E-FAN.

Cisco 6509 Chassis has its backplane incompatible with WS-C6509-E-FAN.

What is your suggestion?

Thanks,

Rpsa

Reza Sharifi · ‎07-23-2011

Hi Rosa,

In order to support your Sup 32, you need to install the high speed fan tray and upgrade your power supply to a minimum of 2500 watts. The part number you have for the fan try is correct. (WS-C6509-E-FAN)

We also need to know the exact IOS version you have on this Sup.

Supervisor Engine 32 Highlights

Supervisor Engine 32 offers a robust feature set at a low cost entry point for the wiring closet. Because it comes standard with the PFC3B, Supervisor Engine 32 offers feature consistency with the Supervisor Engine 720. Supervisor Engine 32 comes in two versions: 8x1 Gigabit Ethernet (GE) Small Form-Factor Pluggable (SFP)-based ports or 2x10 GE XENPAK-based ports.

Supervisor Engine 32 requires the high-speed fan tray when operating in the Cisco Catalyst 6500 chassis. As such, a minimum of 2500W AC (in either 110V or 220V mode) or DC power supply is required for operation in a 6-, 9-, and 13-slot chassis. It requires a minimum of 950W in the 3-slot chassis. Supervisor Engine 32 also can operate in the E-Series chassis or a Cisco 7600 Series Router.

Supervisor Engine 32 can be installed in the same slots as Supervisor Engine 720:

• Slot 5 or 6 in 6-slot or 9-slot chassis

• Slot 7 or 8 in 13-slot chassis

• Slot 1 or 2 in 3-slot chassis

All classic line cards and all CEF 256 line cards (without a distributed forwarding card [DFC]) are supported at first customer shipment (FCS). Service modules and WAN cards will be supported post-FCS.

HTH

Reza

Rosa Ladeira · ‎07-23-2011

Reza,

I already have

NAME: "PS 1 WS-CAC-3000W", DESCR: "AC power supply, 3000 watt 1"

PID: WS-CAC-3000W , VID: V01, SN: SNI1028AWHC

NAME: "PS 2 WS-CAC-3000W", DESCR: "AC power supply, 3000 watt 2"

PID: WS-CAC-3000W , VID: V01, SN: SNI1028AWNV

and

NAME: "fan-tray 1", DESCR: "Chassis fan-tray 1"

PID: WS-C6K-9SLOT-FAN , VID: , SN:

The great problem I have is the incompatibility to plug fan tray.

Chassis connector is located on the bottom of the slot. Fan tray connector is located on the middle of the module.

It is impossible to plug them.

It is necessary to find a fan tray which have same connector position as WS-C6K-9SLOT-FAN 1 has.

Regards,

Rosa

Reza Sharifi · ‎07-23-2011

Are you installing it with fans facing down like this picture?

WS-C6K-9SLOT-FAN2 (high speed)

http://www.cisco.com/en/US/docs/switches/lan/catalyst6500/hardware/Config_Notes/78_16162.html#wp33992

Reza

Rosa Ladeira · ‎07-23-2011

Reza I want to upgrade an old 6509.

I have an old 6509 chassis, a new supervisor module and 2 models of fun:

the original: WS-C6K-9SLOT-FAN

the new one: WS-C6509-E-FAN

Both of then are installed vertically. 6509 chassis has a vertical slot for fan tray.

http://www.cisco.com/en/US/docs/switches/lan/catalyst6500/hardware/Chassis_Installation/Cat6500/01over.html#wp1085653

But, I can not use the new one because of the position of its connector.

I guess FAN-2 was vertical slot too.

In fact I do not know how to solve this.

Regards,

Rosa

Reza Sharifi · ‎07-24-2011

Rosa,

It apears that there are 2 options:

Option-1 6509 with WS-C6K-9SLOT-FAN2 I understand that the replacment for number 1 option is number 2, but in this case if you go with number 2 you also need a 6509-E chassis.

or

option-2 6509-E with WS-C6509-E-FAN

so E chassis with E fan

HTH

Reza

Rosa Ladeira · ‎07-24-2011

Reza, thanks a lot for your help.

Regards,

Rosa

Leo Laohoo · ‎07-22-2011

%Software-forced reload

Early Notification of crash condition..

18:16:47 UTC Fri Jul 22 2011: Breakpoint exception, CPU signal 23, PC = 0x410C

Software-caused crash. Please post the un-edited version of the "bootflash:crashinfo_20110722-181647-UTC".

Wow. Your output is very cryptic. I don't know why the output you've posted doesn't make sense. Is this IOS version SXI5?

Cisco IOS Software, s3223_rp Software (s3223_rp-IPBASEK9-M), Version 12.2(33)S)

I have never seen an IOS version like this before.

  5  68ef.bd85.0814 to 68ef.bd85.0819   1.8   12.2(18r)SX9 12.2(33)SXI5 Ok

This one says you're running SXI5.

Rosa Ladeira · ‎07-24-2011

---------->>>>> System Bootstrap, Version 12.2(17r)SX3, RELEASE SOFTWARE (fc1) <<<<<------------

---------->>>>> Cat6k-MSFC2A platform with 524288 Kbytes of main memory

---------->>>>> Cisco IOS Software, s3223_rp Software (s3223_rp-IPBASEK9-M), Version 12.2(33)SX)

---------->>>>> Compiled Fri 22-Oct-10 14:31 by prod_rel_team

---------->>>>> Image text-base: 0x40101328, data-base: 0x4350E450

---------->>>>> Cisco WS-C6509 (R7000) processor (revision 3.0) with 458752K/65536K bytes of me.

---------->>>>> board ID TBM06124103

---------->>>>> R7000 CPU at 300Mhz, Implementation 0x27, Rev 3.3, 256KB L2, 1024KB L3 Cache

1 Virtual Ethernet interface

1 Gigabit Ethernet interface

2 Ten Gigabit Ethernet interfaces

1915K bytes of non-volatile configuration memory.

Mod Sub-Module Model Serial Hw Status

Mod MAC addresses Hw Fw Sw Status

5 3 Supervisor Engine 32 10GE (Active) WS-SUP32-10GE-3B SAL15056BAB

5 68ef.bd85.0814 to 68ef.bd85.0819 1.8 12.2(18r)SX9 12.2(33)SXI5 Ok

5 Policy Feature Card 3 WS-F6K-PFC3B SAL15056A6Z 2.6 Ok

5 Cat6k MSFC 2A daughterboard WS-F6K-MSFC2A SAL15066UHJ 4.1 Ok

65536K bytes of Flash internal SIMM (Sector size 512K).

NAME: "WS-C6509", DESCR: "Cisco Systems Catalyst 6500 9-slot Chassis System"

PID: WS-C6509 , VID: , SN: TBM06124103

NAME: "WS-C6K-VTT 1", DESCR: "VTT FRU 1"

PID: WS-C6K-VTT , VID: , SN: SMT0609D809

NAME: "WS-C6K-VTT 2", DESCR: "VTT FRU 2"

PID: WS-C6K-VTT , VID: , SN: SMT0609C421

NAME: "WS-C6K-VTT 3", DESCR: "VTT FRU 3"

PID: WS-C6K-VTT , VID: , SN: SMT0609C394

NAME: "WS-C6000-CL 1", DESCR: "C6K Clock FRU 1"

PID: WS-C6000-CL , VID: , SN: SMT0607C685

NAME: "WS-C6000-CL 2", DESCR: "C6K Clock FRU 2"

PID: WS-C6000-CL , VID: , SN: SMT0609B897

NAME: "5", DESCR: "WS-SUP32-10GE-3B 3 ports Supervisor Engine 32 10GE Rev. 1.8"

PID: WS-SUP32-10GE-3B , VID: V10, SN: SAL15056BAB

NAME: "msfc sub-module of 5", DESCR: "WS-F6K-MSFC2A Cat6k MSFC 2A daughterboard"

PID: WS-F6K-MSFC2A , VID: , SN: SAL15066UHJ

NAME: "WS-F6K-PFC3B Policy Feature Card 3 sub-module of 5", DESCR: "WS-F6K-PFC3"

PID: WS-F6K-PFC3B , VID: V02, SN: SAL15056A6Z

NAME: "fan-tray 1", DESCR: "Chassis fan-tray 1"

PID: WS-C6K-9SLOT-FAN , VID: , SN:

NAME: "PS 1 WS-CAC-3000W", DESCR: "AC power supply, 3000 watt 1"

PID: WS-CAC-3000W , VID: V01, SN: SNI1028AWHC

NAME: "PS 2 WS-CAC-3000W", DESCR: "AC power supply, 3000 watt 2"

PID: WS-CAC-3000W , VID: V01, SN: SNI1028AWNV

Reza Sharifi · ‎07-24-2011

Rosa,

regarding your IOS version is see s3223_rp Software (s3223_rp-IPBASEK9-M), Version 12.2(33)SX)

Then I see this

12.2(18r)SX9 12.2(33)SXI5 Ok which tells that you SXI5.

Is there a way to put this Sup in a different 6509 and verify that you have the correct IOS installed?

Usually the IOS name should look like this:

s72033-advipservicesk9_wan-mz.122-33.SXI4.bin

HTH

Reza

Rosa Ladeira · ‎07-24-2011

Yes I have booted from slot 5.

As I have showed on the first form, crash occurs immediately after first boot (Press RETURN to get started!).

Tomorrow I will do it from slot 6.

My question is : Is there any minimum IOS version which could perfectly run with this hardware config or it is,in fact, a heat problem ?

Regards,

Rosa

Reza Sharifi · ‎07-24-2011

You can use any of the IOS (SXI version) on this sup. For example, I know SXI2a is good and so is SXI4 and 4a.

I would try differnt IOS version and see if you get a different results. Of course, if the fan tray and/or power supply is the problem, no IOS is going to fix it.

HTH

Reza

Failure on boot

Recovering from a 3850 boot failure.

Recovering from a 3850 boot failure.

Issue with Catalyst 9200L Switch Boot Failure and ROMMON Mode

StarOS: boot config overwrite について

IOS-XE SD-WAN: 再起動時に過去に使用していた Version で Boot する