03-22-2016 04:36 AM - edited 03-03-2019 08:10 AM
I am having trouble booting SUP-32 on 7606-S Chassis. Tried two different IOS but getting below errors:
rommon 4 > boot disk0:c7600s3223-advipservicesk9-mz.122-33.SRE12.bin
Initializing ATA monitor library...
Self extracting the image... [OK]
Self decompressing the image : ######################################################################################################## [OK]
Restricted Rights Legend
Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.
cisco Systems, Inc.
170 West Tasman Drive
San Jose, California 95134-1706
Cisco IOS Software, c7600s3223_sp Software (c7600s3223_sp-ADVIPSERVICESK9-M), Version 12.2(33)SRE12, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2015 by Cisco Systems, Inc.
Compiled Thu 12-Mar-15 00:26 by prod_rel_team
MAC based EOBC installed
*Jan 1 01:55:54.567: %SYS-SP-3-LOGGER_FLUSHING: System pausing to ensure console debugging output.
*Jan 1 01:55:52.359: %PFREDUN-6-ACTIVE: Initializing as ACTIVE processor
*Jan 1 01:55:54.567: %OIR-SP-6-CONSOLE: Changing console ownership to route processor
System Bootstrap, Version 12.2(17r)SX3, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 2004 by cisco Systems, Inc.
Cat6k-MSFC2A platform with 524288 Kbytes of main memory
rommon 1 >
*Jan 1 01:58:55.595: %SYS-SP-3-LOGGER_FLUSHING: System pausing to ensure console debugging output.
*Jan 1 01:55:54.835: %SYS-SP-3-LOGGER_FLUSHED: System was paused for 00:00:00 to ensure console debugging output.
Firmware compiled 08-Dec-11 13:19 by integ Build [100]
*Jan 1 01:58:55.595: %OIR-SP-6-CONSOLE: Changing console ownership to switch processor
%Software-forced reload
01:58:55 UTC Sat Jan 1 2000: Breakpoint exception, CPU signal 23, PC = 0x4054EAC0
--------------------------------------------------------------------
Possible software fault. Upon recurrence, please collect
crashinfo, "show tech" and contact Cisco Technical Support.
--------------------------------------------------------------------
-Traceback= 0x4054EAC0 0x4054D9A4 0x40DDD0F0 0x40DE5728 0x40DE6A14 0x40DA2CEC
$0 : 00000000, AT : 42440000, v0 : 00000000, v1 : 00000000
a0 : 50B17910, a1 : BE880000, a2 : 00004038, a3 : FFFFFFF7
t0 : 00000028, t1 : 3400FD01, t2 : 34008100, t3 : FFFF00FF
t4 : 42440000, t5 : 00000000, t6 : 34008101, t7 : 34008100
s0 : 00000000, s1 : 421D0000, s2 : 444A0000, s3 : 00000000
s4 : 00000000, s5 : 44490000, s6 : 00000000, s7 : 00000000
t8 : 00000000, t9 : 00000001, k0 : 849DAB40, k1 : 05389200
gp : 424433F0, sp : 51033EB0, s8 : 00000000, ra : 4054D9A4
EPC : 4054EAC0, ErrorEPC : 018BAEAE, SREG : 3400FD03
MDLO : 00000000, MDHI : 00000009, BadVaddr : D37AFBDF
DATA_START : 0x4214F2B0
Cause 00000024 (Code 0x9): Breakpoint exception
01:58:55 UTC Sat Jan 1 2000: Breakpoint exception, CPU signal 23, PC = 0x4054EAC0
--------------------------------------------------------------------
Possible software fault. Upon recurrence, please collect
crashinfo, "show tech" and contact Cisco Technical Support.
--------------------------------------------------------------------
-Traceback= 0x4054EAC0 0x4054D9A4 0x40DDD0F0 0x40DE5728 0x40DE6A14 0x40DA2CEC
$0 : 00000000, AT : 42440000, v0 : 00000000, v1 : 00000000
a0 : 50B17910, a1 : BE880000, a2 : 00004038, a3 : FFFFFFF7
t0 : 00000028, t1 : 3400FD01, t2 : 34008100, t3 : FFFF00FF
t4 : 42440000, t5 : 00000000, t6 : 34008101, t7 : 34008100
s0 : 00000000, s1 : 421D0000, s2 : 444A0000, s3 : 00000000
s4 : 00000000, s5 : 44490000, s6 : 00000000, s7 : 00000000
t8 : 00000000, t9 : 00000001, k0 : 849DAB40, k1 : 05389200
gp : 424433F0, sp : 51033EB0, s8 : 00000000, ra : 4054D9A4
EPC : 4054EAC0, ErrorEPC : 018BAEAE, SREG : 3400FD03
MDLO : 00000000, MDHI : 00000009, BadVaddr : D37AFBDF
DATA_START : 0x4214F2B0
Cause 00000024 (Code 0x9): Breakpoint exception
File bootdisk:crashinfo_20000101-015855-UTC Device Error :No such device
01:58:55 UTC Sat Jan 1 2000: Breakpoint exception, CPU signal 23, PC = 0x4054EAC0
--------------------------------------------------------------------
Possible software fault. Upon recurrence, please collect
crashinfo, "show tech" and contact Cisco Technical Support.
--------------------------------------------------------------------
-Traceback= 0x4054EAC0 0x4054D9A4 0x40DDD0F0 0x40DE5728 0x40DE6A14 0x40DA2CEC
$0 : 00000000, AT : 42440000, v0 : 00000000, v1 : 00000000
a0 : 50B17910, a1 : BE880000, a2 : 00004038, a3 : FFFFFFF7
t0 : 00000028, t1 : 3400FD01, t2 : 34008100, t3 : FFFF00FF
t4 : 42440000, t5 : 00000000, t6 : 34008101, t7 : 34008100
s0 : 00000000, s1 : 421D0000, s2 : 444A0000, s3 : 00000000
s4 : 00000000, s5 : 44490000, s6 : 00000000, s7 : 00000000
t8 : 00000000, t9 : 00000001, k0 : 849DAB40, k1 : 05389200
gp : 424433F0, sp : 51033EB0, s8 : 00000000, ra : 4054D9A4
EPC : 4054EAC0, ErrorEPC : 018BAEAE, SREG : 3400FD03
MDLO : 00000000, MDHI : 00000009, BadVaddr : D37AFBDF
DATA_START : 0x4214F2B0
Cause 00000024 (Code 0x9): Breakpoint exception
-Traceback= 0x4054EAC0 0x4054D9A4 0x40DDD0F0 0x40DE5728 0x40DE6A14 0x40DA2CEC
------------------ show chunk failures ------------------
------------------ show redundancy states ------------------
File bootdisk:crashinfo_20000101-015856-UTC Device Error :No such device
=== Flushing messages (01:58:58 UTC Sat Jan 1 2000) ===
Buffered messages:
Queued messages:
*Jan 1 01:58:58.523: %SYS-SP-3-LOGGER_FLUSHING: System pausing to ensure console debugging output.
*Jan 1 01:58:55.967: %SYS-SP-3-LOGGER_FLUSHED: System was paused for 00:00:00 to ensure console debugging output.
*Jan 1 01:58:55.971: %PFREDUN-SP-4-AUTOBOOT: Disable autoboot for Supervisor in slot 6
*Jan 1 01:58:55.971: %PFREDUN-SP-6-ACTIVE: Sup in slot 6 is crashing due to RP failed to boot
*Jan 1 01:58:55.999: SP: Failed to send heartbeat poison message
*Jan 1 01:58:59.015: %SYS-SP-3-LOGGER_FLUSHING: System pausing to ensure console debugging output.
*Jan 1 01:58:59.015: %SYS-SP-3-LOGGER_FLUSHED: System was paused for 00:00:00 to ensure console debugging output.
*Jan 1 01:58:59.015: %OIR-SP-6-CONSOLE: Changing console ownership to switch processor
*** System received a Software forced crash ***
signal= 0x17, code= 0x24, context= 0x43852654
PC = 0x4053efec, SP = 0x504f6da0, RA = 0x4054f308
Cause Reg = 0x00001020, Status Reg = 0x34008102
rommon 5 >
monitor: command "" not found
rommon 6 >
rommon 6 >
rommon 6 > dir disk0:
Initializing ATA monitor library...
Directory of disk0:
5080 103051324 -rw- c7600s3223-advipservicesk9-mz.122-33.SRE12.bin
2 41594880 -rw- c7600-fpd-pkg.122-33.SRE12.pkg
17660 106763004 -rw- c7600s3223-advipservicesk9-mz.152-2.S.bin
rommon 7 > boot disk0:c7600s3223-advipservicesk9-mz.122-33.SRE12.bin
Initializing ATA monitor library...
Self extracting the image... [OK]
Self decompressing the image : ######################################################################################################## [OK]
Restricted Rights Legend
Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.
cisco Systems, Inc.
170 West Tasman Drive
San Jose, California 95134-1706
Cisco IOS Software, c7600s3223_sp Software (c7600s3223_sp-ADVIPSERVICESK9-M), Version 12.2(33)SRE12, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2015 by Cisco Systems, Inc.
Compiled Thu 12-Mar-15 00:26 by prod_rel_team
MAC based EOBC installed
Active crashed three times, disabling auto-boot and dropping to rommon
%Software-forced reload
02:04:50 UTC Sat Jan 1 2000: Breakpoint exception, CPU signal 23, PC = 0x4054EAC0
--------------------------------------------------------------------
Possible software fault. Upon recurrence, please collect
crashinfo, "show tech" and contact Cisco Technical Support.
--------------------------------------------------------------------
-Traceback= 0x4054EAC0 0x4054D9A4 0x40DE2018 0x40DA2BFC
$0 : 00000000, AT : 42440000, v0 : 00000000, v1 : 00000000
a0 : 50B8FE84, a1 : BE880000, a2 : 00004030, a3 : FFFFFFF7
t0 : 00000028, t1 : 3400FD01, t2 : 34008100, t3 : FFFF00FF
t4 : 42440000, t5 : 00000000, t6 : 34008101, t7 : 34008100
s0 : 00000000, s1 : 421D0000, s2 : 00000007, s3 : 00000000
s4 : 44490000, s5 : 43340000, s6 : 00000000, s7 : 00000000
t8 : 00000000, t9 : 00000001, k0 : 849D8400, k1 : 05389200
gp : 42440CB0, sp : 511062E0, s8 : 00000000, ra : 4054D9A4
EPC : 4054EAC0, ErrorEPC : 018BAEAE, SREG : 3400FD03
MDLO : 00007530, MDHI : 00000000, BadVaddr : 00000000
DATA_START : 0x4214CB70
Cause 00000024 (Code 0x9): Breakpoint exception
02:04:50 UTC Sat Jan 1 2000: Breakpoint exception, CPU signal 23, PC = 0x4054EAC0
--------------------------------------------------------------------
Possible software fault. Upon recurrence, please collect
crashinfo, "show tech" and contact Cisco Technical Support.
--------------------------------------------------------------------
-Traceback= 0x4054EAC0 0x4054D9A4 0x40DE2018 0x40DA2BFC
$0 : 00000000, AT : 42440000, v0 : 00000000, v1 : 00000000
a0 : 50B8FE84, a1 : BE880000, a2 : 00004030, a3 : FFFFFFF7
t0 : 00000028, t1 : 3400FD01, t2 : 34008100, t3 : FFFF00FF
t4 : 42440000, t5 : 00000000, t6 : 34008101, t7 : 34008100
s0 : 00000000, s1 : 421D0000, s2 : 00000007, s3 : 00000000
s4 : 44490000, s5 : 43340000, s6 : 00000000, s7 : 00000000
t8 : 00000000, t9 : 00000001, k0 : 849D8400, k1 : 05389200
gp : 42440CB0, sp : 511062E0, s8 : 00000000, ra : 4054D9A4
EPC : 4054EAC0, ErrorEPC : 018BAEAE, SREG : 3400FD03
MDLO : 00007530, MDHI : 00000000, BadVaddr : 00000000
DATA_START : 0x4214CB70
Cause 00000024 (Code 0x9): Breakpoint exception
File bootdisk:crashinfo_20000101-020450-UTC Device Error :No such device
02:04:50 UTC Sat Jan 1 2000: Breakpoint exception, CPU signal 23, PC = 0x4054EAC0
--------------------------------------------------------------------
Possible software fault. Upon recurrence, please collect
crashinfo, "show tech" and contact Cisco Technical Support.
--------------------------------------------------------------------
-Traceback= 0x4054EAC0 0x4054D9A4 0x40DE2018 0x40DA2BFC
$0 : 00000000, AT : 42440000, v0 : 00000000, v1 : 00000000
a0 : 50B8FE84, a1 : BE880000, a2 : 00004030, a3 : FFFFFFF7
t0 : 00000028, t1 : 3400FD01, t2 : 34008100, t3 : FFFF00FF
t4 : 42440000, t5 : 00000000, t6 : 34008101, t7 : 34008100
s0 : 00000000, s1 : 421D0000, s2 : 00000007, s3 : 00000000
s4 : 44490000, s5 : 43340000, s6 : 00000000, s7 : 00000000
t8 : 00000000, t9 : 00000001, k0 : 849D8400, k1 : 05389200
gp : 42440CB0, sp : 511062E0, s8 : 00000000, ra : 4054D9A4
EPC : 4054EAC0, ErrorEPC : 018BAEAE, SREG : 3400FD03
MDLO : 00007530, MDHI : 00000000, BadVaddr : 00000000
DATA_START : 0x4214CB70
Cause 00000024 (Code 0x9): Breakpoint exception
-Traceback= 0x4054EAC0 0x4054D9A4 0x40DE2018 0x40DA2BFC
------------------ show chunk failures ------------------
------------------ show redundancy states ------------------
File bootdisk:crashinfo_20000101-020450-UTC Device Error :No such device
=== Flushing messages (02:04:52 UTC Sat Jan 1 2000) ===
Buffered messages:
Queued messages:
*Jan 1 02:04:52.971: %SYS-3-LOGGER_FLUSHING: System pausing to ensure console debugging output.
*Jan 1 02:04:50.447: scp assert failure: queue != NULL: ../const/native/scp_const.c: 929
*Jan 1 02:04:50.447: -Traceback= 4077DE18 4077E4D0
*Jan 1 02:04:50.447: %SCHED-7-WATCH: Attempt to monitor uninitialized watched queue (address 0). -Process= "slcp process", ipl= 0, pid= 135
-Traceback= 405230F8 40CC2FFC 4055085C 40550A34 40527C1C
*Jan 1 02:04:53.435: %SYS-3-LOGGER_FLUSHING: System pausing to ensure console debugging output.
*Jan 1 02:04:53.435: %SYS-3-LOGGER_FLUSHED: System was paused for 00:00:00 to ensure console debugging output.
*Jan 1 02:04:53.435: %OIR-6-CONSOLE: Changing console ownership to switch processor
*** System received a Software forced crash ***
signal= 0x17, code= 0x24, context= 0x4384ff14
PC = 0x4053efec, SP = 0x456fe0e0, RA = 0x4054f308
Cause Reg = 0x00001020, Status Reg = 0x34008102
rommon 8 >
03-22-2016 06:08 AM
If you have tried multiple IOS version and same result constant traceback crash the sup needs to be replaced something's gone in it , tracebacks can be software bugs or hardware , as you have ruled out software by replacing the IOS its most likely hardware failed and will need to go to TAC for replacement
03-22-2016 06:34 AM
Thanks mark for your response. Actually our support contract for this card is expired. Any chance of finding out the problematic component that we could replace in lab? (e.g. RAM or NVRAM battery)
03-22-2016 07:19 AM
Oh that's not good , honestly trackbacks are kept quite tight in Cisco , they don't publicly release what each one means , you would need to have the list that TAC have to be able to decode each one or at least if it generated a crash file to flash during bootup it might show something
I see one of the alerts is a bug , did you add any config before this happened , what exactly triggered this ? and did you go to the latest IOS available just to be sure
https://bst.cloudapps.cisco.com/bugsearch/bug/CSCtj60158/?referring_site=bugquickviewredir
03-22-2016 01:20 PM
This card belongs to our spares inventory and we use it to replace production cards, in case of failure, while their RMA is processed.
During routine checkup with no configuration change, it failed to boot-up. I again tried relatively newer IOS but to no avail. It is also failing to write crash report on bootdisk
File bootdisk:crashinfo_20000101-015856-UTC Device Error :No such device
03-25-2016 07:13 AM
Issue resolved after formatting sup-bootdisk (Internal flash drive) on another SUP-32 card.
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide