SCE 8000 error in software/hardware

Fernando Ibarra Hernandez · ‎09-27-2011

I have a 8000 and the Device SCE 8000 turn it. single handle these messages: The computer is damaged. Levato must be an RMA, or the problem is hardware or software.

Any idea??????

548 OK delta time : 6090 msec

Connecting RpcClient 'RPC[08]_PPC[04]_CORE[01]' to IP '192.168.207.149', port 2549 OK delta time : 3 msec

Connecting RpcClient 'RPC[09]_PPC[05]_CORE[00]' to IP '192.168.207.150', port 2548 OK delta time : 3 msec

Connecting RpcClient 'RPC[10]_PPC[05]_CORE[01]' to IP '192.168.207.150', port 2549 OK delta time : 3 msec

Connecting RpcClient 'RPC[11]_PPC[06]_CORE[00]' to IP '192.168.207.151', port 2548 OK delta time : 3 msec

Connecting RpcClient 'RPC[12]_PPC[06]_CORE[01]' to IP '192.168.207.151', port 2549 OK delta time : 3 msec

RPC servers for master 0

Nala boot - Optical bypass on boot activated = True

Nala boot - Power Up detected setting bypass between LICs mode

NJC ISP upgrade procedure version 1.0.0

NJCPLD: actual version 0x9274 legal version ranges: accept-ranges = { [0x9274,0x9274] }, deny-ranges = { } match-check: up result: match

No need to upgrade NJC version is up to date

create njc max1668 device

create njc summit766 devices

Detected Bay Constellation:

SPABay[0] - 10G SPABay[1] - 10G SPABay[2] - 10G SPABay[3] - 10G

Detected platform type: 10G

Nala eeprom create OK

Nala eeprom read OK

try to program dpt fpga from file : 'fpga/dpt_nala_s130.rbf'

Force diag DPT program = True

Forcing Nala DPT configuration

program Nala DPT 0 fpga/dpt_nala_s130.rbf

njc dpt 0 program ok

program Nala DPT 1 fpga/dpt_nala_s130.rbf

njc dpt 1 program ok

NalaDPT DPT SCOS mode force to queue to 64MB

NalaDPT queue size is 64MB

SimbaDPTDmx interrupts callback registration succeded

SimbaDPTMux interrupts callback registration succeded

DSR is supported

DSR MIP exists

DPTDsr. init MIP all units. enable:1

NalaDPT DPT SCOS mode force to queue to 64MB

NalaDPT queue size is 64MB

SimbaDPTDmx interrupts callback registration succeded

SimbaDPTMux interrupts callback registration succeded

DSR is supported

DSR MIP exists

DPTDsr. init MIP all units. enable:1

Powering on Spa

Creating SPA c2w

Allocating SPA mutex

Retraining SPI4.2 channel on SPA bay 1!

Creating SPA c2w

Allocating SPA mutex

Retraining SPI4.2 channel on SPA bay 0!

SPA Bay 1: first init phase passed

SPA Bay 0: first init phase passed

Creating SPA c2w

Allocating SPA mutex

Retraining SPI4.2 channel on SPA bay 2!

SPA Bay 2: first init phase passed

Creating SPA c2w

Allocating SPA mutex

Retraining SPI4.2 channel on SPA bay 3!

SPA Bay 3: first init phase passed

SPA Bay 1: Starting init phase 2

SPA Bay 0: Starting init phase 2

SPA Bay 2: Starting init phase 2

SPA Bay 3: Starting init phase 2

SPA Bay 1: Starting init phase 3

SPA Bay 0: Starting init phase 3

SPA Bay 2: Starting init phase 3

SPA Bay 0: Starting init phase 4

SPA Bay 3: Starting init phase 3

SPA Bay 1: Starting init phase 4

SPA Bay 2: Starting init phase 4

SPA Bay 3: Starting init phase 4

SPA Bay 0: SPA init passed

SPA module in SPA bay 0 was found and initialized!

SPA Bay 1: SPA init passed

SPA module in SPA bay 1 was found and initialized!

SPA Bay 2: SPA init passed

SPA module in SPA bay 2 was found and initialized!

SPA Bay 3: SPA init passed

SPA module in SPA bay 3 was found and initialized!

Num of ports = 4

Setting system to bypass between LICs mode!

Process affinity succesffuly set to cpu 1.

NalaPortManager: EnableAllPorts to 1 Now!

NalaPortManager: Set Enable to 1 Port TenGigabitEthernet0/0[0].

NalaPortManager: Set Enable to 1 Port TenGigabitEthernet1/0[0].

NalaPortManager: Set Enable to 1 Port TenGigabitEthernet2/0[0].

NalaPortManager: Set Enable to 1 Port TenGigabitEthernet3/0[0].

Tavor with SMC

Cofico 0 : present

Cofico 1 : present

create tavor-max1668 device

create smc_max device

create cofico 0 smc_pm i2c bus : OK

create cofico 1 smc_pm i2c bus : OK

tavor workaround !!

Init cofico 0 smc_pm i2c bus : OK

Init cofico 1 smc_pm i2c bus : OK

Smc eeprom create OK

Smc eeprom read OK

Create cofico i2c bus 0 devices

cofico 0 => board type: P2

Create cofico i2c bus 1 devices

cofico 1 => board type: P2

create cofico i2c bus 0 devices

create cofico i2c bus 1 devices

create tavor-max6681 device

DPT file name fpga/dpt_smc_s180.rbf

program DPT fpga/dpt_smc_s180.rbf

dpt program ok

program CLS fpga/cls_top.rbf

cls program ok

SimbaPlatformMasterComponentManagerBase devices init OK

Create chassis component manager

All Cofico cores pass stage 0 succesfuly ( program FC )

SimbaPlatformMasterComponentManager::Create

TSEC memory check okay (required=6242367, we have 6291456) !

Tavor TSEC Created !

CLS version :0x2112

Initializing Backplane LinkManager component

Cls metering init done !

Cls main component - PLLs connecting to DPT locked !

InitSRAMMemory, polling ok after 1 loops

Check CAM InitStaticRegion

CAM - Init done !

CLS init SDRAM - waited 44 loops

Cls interrupts callback registration succeded

Cls main - init OK !

SMC DPT SCOS mode force to set queue to 64MB

SimbaDPT queue size is 64MB

SetNewTxCountersSupported(1)

SimbaDPTClsIf interrupts callback registration succeded

DPT interrupts was masked successfully

SimbaDPTDmx interrupts callback registration succeded

SimbaDPTMux interrupts callback registration succeded

All Cofico cores pass stage 2 succesfuly (Init Components core:1)

All Cofico cores pass stage 2 succesfuly (Init Components core:0)

HWSRV_DP_Init OK

Simba is inserted in slot 1 and link speed is 20G -> Initializing Secondary SSA link

Initializing Backplane Links

NalaDPT[0] link synced failed!!

Failed to sync DPT to DPT during try 0

Initializing Backplane Links

NalaDPT[0] link synced

SimbaDPT[0] link synced failed!!

Failed to sync DPT to DPT during try 1

Initializing Backplane Links

NalaDPT[0] link synced failed!!

Failed to sync DPT to DPT during try 2

Initializing Backplane Links

NalaDPT[0] link synced

SimbaDPT[0] link synced failed!!

Failed to sync DPT to DPT during try 3

Initializing Backplane Links

NalaDPT[0] link synced

SimbaDPT[0] link synced

read hw-monitor support info and check tree

tavor cpu temperature monitoring device support = 1

cofico 0 cpus temperature monitoring device support = 1

cofico 0 current monitoring support = 1

cofico 1 cpus temperature monitoring device support = 1

cofico 1 current monitoring support = 1

run share memory network

MprocCommon::initQueues2(): G_HSRV_GetBladeLocalProcId()=0, max_def=12.

share memory usage

-----------------------------------------

m01 1536KB 1104KB 71%

s01 1024KB 544KB 53%

m02 1536KB 1232KB 80%

s02 1024KB 544KB 53%

m03 1536KB 1104KB 71%

s03 1024KB 544KB 53%

m04 1536KB 1104KB 71%

s04 1024KB 544KB 53%

m05 1536KB 1104KB 71%

s05 1024KB 544KB 53%

m06 1536KB 1104KB 71%

s06 1024KB 544KB 53%

m07 1536KB 1104KB 71%

s07 1024KB 544KB 53%

m08 1536KB 1104KB 71%

s08 1024KB 544KB 53%

m09 1536KB 1104KB 71%

s09 1024KB 544KB 53%

m10 1536KB 1104KB 71%

s10 1024KB 544KB 53%

m11 1536KB 1104KB 71%

s11 1024KB configuring PHY 2:02 advertise:0000006F speed:0 duplex:0

544KB 53%

configuring PHY 2:03 advertise:0000006F speed:0 duplex:0

m12 1536KB 1104KB 71%

s12 1024KB 544KB 53%

All queues ready.

Nala DPT support SE

Enable CLS MLIP SimbaDPT version is 491a

Ethernet kernel interface create OK

Simba card is inserted in slot 1

Nala card is inserted in slot 3

Cofico 0 is present

Cofico 1 is present

*************************************************************************

*************** W A R N I N G <start> ***********************************

*************************************************************************

***** *****

TvrSmm: actual version 0xf2c1702 does not match legal version ranges: accept-ranges = { [0x10005,0x10007] [0x20000,0xffffff] [0xf2c1701,0xf2c1701] }, deny-ranges = { }

***** *****

***** WARNING DESCRIPTION: *****

***** ==================== *****

***** some hardware versions are incompatible with this software! *****

***** (did you manually upgrade some hardware unit?) *****

***** *****

***** NOTE #1: this is temporarily a warning (should be an error). *****

***** your system might work ok, but don't count on it. *****

***** NOTE #2: error messages above and below this warning block *****

***** are not necessarily (and mostly are not) related *****

***** directly to this warning. if Hw init fails, you *****

***** should see an ERROR prompt indicating it. *****

***** *****

*************************************************************************

*************** W A R N I N G <end> *************************************

*************************************************************************

---------------------------

HW Init finished OK

---------------------------

Found 0 recvQueue for collector #0, 'nsm-to-sm-high'.

Found 0 xmitQueue for dispatcher #0, 'nsm-to-sm-high'.

Found 0 recvQueue for collector #1, 'sm-to-nms-high'.

Found 0 xmitQueue for dispatcher #1, 'sm-to-nms-high'.

Found 0 recvQueue for collector #2, 'nsm-to-sm-med'.

Found 0 xmitQueue for dispatcher #2, 'nsm-to-sm-med'.

Found 0 recvQueue for collector #3, 'sm-to-nms-med'.

Found 0 xmitQueue for dispatcher #3, 'sm-to-nms-med'.

Found 0 recvQueue for collector #4, 'nsm-to-sm-low'.

Found 0 xmitQueue for dispatcher #4, 'nsm-to-sm-low'.

Found 0 recvQueue for collector #5, 'sm-to-nms-low'.

Found 0 xmitQueue for dispatcher #5, 'sm-to-nms-low'.

Found 0 recvQueue for collector #6, 'nsm-to-sm-ulow'.

Found 0 xmitQueue for dispatcher #6, 'nsm-to-sm-ulow'.

Found 0 recvQueue for collector #7, 'sm-to-nms-ulow'.

Found 0 xmitQueue for dispatcher #7, 'sm-to-nms-ulow'.

SeAppMain(): About to call readConstDbFiles(), emergency=0

Reading platform DB (emergency=0)...

Pre-setting 2 constDb variables (hard coded):

Reading conf file 'DbConst.txt' from directory '/pkg/scos', sending to slaves...

Checking for DB const file '/pkg/scos/DbConst.txt'... Found, reading it.

Reading one DB const file '/pkg/scos/DbShape.txt'...

Reading one DB const file '/pkg/scos/DbFrmtr.txt'...

Reading one DB const file '/pkg/scos/DbParty.txt'...

Reading one DB const file '/pkg/scos/DbSched.txt'...

Reading one DB const file '/pkg/scos/DbJvm.txt'...

Reading one DB const file '/pkg/scos/DbCards.txt'...

Reading one DB const file '/pkg/scos/DbCpuUtil.txt'...

Reading one DB const file '/pkg/scos/DbMem.txt'...

Reading one DB const file '/pkg/scos/DbClsCam.txt'...

Reading one DB const file '/pkg/scos/DbRpc.txt'...

Reading one DB const file '/pkg/scos/DbSanity.txt'...

Reading one DB const file '/pkg/scos/DbNrmFac.txt'...

Reading one DB const file '/pkg/scos/DbBox.txt'...

Reading one DB const file '/pkg/scos/DbMisc.txt'...

Reading one DB const file '/pkg/scos/DbM2Sys.txt'...

Reading one DB const file '/pkg/scos/DbOpenOnN.txt'...

Reading conf file 'DbConst.txt' from directory '/pkg/scos/Rev=A', sending to slaves...

Checking for DB const file '/pkg/scos/Rev=A/DbConst.txt'... Does not exist.

Open user defined const db file /apps/data/scos/system/usrconst.txt for read

Config file '/apps/data/scos/system/config.txt' not found, not extracting 'debug const-db' commands from it.

Sending const-db END command to slaves...

DbConstFileReader::readMainFile(): Sending end command 'END' to slaves after sending 164 vars, took 5992 sys ticks.

processSeCommonConstDbInterfaceSpecificParams(): ifType=3, our data=10000000, no need to change queue params.

2073 DB variables initialized out of 2073.

Checking if pstack supported

shell_runner(): beginning shell.

shell_runner(): Initializing minishell server on port 78 (78 + 0).

Starting minishell server on port 78.

Minishell server started OK.

SCOS shell was created - task ID = -1880984416

SCOS shell started for the first time

pstack isn't supported in this platform

The CRASH module was started

KernelWatchdog monitor WD Statitics task was triggered

init Cpu Utilization Monitor module init succeeded

DBG 'common.CriticalSection.DBG_COULD_NOT_CREATE' hash= 4130614079.

DBG 'common.CriticalSection.DBG_LIST_FULL' hash= 585703309.

DBG 'common.CriticalSection.DBG_REMOVE_NOT_FOUND' hash= 3907609472.

DBG 'common.test.msg2' hash= 2670446627.

DBG 'common.test.msg3' hash= 3476223276.

DBG 'common.test.msgA' hash= 89862758.

DBG 'common.DbContainer.DBG_NO_MEMORY' hash= 1179297079.

DBG 'common.DbBase.DBG_ADDING' hash= 3674379735.

DBG 'common.DbBase.DBG_ADDING_OK' hash= 1198001663.

DBG 'common.DbBase.DBG_NULL_PTR' hash= 1853563718.

DBG 'common.DbBase.DBG_BAD_INDEX' hash= 1091176901.

DBG 'common.DbBase.DBG_SET_CONST' hash= 2538370734.

DBG 'common.DbBase.DBG_DUPLICATE_NAME' hash= 1287558230.

DBG 'common.DbBase.DBG_NO_MEMORY' hash= 2546497118.

Recorded 14 DBG messages, 0 hash collisions.

Initializing heap consumers...

Finished initialising heap consumers after 3 loops.

Calling DBG_Init()...

Debug queues are initialized

TT Handler init

Calling 39 DBG init functions...

Registering IPv6_Reporting DBGs...

Registering IPv6_DB DBGs...

Registering EDM DBGs...

Registering ENGAGE_TUNABLES DBGs...

Registering SUB_CONTEXT DBGs...

Registering ENGAGE_API DBGs...

Registering VLUR_REPORT DBGs...

Registering NUR DBGs...

Registering SUR DBGs...

Registering PARTY_PERIODIC_REPORTING DBGs...

Registering REPORTING_API DBGs...

Registering QE DBGs...

Registering CcPeriodicAggregatedRecords DBGs...

Registering REPORT_AGG_SUBTASK DBGs...

Registering ReportAggregationManager DBGs...

Registering ENGAGE_REPORT_AGG_LISTENER DBGs...

Registering ENGAGE_INIT_STUFF DBGs...

Registering RDR_RATE_CONTROL DBGs...

Registering PERIODIC_REPORTING DBGs...

Registering ENGAGE_REPOTING_DB DBGs...

Registering EngageDb DBGs...

Registering AppModules DBGs...

Registering LcTestApplicationLoader DBGs...

Registering TimeBasedHandlers DBGs...

Registering MCM DBGs...

Registering ManagementVariables DBGs...

Registering LineCard DBGs...

Message status cannot be set to "ALWAYS ON"

DBG_RTSetMsgPeriod: Message number 14 is larger then maximum -1 for module 0xc01

Registering LineCard2 DBGs...

Registering LinecardHandlers DBGs...

Registering VSA DBGs...

Registering ControlCard DBGs...

Message status cannot be set to "ALWAYS ON"

Registering PartyDynamicStateManager DBGs...

Registering CcAppVariableStorageManager DBGs...

Registering ControlCardHandlers DBGs...

Registering Reporting DBGs...

Registering ReaderFileSystem DBGs...

Registering SeCommon DBGs...

Registering HandlerDeclaration DBGs...

Registering Common DBGs...

DBG Rate control restored to normal state.

Setting the cascade ports definitions: 2 2 3 3 2 2 3 3 (crossed connected)

BootLog: Creature 'ControlCardInit' started.

Spawning ControlMain task...

****************************************************************************************

*

* Starting boot process of Cisco SCE8000 Control Card - OS Version 3.6.1 Build 13.

*

****************************************************************************************

Not setting Control-Card affinity.

**************************************************

* Warning: setting recovery mode flag on !!!!!!

**************************************************

Setting system status to emergency due to 3 successive reboots!

Beginning Version 3.6.1 Build 13, SCE8000 Version 3.6.1 Build 13.

PartyDBManager::getMemorySize() called:

numPIDs=1012000, partyEfficiencyFactor=400,

numIpEntries=1000000, ipEfficiencyFactor=400,

numRangeEntries=250000, radixEfficiencyFactor=200,

maxVpnId=4000,

numUnmappedRanges=5000, numUnmappedTunnels=0,

Returning 94317564+162631780+846928=257796272.

BootLog: Creature 'LineCardInit' started.

Spawning RucMain task...

Setting Master RUC affinity to core 1...

Process affinity succesffuly set to cpu 1.

Setting Master RUC affinity returned 0...

Line card watchdog initialized

Starting Memory Monitoring Task

Rpc client server already created

Init only link and task

MsgHndlr: Registering RUC server interfaces...

I'm a Master

In RucEmergencies::initEmergencies

In RucEmergencies::initEmergencies theEmergencyMessanger = 0x12f823c0, message queue id = 20

In RucEmergencyMessenger::createReceiverCommon

Initializing traverser Watchdog, TWD Status = 1 (0=disabled, 1=enabled), LogOnly Status = 0, sampling interval(uSec)=5000 sampling timeout(miliSec)=20000

Number Of Assembled ports 4, Number Of Supported ports 4

Port topology is set for Full port configuration - Single box

Platform type is multi CPU

CPU type is CPU_CONF_MASTER_ONLY

12 agents detected, FF configured to 12 agents

Registering RuC RPC client interfaces...

#total shell commands: 11333

master00->

Spawning Reboot Support Task

Reboot support task started

CmdlGenIf: Tables are OK, 1545 funcs found.

******************************************

* Warning: Recovery mode flag is on !!!!!!

******************************************

SANB_iosDevFind(): Device '~/should-not-exist' does not exist.

SANB_iosDevFind(): Added device '/apps/data/scos' because device '/apps/data/scos' contains soft-links.

Init remote ip messages

Ruc ques are initiliazed

Ruc_Init(): Init VAS HW

Ruc_Init(): PPC 0 initialized Flow-Capture Recording Rules manager successfully.

Ruc_Init(): PPC 0 - no need to initializing Flow-Capture manager.

Host name from boot is 'host_name'.

hiddenDir is '/apps/data/scos/system/p3hidden'.

systemDir is '/apps/data/scos/system'.

IP address is '0.0.0.0', subnet mask is '0.0.0.0'.

running script scos_mkdir --clean --dir /apps/data/scos/system/package/ftp , script output:

BandwidthMeterTable Created.

init hw counters manager

INFO: Waiting for Complex RPC server to finish init...

script return val is 0

running script scos_mkdir --clean --dir /apps/data/scos/system/package/extract , script output:

script return val is 0

Watchdog task spawned - task name: tCCWatchdog

SysWatchdog scos-watchdog-monitor was disabled

SysWatchdog scos-watchdog-monitor was enabled

Initializing Control-Card FTP client...

FTP manager init succeded - local cached dir /apps/var/scos/ftp/

CLI initialization started

Boot Time Watchdog ended after 75 seconds

Registered 117 out of 224 CLI trees, found 0 trees with problems.

CLI initialization finished successfully

Activating Generic SCOS RPC server. TimeStamp:77.

Activating telnet server. TimeStamp:77.

Starting Internal Cli Server on port 2222 for use by Telnet.

Starting telnetServer server on port 2222...

Internal Cli Server started.

Telnet Server started OK.

Activating SSH server. TimeStamp:77.

Starting sshServer server on port 2223...

Internal Cli Server started on port 2223 for use by SSH.

Service guard init

Running telnetd guard thread

Running sshd guard thread

Running ntpd guard thread

Running ntpd last update time monitor thread

CRpcifBase::reportUsingUnInitializedClient(): Rpcif name 'RiLineCardCcToMaster_c', index 0 is being used while not initialized !

CRpcifBase::warnIfNotInitialized(): Rpcif name 'RiLineCardCcToMaster' is being used while not initialized !

Activating CLI Console. TimeStamp:77.

Serial CLI console started on device '/dev/ttyS1'.

BootLog: Creature 'ControlCardInit' finished.

Finished boot. TimeStamp:77.

*****************************************************************

*

* Welcome to SCE8000 Version 3.6.1 Build 13.

*

* Recovery mode detected, loaded with minimal hardware interaction.

*

* This might result from various reasons (HW problem, explicit user request, etc.)

* Use the 'show system operation-status' to verify the exact reason

*

* You should be able to telnet to the box and install a package file

* using the 'debug package extract system <package name>'

* CLI command.

* Using the logger for Dbg interpretation is possible as well.

*

* Usage of any other commands might be risky, as they might

* cause the box to get stuck !

*

* Good Luck!

*****************************************************************