cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
2080
Views
0
Helpful
4
Replies

Cisco 12000-SIP-601 keeps going offline

dhunt
Level 1
Level 1

Hi All

I have had this card fall over in the following way 3 times in the past 3 weeks (??? to protect the innocent) :

Feb 3 17:27:31.209 ACDT: %MBUS-6-SWITCHED_FABCLK: Slot 4 primary clock switched to clock 0

Feb 3 17:27:33.360 ACDT: %LDP-5-NBRCHG: LDP Neighbor ???.???.???.??:0 (1) is DOWN (Received error notification from peer: Holddown time expired)

Feb 3 17:27:36.380 ACDT: %PIM-5-NBRCHG: neighbor ???.???.???.??? DOWN on interface GigabitEthernet4/0/0 non DR

Feb 3 17:28:03.267 ACDT: %FIB-2-FIBDISABLE: Fatal error, slot 4: IPC Failure: timeout

Feb 3 17:28:03.267 ACDT: %RP-4-RSTSLOT: Resetting the card in the slot: 4,Event: CEF failure


Feb 3 17:28:03.303 ACDT: %LINK-5-CHANGED: Interface GigabitEthernet4/0/0, changed state to administratively down

Feb 3 17:28:03.307 ACDT: %OSPFv3-5-ADJCHG: Process 42, Nbr ???.???.???.??? on GigabitEthernet4/0/0 from FULL to DOWN, Neighbor Down: Interface down or detached

Feb 3 17:28:03.307 ACDT: %OSPF-5-ADJCHG: Process 42, Nbr ???.???.???.??? on GigabitEthernet4/0/0 from FULL to DOWN, Neighbor Down: Interface down or detached

Feb 3 17:28:03.315 ACDT: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet4/0/0, changed state to down

Feb 3 17:28:03.323 ACDT: %SPA_OIR-6-OFFLINECARD: SPA (SPA-1X10GE-L-V2) offline in subslot 4/0

Feb 3 17:32:29.862 ACDT: %RP-3-LC_ROMMON_STARTUP_FAILURE: Slot 4, output =

PON_09

PON_09

PON_09

PON_09

POFF09

POFF09

Chassis code release:

IOS (tm) GS Software (C12KPRP-K4P-M), Version 12.0(32)SY11, RELEASE SOFTWARE (fc2)

Hardware info:

AME: "slot 4", DESCR: "ISE 10G Modular Services Card v2"

PID: 12000-SIP-601     , VID: V03, SN: ?????

NAME: "SPA subslot 4/0", DESCR: "1-port 10 Gigabit Ethernet Shared Port Adapter XFP based"

PID: SPA-1X10GE-L-V2   , VID: V02, SN: ?????

NAME: "subslot 4/0 transceiver 0", DESCR: "OC192 + 10GBASE-L"

PID: 10-1989-02XFP     , VID: C  , SN: ?????? 

After the initial failure and card reseat it has lasted almost 3 weeks, reseated it again today and it fell over again within a minute. Reseated again and it is stil up and passing traffic after an hour.

Trying to power cycle the card from the chassis fails, a remove/insert is required to get the card running.

Is this a memory failure on the SIP (CEF failure??) or some other odd fault with the SIP, that makes it require a card remove/reinsert?

Thanks

David

4 Replies 4

David Aicher
Cisco Employee
Cisco Employee

David

Looks like some sort of fabric issue

Feb 3 17:27:31.209 ACDT: %MBUS-6-SWITCHED_FABCLK: Slot 4 primary clock switched to clock 0

capture "show controller fia" from the line card and global cli

Thanks

Dave Aicher