16P10G module not recognized after updating c6880-x

withison00 · ‎06-04-2020

hello,

I had a problem updating C6880x.

The currently running version is 15.2(1)sy5. The update attempt versions are 15.5(1)sy4 and 15.2(1)sy8.

After updating, the 16p10G module is not recognized.

The update method is as follows.

1. copy disk0:c6880x-ipservicesk9-mz.SPA.155-1.SY4.bin bootdisk:

INTERNET_PTN_BB#dir
Directory of bootdisk:/

1 -rw- 33554432 Jan 29 2017 11:00:04 +09:00 sea_log.dat
4 -rw- 144605972 May 29 2020 16:34:18 +09:00 c6880x-ipservicesk9-mz.SPA.155-1.SY4.bin
2 -rw- 33554432 Jan 29 2017 11:16:28 +09:00 sea_console.dat
3 -rw- 131546664 May 2 2018 18:39:02 +09:00 c6880x-ipservicesk9-mz.SPA.152-1.SY5.bin

1939189760 bytes total (1595920384 bytes free)

2. (config)#boot system bootdisk:c6880x-ipservicesk9-mz.SPA.152-1.SY5.bin
(config)#no boot system bootdisk:c6880x-ipservicesk9-mz.SPA.155-1.SY4.bin

3. #reload

#reload
Proceed with reload? [confirm]

May 29 18:10:04.052 KST: %SYS-5-RELOAD: Reload requested by admin on console. Reload Reason: Reload Command.
Cisco Governator Rommon version 1.1

System Initializing ...

Current image running: Governator Boot Rom :Upgradable Region

Last reset cause: Software Reset, reset code 0x4

Governator platform with 4194304 Kbytes of main memory

#Booting c6880x-ipservicesk9-mz.SPA.155-1.SY4.bin ...
####################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################
ELF image verification PASSED

Self extracting the image... [OK]

Self decompressing the image : ############################################################################################################################################################################################################################################################################################################################################################################################################################################################################################### [OK]

Restricted Rights Legend

Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.

cisco Systems, Inc.
170 West Tasman Drive
San Jose, California 95134-1706

Cisco IOS Software, c6880x Software (c6880x-IPSERVICESK9-M), Version 15.5(1)SY4, RELEASE SOFTWARE (fc4)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2019 by Cisco Systems, Inc.
Compiled Mon 02-Sep-19 06:19 by prod_rel_team
FPGA_UPG: Malfra Upgrade in progress...
MALFRA MICRON flash(0x20) found
MALFRA MICRON flash(0x20) found

FPGA_UPG: Power cycling Supervisor after FPGA upgrade...
Cisco Governator Rommon version 1.1

System Initializing ...

Current image running: Governator Boot Rom :Upgradable Region

Last reset cause: Power On, reset code 0x6

Governator platform with 4194304 Kbytes of main memory

#Booting c6880x-ipservicesk9-mz.SPA.155-1.SY4.bin ...
####################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################
ELF image verification PASSED

Self extracting the image... [OK]

Self decompressing the image : ############################################################################################################################################################################################################################################################################################################################################################################################################################################################################################### [OK]

Restricted Rights Legend

Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.

cisco Systems, Inc.
170 West Tasman Drive
San Jose, California 95134-1706

Cisco IOS Software, c6880x Software (c6880x-IPSERVICESK9-M), Version 15.5(1)SY4, RELEASE SOFTWARE (fc4)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2019 by Cisco Systems, Inc.
Compiled Mon 02-Sep-19 06:19 by prod_rel_team
This is a VSS capable switch.
VSL ports can be configured in slot: 5

This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to
export@cisco.com.

USB high speed device - Port:0
Cisco C6880-X ( Intel(R) Core(TM) i3- CPU @ 2.00GHz ) processor (revision ) with 2994174K/409600K bytes of memory.
Processor board ID SAL21020343
Processor signature 0xA7060200
Last reset from power-on
1 Virtual Ethernet interface
1 Gigabit Ethernet interface
48 Ten Gigabit Ethernet interfaces
1966064K bytes of USB Flash bootdisk (Read/Write)

Press RETURN to get started!

*May 29 08:42:38.975: %USBFLASH-5-CHANGE: bootdisk has been inserted!
*May 29 08:42:38.975: %USBFLASH-5-CHANGE: bootdisk Initialization in progress. Do not remove until initialization complete.
*May 29 08:42:51.171: %USBFLASH-5-CHANGE: bootdisk Initialization complete.
*May 29 08:42:54.639 UTC: %SYS-5-LOG_CONFIG_CHANGE: Buffer logging: level informational, xml disabled, filtering disabled, size (16384)
*May 29 17:42:54.639 KST: %SYS-6-CLOCKUPDATE: System clock has been updated from 08:42:54 UTC Fri May 29 2020 to 17:42:54 KST Fri May 29 2020, configured from console by vty0.
*May 29 17:42:54.763 KST: %SYS-6-LOGGINGHOST_STARTSTOP: Logging to host X.X.X.X port 0 CLI Request Triggered
*May 29 17:42:54.839 KST: %SYS-5-CONFIG_I: Configured from memory by console
*May 29 17:42:54.955 KST: %SYS-5-RESTART: System restarted --
Cisco IOS Software, c6880x Software (c6880x-IPSERVICESK9-M), Version 15.5(1)SY4, RELEASE SOFTWARE (fc4)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2019 by Cisco Systems, Inc.
Compiled Mon 02-Sep-19 06:19 by prod_rel_team
*May 29 17:42:54.959 KST: %SNMP-5-COLDSTART: SNMP agent on host XXXXXXX is undergoing a cold start
*May 29 17:42:54.975 KST: %SSH-5-ENABLED: SSH 1.99 has been enabled
*May 29 17:42:55.223 KST: %SYS-6-BOOTTIME: Time taken to reboot after reload = 431 seconds
*May 29 17:42:55.251 KST: %SYS-6-LOGGINGHOST_STARTSTOP: Logging to host X.X.X.X port 514 started - CLI initiated
*May 29 17:42:55.959 KST: %CPU_MONITOR-6-RECORRECT_TIMER_COUNT: Recurring Timer Count: 1
*May 29 17:42:57.043 KST: %OIR-6-INSPS: Power supply inserted in slot 1
*May 29 17:42:57.047 KST: %C6KPWR-4-PSOK: power supply 1 turned on.
*May 29 17:42:58.215 KST: %OIR-6-INSPS: Power supply inserted in slot 2
*May 29 17:42:58.219 KST: %C6KPWR-4-PSOK: power supply 2 turned on.
*May 29 17:42:58.219 KST: %C6KPWR-4-PSREDUNDANTBOTHSUPPLY: in power-redundancy mode, system is operating on both power supplies.
*May 29 17:42:59.939 KST: %OIR-6-INSFAN: Fan 1 inserted
*May 29 17:43:00.663 KST: %PNP-6-PNP_DISCOVERY_STOPPED: PnP Discovery stopped (Startup Config Present)
*May 29 17:43:34.927 KST: %FABRIC-5-FABRIC_MODULE_ACTIVE: The Switch Fabric Module in slot 5 became active.
*May 29 17:43:34.939 KST: %FABRIC-5-TRUNK_MODE_NA_ON_DCEF: Truncated mode is not allowed due to dCEF-only mode.

*May 29 17:44:21.811 KST: %C6K_PLATFORM-2-FPGAUPGRADE_INPROG:

*****************************************************************
*****************************************************************

G1 Upgrade in progress on module 2. Avoid reloading when FPGA
upgrade is in progress.

*****************************************************************
*****************************************************************

#

#
*May 29 17:44:21.831 KST: %C6K_PLATFORM-2-FPGAUPGRADE_INPROG:

*****************************************************************
*****************************************************************

G1 Upgrade in progress on module 1. Avoid reloading when FPGA
upgrade is in progress.

*****************************************************************
*****************************************************************

*May 29 17:44:28.391 KST: %DIAG-6-DIAG_OK: Module 5: Passed Online Diagnostics
*May 29 17:44:28.995 KST: %C6KENV-4-LOWER_SLOT_EMPTY: The lower adjacent slot of module 5 might be empty. Airdam must be installed in that slot to be NEBS compliant
*May 29 17:44:36.807 KST: %OIR-6-SP_INSCARD: Card inserted in slot 5, interfaces are now online

*May 29 17:45:33.335 KST: %C6K_PLATFORM-2-FPGAUPGRADE_INPROG:

*****************************************************************
*****************************************************************

Malfra Upgrade in progress on module 2. Avoid reloading when FPGA
upgrade is in progress.

*****************************************************************
*****************************************************************

*May 29 17:45:36.611 KST: %C6K_PLATFORM-2-FPGAUPGRADE_INPROG:

*****************************************************************
*****************************************************************

Malfra Upgrade in progress on module 1. Avoid reloading when FPGA
upgrade is in progress.

*****************************************************************
*****************************************************************

*May 29 18:20:33.850 KST: %C6K_PLATFORM-2-FPGAUPGRADE_PWRCYCLE:

**********************************************************
**********************************************************
WARNING WARNING WARNING !!!!!!!!

FPGA upgrade is done for slot 2. Module going for reload.
**********************************************************
**********************************************************

*May 29 18:20:33.854 KST: %C6KPWR-4-DISABLED: power to module in slot 2 set off (Reset)

*May 29 18:20:38.630 KST: %C6K_PLATFORM-2-FPGAUPGRADE_PWRCYCLE:

**********************************************************
**********************************************************
WARNING WARNING WARNING !!!!!!!!

FPGA upgrade is done for slot 1. Module going for reload.
**********************************************************
**********************************************************

*May 29 18:20:38.634 KST: %C6KPWR-4-DISABLED: power to module in slot 1 set off (Reset)
*May 29 18:21:44.702 KST: %FABRIC-5-TRUNK_MODE_NA_ON_DCEF: Truncated mode is not allowed due to dCEF-only mode.

#show module
Mod Ports Card Type Model Serial No.
--- ----- -------------------------------------- ------------------ -----------
1 20 DCEF-X 16P SFP+ Multi-Rate C6880-X-16P10G SALXXXXXXXX
2 20 DCEF-X 16P SFP+ Multi-Rate C6880-X-16P10G SALXXXXXXXX
5 20 6880-X 16P SFP+ Multi-Rate (Active) C6880-X-SUP SALXXXXXXXX

Mod MAC addresses Hw Fw Sw Status
--- ---------------------------------- ------ ------------ ------------ -------
1 XXXXXXXX to XXXXXXXX 2.1 15.1(61r)SYL 15.5(1)SY4 Other
2 XXXXXXXX to XXXXXXXX 2.1 15.1(61r)SYL 15.5(1)SY4 Other
5 XXXXXXXX to XXXXXXXX 1.3 15.1(02)SY01 15.5(1)SY4 Ok

Mod Sub-Module Model Serial Hw Status
---- --------------------------- ------------------ ----------- ------- -------
1 Distributed Forwarding Card C6880-X-DFC SALXXXXXXXX 1.3 Other
2 Distributed Forwarding Card C6880-X-DFC SALXXXXXXXX 1.3 Other
5 Policy Feature Card 4 C6880-X-PFC SALXXXXXXXX 1.2 Ok

Mod Online Diag Status
---- -------------------
1 Unknown
2 Unknown
5 Pass

Jan 1 00:00:26.363: DFC1: Asic 0: Mem LM_L3_MEMORY: Test GMTL_TEST_WALKING_1 : Failed Address: 0x8B800000.
Jan 1 00:00:26.363: DFC1: --> [0] fail 0x00000000, expected 0x00000100
Jan 1 00:00:26.363: DFC1: [1] fail 0x00000000, expected 0x00000000
Jan 1 00:00:26.363: DFC1: --> [2] fail 0x00000008, expected 0x00000000
Jan 1 00:00:26.363: %EARL-DFC1-0-MEMORY_TEST_ERR: EARL 0: GMTL_TEST_WALKING_1 test failed on memory LM_L3_MEMORY. Reason GMTL_DATA_MISMATCH.
Jan 1 00:00:26.363: DFC1: Asic 0: Mem LM_L3_MEMORY: Test GMTL_TEST_WALKING_1 : Failed Address: 0x8B800000.
Jan 1 00:00:26.363: DFC1: --> [0] fail 0x00000000, expected 0x00000100
Jan 1 00:00:26.363: DFC1: [1] fail 0x00000000, expected 0x00000000
Jan 1 00:00:26.363: DFC1: --> [2] fail 0x00000008, expected 0x00000000
Jan 1 00:00:26.363: DFC1: Asic 0: Mem LM_L3_MEMORY: Test GMTL_TEST_WALKING_1 : Failed Address: 0x8B800000
INTERNET_PTN_B.
Jan 1 00:00:26.363: DFC1: --> [0] fail 0x00000000, expected 0x00000100
Jan 1 00:00:26.363: DFC1: [1] fail 0x00000000, expected 0x00000000
Jan 1 00:00:26.363: DFC1: --> [2] fail 0x00000008, expected 0x00000000
Jan 1 00:00:26.363: DFC1: Asic 0: Mem LM_L3_MEMORY: Test GMTL_TEST_WALKING_1 : Failed Address: 0x8B800000.
Jan 1 00:00:26.363: DFC1: --> [0] fail 0x00000000, expected 0x00000100
Jan 1 00:00:26.363: DFC1: [1] fail 0x00000000, expected 0x00000000
Jan 1 00:00:26.363: DFC1: --> [2] fail 0x00000008, expected 0x00000000
Jan 1 00:00:26.367: DFC1: Asic 0: Mem LM_L3_MEMORY: Test GMTL_TEST_WALKING_1 : Failed Address: 0x8B800000.
Jan 1 00:00:26.367: DFC1: --> [0] fail 0x00000000, expected 0x00000100
Jan 1 00:00:26.367: DFC1: [1] fail 0x00000000, expected 0x00000000
Jan 1 00:00:26.367: DFC1: --> [2] fail 0x00000008, expected 0x00000000
Jan 1 00:00:26.367: DFC1: Asic 0: Mem LM_L3_MEMORY: Test GMTL_TEST_WALKING_1 : Failed Address: 0x8B800000.
Jan 1 00:00:26.367: DFC1: --> [0] fail 0x00000000, expected 0x00000100
Jan 1 00:00:26.367: DFC1: [1] fail 0x00000000, expected 0x00000000
Jan 1 00:00:26.367: DFC1: --> [2] fail 0x00000008, expected 0x00000000
Jan 1 00:00:26.367: DFC1: Asic 0: Mem LM_L3_MEMORY: Test GMTL_TEST_WALKING_1 : Failed Address: 0x8B800000.
Jan 1 00:00:26.367: DFC1: --> [0] fail 0x00000000, expected 0x00000100
Jan 1 00:00:26.367: DFC1: [1] fail 0x00000000, expected 0x00000000
Jan 1 00:00:26.367: DFC1: --> [2] fail 0x00000008, expected 0x00000000
Jan 1 00:00:26.371: DFC1: Asic 0: Mem LM_L3_MEMORY: Test GMTL_TEST_WALKING_1 : Failed Address: 0x8B800000.
Jan 1 00:00:26.371: DFC1: --> [0] fail 0x00000000, expected 0x00000100
Jan 1 00:00:26.371: DFC1: [1] fail 0x00000000, expected 0x00000000
Jan 1 00:00:26.371: DFC1: --> [2] fail 0x00000008, expected 0x00000000
Jan 1 00:00:26.371: DFC1: Asic 0: Mem LM_L3_MEMORY: Test GMTL_TEST_WALKING_1 : Failed Address: 0x8B800000.
Jan 1 00:00:26.371: DFC1: --> [0] fail 0x00000000, expected 0x00000100
Jan 1 00:00:26.371: DFC1: [1] fail 0x00000000, expected 0x00000000
Jan 1 00:00:26.371: DFC1: --> [2] fail 0x00000008, expected 0x00000000
Jan 1 00:00:26.371: DFC1: Asic 0: Mem LM_L3_MEMORY: Test GMTL_TEST_WALKING_1 : Failed Address: 0x8B800000.
Jan 1 00:00:26.371: DFC1: --> [0] fail 0x00000000, expected 0x00000100
Jan 1 00:00:26.371: DFC1: [1] fail 0x00000000, expected 0x00000000
Jan 1 00:00:26.371: DFC1: --> [2] fail 0x00000008, expected 0x00000000
Jan 1 00:00:26.371: DFC1: Asic 0: Mem LM_L3_MEMORY: Test GMTL_TEST_WALKING_1 : Failed Address: 0x8B800000.
Jan 1 00:00:26.371: DFC1: --> [0] fail 0x00000000, expected 0x00000100
Jan 1 00:00:26.371: DFC1: [1] fail 0x00000000, expected 0x00000000
Jan 1 00:00:26.371: DFC1: --> [2] fail 0x00000008, expected 0x00000000
Jan 1 00:00:26.375: DFC1: Asic 0: Mem LM_L3_MEMORY: Test GMTL_TEST_WALKING_1 : Failed Address: 0x8B800000.
Jan 1 00:00:26.375: DFC1: --> [0] fail 0x00000000, expected 0x00000100
Jan 1 00:00:26.375: DFC1: [1] fail 0x00000000, expected 0x00000000
Jan 1 00:00:26.375: DFC1: --> [2] fail 0x00000008, expected 0x00000000
Jan 1 00:00:26.375: DFC1: Asic 0: Mem LM_L3_MEMORY: Test GMTL_TEST_WALKING_1 : Failed Address: 0x8B800000.
Jan 1 00:00:26.375: DFC1: --> [0] fail 0x00000000, expected 0x00000100
Jan 1 00:00:26.375: DFC1: [1] fail 0x00000000, expected 0x00000000
Jan 1 00:00:26.375: DFC1: --> [2] fail 0x00000008, expected 0x00000000
Jan 1 00:00:26.375: DFC1: Asic 0: Mem LM_L3_MEMORY: Test GMTL_TEST_WALKING_1 : Failed Address: 0x8B800000.
Jan 1 00:00:26.375: DFC1: --> [0] fail 0x00000000, expected 0x00000100
Jan 1 00:00:26.375: DFC1: [1] fail 0x00000000, expected 0x00000000
Jan 1 00:00:26.375: DFC1: --> [2] fail 0x00000008, expected 0x00000000
Jan 1 00:00:26.375: DFC1: Asic 0: Mem LM_L3_MEMORY: Test GMTL_TEST_WALKING_1 : Failed Address: 0x8B800000.
Jan 1 00:00:26.375: DFC1: --> [0] fail 0x00000000, expected 0x00000100
Jan 1 00:00:26.375: DFC1: [1] fail 0x00000000, expected 0x00000000
Jan 1 00:00:26.375: DFC1: --> [2] fail 0x00000008, expected 0x00000000
Jan 1 00:00:26.379: DFC1: Asic 0: Mem LM_L3_MEMORY: Test GMTL_TEST_WALKING_1 : Failed Address: 0x8B800000.
Jan 1 00:00:26.379: DFC1: --> [0] fail 0x00000000, expected 0x00000100
Jan 1 00:00:26.379: DFC1: [1] fail 0x00000000, expected 0x00000000
Jan 1 00:00:26.379: DFC1: --> [2] fail 0x00000008, expected 0x00000000
Jan 1 00:00:26.379: DFC1: Asic 0: Mem LM_L3_MEMORY: Test GMTL_TEST_WALKING_1 : Failed Address: 0x8B800000.
Jan 1 00:00:26.379: DFC1: --> [0] fail 0x00000000, expected 0x00000100
Jan 1 00:00:26.379: DFC1: [1] fail 0x00000000, expected 0x00000000
Jan 1 00:00:26.379: DFC1: --> [2] fail 0x00000008, expected 0x00000000
Jan 1 00:00:26.379: DFC1: Asic 0: Mem LM_L3_MEMORY: Test GMTL_TEST_WALKING_1 : Failed Address: 0x8B800000.
Jan 1 00:00:26.379: DFC1: --> [0] fail 0x00000000, expected 0x00000100
Jan 1 00:00:26.379: DFC1: [1] fail 0x00000000, expected 0x00000000
Jan 1 00:00:26.379: DFC1: --> [2] fail 0x00000008, expected 0x00000000
Jan 1 00:00:26.379: DFC1: Asic 0: Mem LM_L3_MEMORY: Test GMTL_TEST_WALKING_1 : Failed Address: 0x8B800000.
Jan 1 00:00:26.379: DFC1: --> [0] fail 0x00000000, expected 0x00000100
Jan 1 00:00:26.379: DFC1: [1] fail 0x00000000, expected 0x00000000
Jan 1 00:00:26.383: DFC1: --> [2] fail 0x00000008, expected 0x00000000
Jan 1 00:00:26.383: DFC1: Asic 0: Mem LM_L3_MEMORY: Test GMTL_TEST_WALKING_1 : Failed Address: 0x8B800000.
Jan 1 00:00:26.383: DFC1: --> [0] fail 0x00000000, expected 0x00000100
Jan 1 00:00:26.383: DFC1: [1] fail 0x00000000, expected 0x00000000
Jan 1 00:00:26.383: DFC1: --> [2] fail 0x00000008, expected 0x00000000
Jan 1 00:00:35.423: DFC1: Currently running ROMMON from S (Gold) region

After that, it will continue to reboot the module.

Is there a solution?

Thank you,

Kim

Leo Laohoo · ‎06-04-2020

@withison00 wrote:

*May 29 18:20:38.634 KST: %C6KPWR-4-DISABLED: power to module in slot 1 set off (Reset)

FPGA has killed the line cards.
Can you try turning the power off and then on to slot 1 and 2?

If this works, raise a TAC Case. TAC needs to reach out to the developers so they can troubleshoot why the FPGA upgrade is failing.

withison00 · ‎06-04-2020

The reboot is repeated. Other C6880-x repeats the same. There are three of the same C6880-x.

I think there is a problem with the update method, but I don't know.

Leo Laohoo · ‎06-05-2020

RMA the line card in slot 1. It is dead.

How about the card in slot 2?

ncfb-awarsame · ‎09-12-2022

Hi withison00,

How did you resolve the issue? Did you RMA the line cards?