07-04-2022 02:54 AM
Hi,
I have a problem with a new C3850 48p POE+ Switch, at first it came with IOS Version 16.x.x and it was working fine. but I wanted to add it to a stack. The stack master was c3850 48p and was runing ios 03.02.03.SE so I enabled auto-upgrade on the master switch then I added the new switch to the stack with full ring. Everything was ok then the new switch rebooted so it will use auto-upgrade to downgraded from 16.x.x to 3.2.3se. while its rebooting I saw a fail msg and then the switch went into a rebooting loop until it said Auto reboot is disabled and I got stuck at ROMMON mode.
Now I removed the stack cables and wanted to return the new switch to be operational again but every time I reboot it just go straight to ROMMON mode. I tried to reload new IOS from USB flash but it keep failing and I cant copy anything to Flash:/ as it says it REAN ONLY.
I'm currntly stuck here and I have no idea what to do. I searched many solutions but all failed.
Pls see the system msg below :
"
Booting...
Interface GE 0 link down***ERROR: PHY link is down
The "IP_ADDR" environment variable is not set.
Getting rest of image
Reading full image into memory...Check base package header ...: done = 16384
Getting rest of image
Reading full image into memory....done
Reading full base package into memory...: done = 74369716
Bundle Image
--------------------------------------
Kernel Address : 0x53777350
Kernel Size : 0x31794f/3242319
Initramfs Address : 0x53a8eca0
Initramfs Size : 0xdbe613/14411283
Compression Format: .mzip
Bootable image at @ ram:0x53777350
Bootable image segment 0 address range [0x81100000, 0x81b80000] is in range [0x80180000, 0x90000000].
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@boot_system: 623
Loading Linux kernel with entry point 0x811060f0 ...
Bootloader: Done loading app on core_mask: 0xf
### Launching Linux Kernel (flags = 0x5)
All packages are Digitally Signed
Starting System Services
Jul 4 08:10:03 %IOSXE-3-PLATFORM: process kernel: PCIe: read addr 0x90011c00f00001d0 inst 0 dev addr=0 dev id=0
Jul 4 08:10:04 %IOSXE-3-PLATFORM: process kernel: PCIe: read addr 0x90011c00f80001d0 inst 1 dev addr=1 dev id=1
4 08:10:07 %PLATFORM_MGR-1-PLATMGR_INIT_FAIL: Platform Manager: Jul 4 08:10:07 %IOSXE-2-PLATFORM: process ng_dumper: Process platform_mgr: terminated abnormally.
Jul 4 08:10:07 %IOSXE-2-PLATFORM: process ng_dumper: Process stack-mgr: terminated abnormally.
Jul 4 08:10:08 %IOSXE-2-PLATFORM: process stack-mgr: ===================== Exception Data ====================
Jul 4 08:10:08 %IOSXE-2-PLATFORM: process stack-mgr: Exception in 'stack-mgr' with Signal=SIGSEGV(11)
Jul 4 08:10:08 %IOSXE-2-PLATFORM: process stack-mgr: Frame Pointer=0x31330F00, Program Counter=0x100A06A8
Jul 4 08:10:08 %IOSXE-2-PLATFORM: process stack-mgr: Thread ID=6351: -Traceback= 1#ab9f1ac45690910b4c22365051e79e43 ld:2AD38000+AD40 ld:2AD38000+AD40 ld:2AD38000+AD40 ld:2AD38000+AD40 ld:2AD38000+AD40 ld:2AD38000+AD40 ld:2AD38000+AD40 ld:2AD38000+AD40 ld:2AD38000+AD40 ld:2AD38000+AD40 ld:2AD38000+AD40 crashinfo:2CE39000+598 crashinfo:2CE39000+598 crashinfo:2CE39000+598 crashinfo:2CE39000+598 crashinfo:2CE39000+598 crashinfo:2CE39000+598 crashinfo:2CE39000+598 crashinfo:2CE39000+598 crashinfo:2CE39000+598 crashinfo:2CE39000+598 crashinfo:2CE39000+598 crashinfo:2CE39000+598 crashinfo:2CE39000+598 crashinfo:2CE39000+598 crashinfo:2CE39000+598 crashinfo:2CE39000+598 crashinfo:2CE39000+598 crashinfo:2CE39000+598 crashinfo:2CE39000+598 initcii:2CE25000+F08 c:2BF74030+8998 c:2BF74030+8998 c:2BF74030+8998 c:2BF74030+8998 c:2BF74030+8998 c:2BF74030+8998 c:2BF74030+8998 c:2BF74030+8998 c:2BF74030+8998 initcii:2CE25000+0 initcii:2CE25000+0 initcii:2CE25000+0 initcii:2CE25000+0 initcii:2CE25000+0 initcii:2CE25000+0 initcii:2CE
Jul 4 08:10:08 %IOSXE-2-PLATFORM: process stack-mgr:
Jul 4 08:10:08 %IOSXE-2-PLATFORM: process platform_mgr: ===================== Exception Data ====================
Jul 4 08:10:08 %IOSXE-2-PLATFORM: process platform_mgr: Exception in 'platform_mgr' with Signal=SIGABRT(6)
Jul 4 08:10:08 %IOSXE-2-PLATFORM: process platform_mgr: Frame Pointer=0x7FA372E0, Program Counter=0x2C6B4480
Jul 4 08:10:08 %IOSXE-2-PLATFORM: process platform_mgr: Thread ID=5937: -Traceback= 1#5f5295d0ccb85cd40665ff455f51e3e4 pthread:2C6A2000+12480
Jul 4 08:10:08 %IOSXE-2-PLATFORM: process platform_mgr:
<Mon Jul 4 08:10:07 2022> Message from sysmgr: Reset Reason:Service [platform_mgr] pid:[5937] terminated abnormally [6]. Re
Details:
--------
Service: platform_mgr
Description: 3K Platform Manager
Executable: /tmp/sw/mount/cat3k_caa-platform.SPA.03.02.03.SE.pkg//usr/binos/bin/platform_mgr
Started at Mon Jul 4 08:10:04 2022 (831644 us)
Stopped at Mon Jul 4 08:10:07 2022 (249931 us)
Uptime: 3 seconds
Start type: SRV_OPTION_RESTART_STATELESS (23)
Death reason: SYSMGR_DEATH_REASON_FAILURE_SIGNAL (2)
Last heartbeat 0.00 secs ago
PID: 5937
Exit code: signal 6 (no core)
CWD: /var/sysmgr/work
PID: 5937
UUID: 3008
get_local: failed: No such file or directory
Unmounting ng3k filesystems...
Unmounted /dev/sda3...
Warning! - some ng3k filesystems may not have unmounted cleanly...
Please stand by while rebooting the system...
Restarting system.
Booting...
Interface GE 0 link down***ERROR: PHY link is down
The "IP_ADDR" environment variable is not set.
Getting rest of image
Reading full image into memory...Check base package header ...: done = 16384
Getting rest of image
Reading full image into memory....done
Reading full base package into memory...: done = 74369716
Bundle Image
--------------------------------------
Kernel Address : 0x53777350
Kernel Size : 0x31794f/3242319
Initramfs Address : 0x53a8eca0
Initramfs Size : 0xdbe613/14411283
Compression Format: .mzip
Bootable image at @ ram:0x53777350
Bootable image segment 0 address range [0x81100000, 0x81b80000] is in range [0x80180000, 0x90000000].
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@boot_system: 623
Loading Linux kernel with entry point 0x811060f0 ...
Bootloader: Done loading app on core_mask: 0xf
### Launching Linux Kernel (flags = 0x5)
All packages are Digitally Signed
Starting System Services
Jul 4 08:13:41 %IOSXE-3-PLATFORM: process kernel: PCIe: read addr 0x90011c00f00001d0 inst 0 dev addr=0 dev id=0
Jul 4 08:13:41 %IOSXE-3-PLATFORM: process kernel: PCIe: read addr 0x90011c00f80001d0 inst 1 dev addr=1 dev id=1
4 08:13:44 %PLATFORM_MGR-1-PLATMGR_INIT_FAIL: Platform Manager: Jul 4 08:13:44 %IOSXE-2-PLATFORM: process ng_dumper: Process platform_mgr: terminated abnormally.
Jul 4 08:13:45 %IOSXE-2-PLATFORM: process platform_mgr: ===================== Exception Data ====================
Jul 4 08:13:45 %IOSXE-2-PLATFORM: process platform_mgr: Exception in 'platform_mgr' with Signal=SIGABRT(6)
Jul 4 08:13:45 %IOSXE-2-PLATFORM: process platform_mgr: Frame Pointer=0x7F667440, Program Counter=0x2C0AE480
Jul 4 08:13:45 %IOSXE-2-PLATFORM: process platform_mgr: Thread ID=5922: -Traceback= 1#5f5295d0ccb85cd40665ff455f51e3e4 pthread:2C09C000+12480
Jul 4 08:13:45 %IOSXE-2-PLATFORM: process platform_mgr:
<Mon Jul 4 08:13:44 2022> Message from sysmgr: Reset Reason:Service [platform_mgr] pid:[5922] terminated abnormally [6]. Re
Details:
--------
Service: platform_mgr
Description: 3K Platform Manager
Executable: /tmp/sw/mount/cat3k_caa-platform.SPA.03.02.03.SE.pkg//usr/binos/bin/platform_mgr
Started at Mon Jul 4 08:13:41 2022 (930486 us)
Stopped at Mon Jul 4 08:13:44 2022 (348186 us)
Uptime: 3 seconds
Start type: SRV_OPTION_RESTART_STATELESS (23)
Death reason: SYSMGR_DEATH_REASON_FAILURE_SIGNAL (2)
Last heartbeat 0.00 secs ago
PID: 5922
Exit code: signal 6 (no core)
CWD: /var/sysmgr/work
PID: 5922
UUID: 3008
get_local: failed: No such file or directory
Switch rebooted continously for atleast 5 times. Disabling autoreboot
Unmounting ng3k filesystems...
Unmounted /dev/sda3...
Warning! - some ng3k filesystems may not have unmounted cleanly...
Please stand by while rebooting the system...
Restarting system.
Booting...
Interface GE 0 link down***ERROR: PHY link is down
The "IP_ADDR" environment variable is not set.
The system is not configured to boot automatically. The
following command will finish loading the operating system
software:
boot
switch: ?
? -- Present list of available commands
arp -- Show arp table or arp-resolve an address. -f to flush
boot -- Load and boot an executable image
cat -- Concatenate (type) file(s)
copy -- Copy a file
delete -- Delete file(s)
dig -- Lookup a name via a remote dns server
dir -- List files in directories
emergency-install -- Initiate Disaster Recovery
flash_init -- Initialize filesystem(s)
format -- Format a filesystem
fsck -- Check filesystem consistency
help -- Present list of available commands
mgmt_init -- initialize management port
mkdir -- Create dir(s)
mlog -- In-memory log control
more -- Concatenate (display) file(s)
net-debug -- Show/change network debug val
net-dhcp -- Initiate DHCP request for remote configuration
net-show -- Show network parameters
net-tcp-bufs -- see/set tcp number of buffers
net-tcp-mss -- see/set tcp mss
net6-dhcp -- test dhcpv6
net6-show -- Display ipv6 info
ping4 -- Send ICMP ECHO_REQUEST packets to a network host
ping6 -- Ping v6 host
readrtc -- Read RTC
rename -- Rename a file
reset -- Reset the system
rmdir -- Delete empty dir(s)
set -- Set or display environment variables
set_bs -- Set attributes on a boot sector filesystem
set_param -- Set system parameters in flash
type -- Concatenate (type) file(s)
unset -- Unset one or more environment variables
version -- Display boot loader version
writertc -- Write RTC
switch:
"
Kindly I need support from the experts.
Thank you
Solved! Go to Solution.
07-04-2022 03:32 AM
Contact Cisco TAC and organize for an RMA.
This is a very well-known issue, CSCva30394.
07-04-2022 03:01 AM
Suggest always upgrade to new stack memeber offline before you join live network (personally not take chance)
here is recovery of image :
07-04-2022 03:04 AM
Hello,
what is the output of:
dir flash:
?
If there is a valid image in flash, did you try and boot manually "
boot flash: full_image_name
07-04-2022 03:32 AM
Contact Cisco TAC and organize for an RMA.
This is a very well-known issue, CSCva30394.
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide