Nexus 3048 fails from switch(boot)# load with INIT: cannot execute

[Greg Focaccio]

Curious what is going on.  Nexus not seeming to be able to load new compact bin from bootflash.

>>>>> Here is the system:

sp1b# sh ver
Cisco Nexus Operating System (NX-OS) Software
TAC support: http://www.cisco.com/tac
Documents: http://www.cisco.com/en/US/products/ps9372/tsd_products_support_serie
s_home.html
Copyright (c) 2002-2015, Cisco Systems, Inc. All rights reserved.
The copyrights to certain works contained herein are owned by
other third parties and are used and distributed under license.
Some parts of this software are covered under the GNU Public
License. A copy of the license is available at
http://www.gnu.org/licenses/gpl.html.

Software
BIOS: version 1.2.0
loader: version N/A
kickstart: version 6.0(2)U5(2)
system: version 6.0(2)U5(2)
Power Sequencer Firmware:
Module 1: version v4.4
BIOS compile time: 08/25/2011
kickstart image file is: bootflash:///n3000-uk9-kickstart.6.0.2.U5.2.bin
kickstart compile time: 3/17/2015 2:00:00 [03/17/2015 10:50:07]
system image file is: bootflash:///n3000-uk9.6.0.2.U5.2.bin
system compile time: 3/17/2015 2:00:00 [03/17/2015 12:29:49]

Hardware
cisco Nexus 3048 Chassis ("48x1GE + 4x10G Supervisor")
Intel(R) Celeron(R) CPU P450 with 3665232 kB of memory.
Processor Board ID FOC18469LU5

Device name: sp1b
bootflash: 7575584 kB

Kernel uptime is 0 day(s), 0 hour(s), 2 minute(s), 58 second(s)

Last reset
Reason: Unknown
System version: 6.0(2)U5(2)
Service:

plugin
Core Plugin, Ethernet Plugin
sp1b#

>>>>> Here is the dir

switch(boot)# copy tftp: bootflash:
Enter source filename: n3000-compact.9.3.14.bin
Enter hostname for the tftp server: 198.18.225.68
Trying to connect to tftp server......
Connection to server Established. Copying Started.....
-
TFTP get operation was successful
Copy complete, now saving to disk (please wait)...
switch(boot)# dir
458 Feb 24 2017 02:42:13 20170224_023945_poap_3834_init.log
2097302 Nov 16 2021 09:30:39 20211103_165239_poap_3834_1.log
534312 Nov 16 2021 16:15:43 20211103_165239_poap_3834_2.log
1048630 Nov 04 2021 06:07:58 20211103_165239_poap_3834_init.log
84 Nov 09 2023 14:57:10 20231109_145603_poap_3833_init.log
168 Oct 12 2024 01:59:00 20241012_015205_poap_3834_init.log
168 Oct 12 2024 12:32:13 20241012_122128_poap_3834_init.log
134 Feb 28 2017 14:46:05 dhclient_log
0 Feb 21 2017 23:05:56 last-python-exc.log
4096 Feb 21 2017 23:05:56 lib/
339 May 14 2014 02:38:32 license_FOC1814R0HX_31_1.lic
4096 Nov 03 2021 16:51:00 lost+found/
639359749 Oct 26 2024 14:15:16 n3000-compact.9.3.14.bin
37738496 Feb 21 2017 23:06:12 n3000-uk9-kickstart.6.0.2.U5.2.bin
0 Feb 21 2017 23:05:58 root.rc.cli
4096 Jan 29 2010 02:34:53 vdc_2/
4096 Jan 29 2010 02:34:53 vdc_3/
4096 Jan 29 2010 02:34:53 vdc_4/
4096 Feb 21 2017 23:09:30 virtual-instance/

Usage for bootflash: filesystem
796925952 bytes used
812351488 bytes free
1609277440 bytes total
switch(boot)# ?

>>>>> Here is the issue:

switch(boot)# load bootflash:n3000-compact.9.3.14.bin
Loading System Software Sat Oct 26 14:20:51 UTC 2024

INIT: Switching to runlevel: 3
INIT: Sending processes the TERM signal
INIT: (boot)#
Mounting other filesystems: [
INIT: cannot execute "/isan/bin/sysmgr_spawn"
INIT: cannot execute "/isan/bin/libvirtd.sh"
INIT: cannot execute "/isan/bin/sysmgr_spawn"
INIT: cannot execute "/isan/bin/libvirtd.sh"
INIT: cannot execute "/isan/bin/sysmgr_spawn"
INIT: cannot execute "/isan/bin/libvirtd.sh"
INIT: Id "libv" respawning too fast: disabled for 5 minutes
INIT: cannot execute "/isan/bin/sysmgr_spawn"
INIT: Id "sm" respawning too fast: disabled for 5 minutes

ERROR: ld.so: object '/isan/lib/libnxoscustom.so' from LD_PRELOAD cannot be preloaded: ignored.

User Access Verification

[Greg Focaccio]

When I try to load the bin from loader>  The following happens:

loader> boot n3000-compact.9.3.14.bin
Booting kickstart image: n3000-compact.9.3.14.bin....
..
Size of image (639359749) not equal to size derived from the image (-1730065056
), aborting
loader>

[marce1000]

 - Check if these info's can help you :
        https://community.cisco.com/t5/data-center-switches/error-messages-after-loading-the-system-image-cisco-nexus-3048/m-p/4447010/highlight/true#M7564   (edited)
              https://www.youtube.com/watch?v=JskVWVY5U00&t=90s&pp=ygUlcmVjb3ZlciBuZXh1cyAzMDQ4IGZyb20gbG9hZGVyIHByb21wdA%3D%3D

  M.

[Greg Focaccio]

Thanks @marce1000 

The link to Zahidul Hasan's youtube was very helpful.

I'm not done yet - since the goal is to get to nexus 9.x - but at least I'm back at square 1 - a "normally" working switch!

Steps I took:

1. switch(boot)# init system check-filesystem

for clean wipe of bootflash

2. from loader, set ip and used tftp to boot kiskstart (linux kernel) [consoled in with usb > console adapter]

loader> boot tftp://a.b.c.d/<kickstart bin>

3. returns to switch(boot) allowing ftp of kickstart and system bin to fresh bootflash

4. ***critical step*** from here i was now able to successfully load a system bin again

switch(boot)# load bootflash:n3000-uk9.6.0.2.U6.10.bin

5. finished up with install all

install all kickstart <kisckstart bin> system <system bin>

...Now what's the recommended way to get to 9.x

I need portchannels with subinterface layer 3s for VPC

[marce1000]

                               >.....Now what's the recommended way to get to 9.x
 - FYI : https://www.cisco.com/c/en/us/support/docs/switches/nexus-3048-switch/216023-nexus-3048-nx-os-software-upgrade-proced.html

  M.

[Greg Focaccio]

Success!  Finishing up this thread, I was able to get the Nexus 3048 up to nxos 9.2(4)

Continuing, final steps were:

6. ftp to bootflash n3000-compact.9.2.4.bin

7. install all nxos bootflash:n3000-compact.9.2.4.bin

Resulting in success:

sp1b# sh ver
Cisco Nexus Operating System (NX-OS) Software
TAC support: http://www.cisco.com/tac
Copyright (C) 2002-2019, Cisco and/or its affiliates.
All rights reserved.
The copyrights to certain works contained in this software are
owned by other third parties and used and distributed under their own
licenses, such as open source. This software is provided "as is," and unless
otherwise stated, there is no warranty, express or implied, including but not
limited to warranties of merchantability and fitness for a particular purpose.
Certain components of this software are licensed under
the GNU General Public License (GPL) version 2.0 or
GNU General Public License (GPL) version 3.0 or the GNU
Lesser General Public License (LGPL) Version 2.1 or
Lesser General Public License (LGPL) Version 2.0.
A copy of each such license is available at
http://www.opensource.org/licenses/gpl-2.0.php and
http://opensource.org/licenses/gpl-3.0.html and
http://www.opensource.org/licenses/lgpl-2.1.php and
http://www.gnu.org/licenses/old-licenses/library.txt.

Software
BIOS: version 5.0.0
NXOS: version 9.2(4)
BIOS compile time: 06/06/2018
NXOS image file is: bootflash:///n3000-compact.9.2.4.bin
NXOS compile time: 8/20/2019 7:00:00 [08/20/2019 15:52:22]

Hardware
cisco Nexus 3048 Chassis
Intel(R) Celeron(R) CPU P4505 @ 1.87GHz with 3902272 kB of memory.
Processor Board ID FOC18469LU5

Device name: sp1b
bootflash: 1880320 kB
usb1: 7575584 kB (expansion flash)

Kernel uptime is 0 day(s), 0 hour(s), 11 minute(s), 56 second(s)

Last reset
Reason: Unknown
System version: 9.2(4)
Service:

plugin
Core Plugin, Ethernet Plugin

Active Package(s):

sp1b# dir
8487 Jan 31 09:53:00 2010 .n3k_pre_single_img_upd_config
4096 Jan 31 10:01:02 2010 .rpmstore/
4096 Jan 31 10:01:33 2010 .swtam/
490 Jan 29 12:44:20 2010 20100129_124259_poap_4034_init.log
4096 Jan 31 10:02:33 2010 logflash/
544195757 Jan 31 09:49:14 2010 n3000-compact.9.2.4.bin
37881856 Jan 29 12:24:20 2010 n3000-uk9-kickstart.6.0.2.U6.10.bin
206130057 Jan 29 12:39:24 2010 n3000-uk9.6.0.2.U6.10.bin
0 Jan 29 12:46:01 2010 platform-sdk.cmd
1024 Feb 01 08:56:44 2010 sprom_2_0_1
1024 Feb 01 08:56:44 2010 sprom_3_0_0
1024 Jan 29 12:41:58 2010 sprom_cstruct_2_0_0
1024 Jan 29 12:42:28 2010 sprom_cstruct_3_0_0
4096 Jan 29 12:42:13 2010 vdc_2/
4096 Jan 29 12:42:13 2010 vdc_3/
4096 Jan 29 12:42:13 2010 vdc_4/
4096 Jan 29 12:42:16 2010 virtual-instance/

Usage for bootflash://
790323200 bytes used
1071292416 bytes free
1861615616 bytes total
sp1b#

[Greg Focaccio]

Another switch I used the following process successfully:

1. Break into loader>

2. set IP on mgmt0

3. connect tftp server to mgmt0

4. from loader> TFTP boot a kickstart to get to switch(boot)#
e.g.
loader> boot tftp://198.18.225.68/n3000-uk9-kickstart.6.0.2.U6.10.bin

5. delete file to make room for 9.x
switch(boot)# delete bootflash:nxos.7.0.3.I7.9.bin

6. ftp to bootflash the new compact 9.x version

switch(boot)# copy ftp: bootflash:
Enter source filename: n3000-compact.9.2.4.bin
Enter hostname for the ftp server: 198.18.225.68
Enter username: lab

Connected to 198.18.225.68.
220 Transfer 2.2.3 (20) ready
200 Type set to I
331 Login OK, please enter password
Password:
230 OK
Remote system type is UNIX.
Using binary mode to transfer files.
local: /bootflash/n3000-compact.9.2.4.bin remote: n3000-compact.9.2.4.bin
229 Entering Extended Passive Mode (|||52555|)
150 Data connection opened; transfer starting
15% |***** | 80397 KiB 11.21 MiB/s 00:39 ETA

7. Power off/on

8. Break into loader>

9. boot to new compact image
loader> boot bootflash:n3000-compact.9.2.4.bin
Booting kickstart image: bootflash:n3000-compact.9.2.4.bin
CardIndex = 11056
Image valid

10.loads 9.x successfully
Software
BIOS: version 4.5.0
NXOS: version 9.2(4)
BIOS compile time: 11/09/2017
NXOS image file is: bootflash:///n3000-compact.9.2.4.bin
NXOS compile time: 8/20/2019 7:00:00 [08/20/2019 15:52:22]