SFR is stuck in recover for 12 hours (ASA5545-x)

[PacketSpartan]

We are doing a clean install of version 6.6.1 from 5.4,

- We successfully uploaded the img file 

- Ip address assigned 

- PKG file uploaded via FTP and system install command applied 

- After 15 hours the SFR was still in recover mode. 

**
*** EVENT: The module is being automatically restarted.
*** TIME: 21:13:05 GMT/BST Dec 16 2020
***

Tonight we have attempted to do the installation again after restoring the SFR module (reboot ASA, shut down sfr, reseat SSD, & restart the whole process)  After 3 hours, we're still in the recover mode. 

Does the above point towards a possible hardware failure/limiation?  

[Mohammed al Baqari]

Hi,

It should not take 15 hrs. Do you have debug module-boot on? What are the
messages displayed before the reboot? Have you attempted to access sfr
console?

**** please remember to rate useful posts

[PacketSpartan]

@Mohammed al Baqari  

The console is still not accessible, as its in recover mode.  This is the second time we're doing it and its still stuck in recover mode 

Displaying Console Log Information for Module sfr:

***
*** EVENT: Creating the Disk Image...
*** TIME: 18:10:56 GMT/BST Dec 17 2020
***

***
*** EVENT: The module is being recovered.
*** TIME: 18:10:56 GMT/BST Dec 17 2020
***

***
*** EVENT: Disk Image created successfully.
*** TIME: 18:13:05 GMT/BST Dec 17 2020
***

***
*** EVENT: Start Parameters: Image: /mnt/disk0/vm/vm_3.img, ISO: -cdrom /mnt/disk0/asasfr-5500x-boot-6.6.1-2.img, Num CPUs: 6, RAM: 4987MB, Mgmt MAC: 2C:33:11:96:ED:08, CP MAC: 00:00:00:04:00:01, HDD: -drive file=/dev/md0,cache=none,if=virtio, Dev D

***
*** EVENT: Start Parameters Continued: RegEx Shared Mem: 32MB, Cmd Op: r, Shared Mem Key: 8061, Shared Mem Size: 64, Log Pipe: /dev/ttyS0_vm3, Sock: /dev/ttyS1_vm3, Mem-Path: -mem-path /hugepages
*** TIME: 18:13:06 GMT/BST Dec 17 2020
***

(process:1802): GLib-WARNING **: /local/jenkins_engci_sjc/workspace/team_SSP/fxplatform/Builds/release__2.6.1_fcs_hammersmith/build-smp-compile/fxos/linux/wrlinux/bitbake_build/tmp/work/corei7-64-wrs-linux/glib-2.0/1_2.54.3-r0/glib-2.54.3/glib/gmem.c:483: custom memory allocation vtable not supported
WARNING: Image format was not specified for '/mnt/disk0/vm/vm_3.img' and probing guessed raw.
Automatically detecting the format is dangerous for raw images, write operations on block 0 will be restricted.
Specify the 'raw' format explicitly to remove the restrictions.
WARNING: Image format was not specified for '/dev/md0' and probing guessed raw.
Automatically detecting the format is dangerous for raw images, write operations on block 0 will be restricted.
Specify the 'raw' format explicitly to remove the restrictions.
WARNING: Image format was not specified for '/mnt/disk0/.private/meta_vm_data' and probing guessed raw.
Automatically detecting the format is dangerous for raw images, write operations on block 0 will be restricted.
Specify the 'raw' format explicitly to remove the restrictions.
Status: Mapping host 0x7fca2c400000 to VM with size 67108864
Warning: vlan 0 is not connected to host network

ISOLINUX 3.73 2009-01-25 Copyright (C) 1994-2008 H. Peter Anvin

Cisco SFR-BOOT-IMAGE and CX-BOOT-IMAGE for SFR - 6.6.1

(WARNING: ALL DATA ON DISK 1 WILL BE LOST)

Loading bzImage.............................................................
Loading initramfs.gz..................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................ready.
[ 0.000000] Initializing cgroup subsys cpuset
[ 0.000000] Initializing cgroup subsys cpu
[ 0.000000] Initializing cgroup subsys cpuacct
[ 0.000000] Linux version 3.10.107sf.cisco-1 (build@1fd5cd658885) (gcc version 4.7.1 (GCC) ) #1 SMP PREEMPT Fri Nov 10 17:06:45 UTC 2017
[ 0.000000] Command line: initrd=initramfs.gz console=ttyS0,9600 BOOT_IMAGE=bzImage
[ 0.000000] e820: BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffdefff] usable
[ 0.000000] BIOS-e820: [mem 0x00000000bffdf000-0x00000000bfffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000177afffff] usable
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] SMBIOS 2.8 present.
[ 0.000000] Hypervisor detected: KVM
[ 0.000000] No AGP bridge found
[ 0.000000] e820: last_pfn = 0x177b00 max_arch_pfn = 0x400000000
[ 0.000000] PAT not supported by CPU.
[ 0.000000] e820: last_pfn = 0xbffdf max_arch_pfn = 0x400000000
[ 0.000000] found SMP MP-table at [mem 0x000f6430-0x000f643f] mapped at [ffff8800000f6430]
[ 0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff]
[ 0.000000] init_memory_mapping: [mem 0x177800000-0x1779fffff]
[ 0.000000] init_memory_mapping: [mem 0x174000000-0x1777fffff]
[ 0.000000] init_memory_mapping: [mem 0x100000000-0x173ffffff]
[ 0.000000] init_memory_mapping: [mem 0x00100000-0xbffdefff]
[ 0.000000] init_memory_mapping: [mem 0x177a00000-0x177afffff]
[ 0.000000] RAMDISK: [mem 0x7db0b000-0x7fffffff]
[ 0.000000] ACPI: RSDP 0x00000000000F63E0 00014 (v00 BOCHS )
[ 0.000000] ACPI: RSDT 0x00000000BFFE14F2 00034 (v01 BOCHS BXPCRSDT 00000001 BXPC 00000001)
[ 0.000000] ACPI: FACP 0x00000000BFFE089A 00074 (v01 BOCHS BXPCFACP 00000001 BXPC 00000001)
[ 0.000000] ACPI: DSDT 0x00000000BFFDFD00 00B9A (v01 BOCHS BXPCDSDT 00000001 BXPC 00000001)
[ 0.000000] ACPI: FACS 0x00000000BFFDFCC0 00040
[ 0.000000] ACPI: SSDT 0x00000000BFFE090E 00B0C (v01 BOCHS BXPCSSDT 00000001 BXPC 00000001)
[ 0.000000] ACPI: APIC 0x00000000BFFE141A 000A0 (v01 BOCHS BXPCAPIC 00000001 BXPC 00000001)
[ 0.000000] ACPI: HPET 0x00000000BFFE14BA 00038 (v01 BOCHS BXPCHPET 00000001 BXPC 00000001)
[ 0.000000] No NUMA configuration found
[ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000177afffff]
[ 0.000000] Initmem setup node 0 [mem 0x00000000-0x177afffff]
[ 0.000000] NODE_DATA [mem 0x177afc000-0x177afffff]
[ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[ 0.000000] kvm-clock: cpu 0, msr 1:77afb001, boot clock
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x00001000-0x00ffffff]
[ 0.000000] DMA32 [mem 0x01000000-0xffffffff]
[ 0.000000] Normal [mem 0x100000000-0x177afffff]
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x00001000-0x0009efff]
[ 0.000000] node 0: [mem 0x00100000-0xbffdefff]
[ 0.000000] node 0: [mem 0x100000000-0x177afffff]
[ 0.000000] ACPI: PM-Timer IO Port: 0x608
[ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] enabled)
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[ 0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[ 0.000000] smpboot: Allowing 6 CPUs, 0 hotplug CPUs
[ 0.000000] e820: [mem 0xc0000000-0xfeffbfff] available for PCI devices
[ 0.000000] Booting paravirtualized kernel on KVM
[ 0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:6 nr_node_ids:1
[ 0.000000] PERCPU: Embedded 24 pages/cpu @ffff880177600000 s68672 r8192 d21440 u262144
[ 0.000000] kvm-clock: cpu 0, msr 1:77afb001, primary cpu clock
[ 0.000000] KVM setup async PF for cpu 0
[ 0.000000] kvm-stealtime: cpu 0, msr 17760ba40
[ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 1259065
[ 0.000000] Policy zone: Normal
[ 0.000000] Kernel command line: initrd=initramfs.gz console=ttyS0,9600 BOOT_IMAGE=bzImage
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] Checking aperture...
[ 0.000000] No AGP bridge found
[ 0.000000] Memory: 4921068k/6155264k available (4805k kernel code, 1049100k absent, 185096k reserved, 2414k data, 896k init)
[ 0.000000] Preemptible hierarchical RCU implementation.
[ 0.000000] RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=6.
[ 0.000000] NR_IRQS:4352 nr_irqs:728 16
[ 0.000000] Console: colour VGA+ 80x25
[ 0.000000] console [ttyS0] enabled
[ 0.000000] allocated 20447232 bytes of page_cgroup
[ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[ 0.000000] tsc: Detected 2659.998 MHz processor
[ 0.002000] Calibrating delay loop (skipped) preset value.. 5319.99 BogoMIPS (lpj=2659998)
[ 0.002331] pid_max: default: 32768 minimum: 301
[ 0.002877] Security Framework initialized
[ 0.004031] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[ 0.008020] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes)
[ 0.009662] Mount-cache hash table entries: 256
[ 0.010487] Initializing cgroup subsys memory
[ 0.011104] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[ 0.011104] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0
[ 0.011104] tlb_flushall_shift: 6
[ 0.013020] Freeing SMP alternatives: 12k freed
[ 0.014275] ACPI: Core revision 20130328
[ 0.015794] ACPI: All ACPI Tables successfully acquired
[ 0.017515] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 0.018003] smpboot: CPU0: Intel QEMU Virtual CPU version 2.4.0 (fam: 06, model: 06, stepping: 03)
[ 0.020000] Performance Events: Broken PMU hardware detected, using software events only.
[ 0.020000] Failed to access perfctr msr (MSR c1 is 0)
[ 0.026083] smpboot: Booting Node 0, Processors #1[ 0.002000] kvm-clock: cpu 1, msr 1:77afb041, secondary cpu clock
[ 0.038024] KVM setup async PF for cpu 1
[ 0.038024] kvm-stealtime: cpu 1, msr 17764ba40
#2[ 0.002000] kvm-clock: cpu 2, msr 1:77afb081, secondary cpu clock
[ 0.052022] KVM setup async PF for cpu 2
[ 0.052022] kvm-stealtime: cpu 2, msr 17768ba40
#3[ 0.002000] kvm-clock: cpu 3, msr 1:77afb0c1, secondary cpu clock
[ 0.066027] KVM setup async PF for cpu 3
[ 0.066027] kvm-stealtime: cpu 3, msr 1776cba40
#4[ 0.002000] kvm-clock: cpu 4, msr 1:77afb101, secondary cpu clock
[ 0.080024] KVM setup async PF for cpu 4
[ 0.080024] kvm-stealtime: cpu 4, msr 17770ba40
#5 OK
[ 0.002000] kvm-clock: cpu 5, msr 1:77afb141, secondary cpu clock
[ 0.094043] Brought up 6 CPUs
[ 0.094022] KVM setup async PF for cpu 5
[ 0.094022] kvm-stealtime: cpu 5, msr 17774ba40
[ 0.095003] smpboot: Total of 6 processors activated (31919.97 BogoMIPS)
[ 0.097063] devtmpfs: initialized
[ 0.097957] NET: Registered protocol family 16
[ 0.099057] ACPI: bus type PCI registered
[ 0.099614] PCI: Using configuration type 1 for base access
[ 0.112481] bio: create slab <bio-0> at 0
[ 0.113552] ACPI: Added _OSI(Module Device)
[ 0.113939] ACPI: Added _OSI(Processor Device)
[ 0.114013] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 0.114463] ACPI: Added _OSI(Processor Aggregator Device)
[ 0.117112] ACPI: Interpreter enabled
[ 0.117474] ACPI: (supports S0 S5)
[ 0.117789] ACPI: Using IOAPIC for interrupt routing
[ 0.118080] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 0.119404] ACPI: No dock devices found.
[ 0.126694] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[ 0.127008] acpi PNP0A03:00: ACPI _OSC support notification failed, disabling PCIe ASPM
[ 0.128015] acpi PNP0A03:00: Unable to request _OSC control (_OSC support mask: 0x08)
[ 0.128765] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ 0.129074] PCI host bridge to bus 0000:00
[ 0.130015] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 0.130520] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7]
[ 0.131004] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff]
[ 0.131572] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
[ 0.132014] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff]
[ 0.140466] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI
[ 0.141013] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB
[ 0.202920] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
[ 0.203283] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[ 0.204263] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[ 0.205139] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
[ 0.205764] ACPI: PCI Interrupt Link [LNKS] (IRQs *9)
[ 0.206506] ACPI: Enabled 16 GPEs in block 00 to 0F
[ 0.207347] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[ 0.208004] vgaarb: loaded
[ 0.208261] vgaarb: bridge control possible 0000:00:02.0
[ 0.209311] SCSI subsystem initialized
[ 0.209668] ACPI: bus type ATA registered
[ 0.210421] ACPI: bus type USB registered
[ 0.210935] usbcore: registered new interface driver usbfs
[ 0.211084] usbcore: registered new interface driver hub
[ 0.212101] usbcore: registered new device driver usb
[ 0.212770] pps_core: LinuxPPS API ver. 1 registered
[ 0.213003] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[ 0.214057] PTP clock support registered
[ 0.214585] PCI: Using ACPI for IRQ routing
[ 0.215421] NetLabel: Initializing
[ 0.215737] NetLabel: domain hash size = 128
[ 0.216003] NetLabel: protocols = UNLABELED CIPSOv4
[ 0.216505] NetLabel: unlabeled traffic allowed by default
[ 0.217053] HPET: 3 timers in total, 0 timers will be used for per-cpu timer
[ 0.217698] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[ 0.218131] hpet0: 3 comparators, 64-bit 100.000000 MHz counter
[ 0.222497] amd_nb: Cannot enumerate AMD northbridges
[ 0.223004] Switching to clocksource kvm-clock
[ 0.223623] pnp: PnP ACPI init
[ 0.223921] ACPI: bus type PNP registered
[ 0.225242] pnp: PnP ACPI: found 11 devices
[ 0.225631] ACPI: bus type PNP unregistered
[ 0.237963] NET: Registered protocol family 2
[ 0.238788] TCP established hash table entries: 65536 (order: 8, 1048576 bytes)
[ 0.240158] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 0.241077] TCP: Hash tables configured (established 65536 bind 65536)
[ 0.241698] TCP: reno registered
[ 0.242031] UDP hash table entries: 4096 (order: 5, 131072 bytes)
[ 0.242648] UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes)
[ 0.243446] NET: Registered protocol family 1
[ 0.244330] RPC: Registered named UNIX socket transport module.
[ 0.244917] RPC: Registered udp transport module.
[ 0.245368] RPC: Registered tcp transport module.
[ 0.245796] RPC: Registered tcp NFSv4.1 backchannel transport module.
[ 0.246405] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[ 0.246951] pci 0000:00:01.0: PIIX3: Enabling Passive Release
[ 0.247511] pci 0000:00:01.0: Activating ISA DMA hang workarounds
[ 0.248208] Trying to unpack rootfs image as initramfs...
[ 0.952652] Freeing initrd memory: 37844k freed
[ 0.959548] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[ 0.960199] software IO TLB [mem 0xbbfdf000-0xbffdf000] (64MB) mapped at [ffff8800bbfdf000-ffff8800bffdefff]
[ 0.962770] microcode: CPU0 sig=0x663, pf=0x1, revision=0x1
[ 0.963345] microcode: CPU1 sig=0x663, pf=0x1, revision=0x1
[ 0.963876] microcode: CPU2 sig=0x663, pf=0x1, revision=0x1
[ 0.964430] microcode: CPU3 sig=0x663, pf=0x1, revision=0x1
[ 0.965121] microcode: CPU4 sig=0x663, pf=0x1, revision=0x1
[ 0.965646] microcode: CPU5 sig=0x663, pf=0x1, revision=0x1
[ 0.966279] microcode: Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[ 0.967988] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 0.968953] VFS: Disk quotas dquot_6.5.2
[ 0.969393] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 0.970551] NFS: Registering the id_resolver key type
[ 0.971062] Key type id_resolver registered
[ 0.971445] Key type id_legacy registered
[ 0.971923] msgmni has been set to 9685
[ 0.972917] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
[ 0.973630] io scheduler noop registered
[ 0.973991] io scheduler deadline registered
[ 0.974454] io scheduler cfq registered (default)
[ 0.975542] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[ 0.976242] ACPI: Power Button [PWRF]
[ 1.027482] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11
[ 1.077279] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10
[ 1.127110] ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 11
[ 1.128041] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[ 1.152503] 00:05: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[ 1.176867] 00:06: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[ 1.178332] Non-volatile memory driver v1.3
[ 1.178722] Linux agpgart interface v0.103
[ 1.179396] [drm] Initialized drm 1.1.0 20060810
[ 1.180203] Floppy drive(s): fd0 is 1.44M, fd1 is 1.44M
[ 1.184242] brd: module loaded
[ 1.186469] loop: module loaded
[ 1.188255] vda: vda1 vda2 vda3 < vda5 vda6 vda7 >
[ 1.189623] Loading iSCSI transport class v2.0-870.
[ 1.192275] FDC 0 is a S82078B
[ 1.192873] scsi0 : ata_piix
[ 1.193454] scsi1 : ata_piix
[ 1.193885] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc0c0 irq 14
[ 1.194534] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc0c8 irq 15
[ 1.195597] e100: Intel(R) PRO/100 Network Driver, 3.5.24-k2-NAPI
[ 1.196177] e100: Copyright(c) 1999-2006 Intel Corporation
[ 1.196763] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.0.3-k
[ 1.197423] igb: Copyright (c) 2007-2013 Intel Corporation.
[ 1.198044] Fusion MPT base driver 3.04.20
[ 1.198427] Copyright (c) 1999-2008 LSI Corporation
[ 1.198871] Fusion MPT SPI Host driver 3.04.20
[ 1.199414] Fusion MPT FC Host driver 3.04.20
[ 1.199914] Fusion MPT SAS Host driver 3.04.20
[ 1.200663] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 1.201304] ehci-pci: EHCI PCI platform driver
[ 1.201871] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[ 1.202560] uhci_hcd: USB Universal Host Controller Interface driver
[ 1.203400] usbcore: registered new interface driver usblp
[ 1.203992] usbcore: registered new interface driver usb-storage
[ 1.204777] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[ 1.206262] serio: i8042 KBD port at 0x60,0x64 irq 1
[ 1.206723] serio: i8042 AUX port at 0x60,0x64 irq 12
[ 1.207478] mousedev: PS/2 mouse device common for all mice
[ 1.208596] rtc_cmos 00:00: RTC can wake from S4
[ 1.209394] rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0
[ 1.209472] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
[ 1.210976] rtc_cmos 00:00: alarms up to one day, 114 bytes nvram, hpet irqs
[ 1.211971] i2c /dev entries driver
[ 1.212639] md: raid1 personality registered for level 1
[ 1.213557] device-mapper: ioctl: 4.24.0-ioctl (2013-01-15) initialised: dm-devel@redhat.com
[ 1.214423] cpuidle: using governor ladder
[ 1.214985] hidraw: raw HID events driver (C) Jiri Kosina
[ 1.218115] usbcore: registered new interface driver usbhid
[ 1.218630] usbhid: USB HID core driver
[ 1.219079] ipip: IPv4 over IPv4 tunneling driver
[ 1.219860] TCP: cubic registered
[ 1.220212] Initializing XFRM netlink socket
[ 1.220742] NET: Registered protocol family 10
[ 1.221495] NET: Registered protocol family 17
[ 1.221936] Key type dns_resolver registered
[ 1.222707] registered taskstats version 1
[ 1.223452] console [netcon0] enabled
[ 1.223799] netconsole: network logging started
[ 1.346948] ata1.00: ATA-7: QEMU HARDDISK, 2.4.0, max UDMA/100
[ 1.347525] ata1.00: 6291456 sectors, multi 16: LBA48
[ 1.348147] ata2.00: ATAPI: QEMU DVD-ROM, 2.4.0, max UDMA/100
[ 1.349188] ata1.00: configured for MWDMA2
[ 1.349620] ata2.00: configured for MWDMA2
[ 1.349703] scsi 0:0:0:0: Direct-Access ATA QEMU HARDDISK 2.4. PQ: 0 ANSI: 5
[ 1.350171] sd 0:0:0:0: [sda] 6291456 512-byte logical blocks: (3.22 GB/3.00 GiB)
[ 1.350250] sd 0:0:0:0: [sda] Write Protect is off
[ 1.350278] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 1.353181] sd 0:0:0:0: Attached scsi generic sg0 type 0
[ 1.353806] sda: unknown partition table
[ 1.354527] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.4. PQ: 0 ANSI: 5
[ 1.355478] sd 0:0:0:0: [sda] Attached SCSI disk
[ 1.355921] sr0: scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray
[ 1.355923] cdrom: Uniform CD-ROM driver Revision: 3.20
[ 1.356480] sr 1:0:0:0: Attached scsi generic sg1 type 5
[ 1.357643] Freeing unused kernel memory: 896k freed
INIT: version 2.86 booting
Please wait: booting...
mount: sysfs already mounted or /sys busy
mount: according to mtab, sysfs is already mounted on /sys
Starting udev [ 1.423487] udevd (800): /proc/800/oom_adj is deprecated, please use /proc/800/oom_score_adj instead.
[ 1.424452] udevd version 124 started
[ 1.553067] end_request: I/O error, dev fd0, sector 0
[ 1.818492] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input2
[ 1.963057] tsc: Refined TSC clocksource calibration: 2660.004 MHz
[ 1.993049] end_request: I/O error, dev fd0, sector 0
and populating dev cache
Root filesystem already rw, not remounting
Configuring network interfaces... done.
net.ipv4.conf.default.rp_filter = 1
net.ipv4.conf.all.rp_filter = 1
Configuring kvm-ivshmem
Configuring busybox-syslog
System startup links for /etc/init.d/sysklogd already exist.
Configuring openssh-sshd
Adding system startup for /etc/init.d/sshd.
Configuring sudo
Configuring ntpdate
adding crontab
Configuring update-modules
INIT: Entering runlevel: 5
Starting OpenBSD Secure Shell server: sshd
generating ssh RSA key...
generating ssh DSA key...
done.
Starting Advanced Configuration and Power Interface daemon: acpid.
acpid: starting up with proc fs

acpid: opendir(/etc/acpi/events): No such file or directory

starting Busybox inetd: inetd... done.
Starting ntpd: done
Starting syslogd/klogd: done
Cisco FirePOWER Services Boot Image 6.6.1

asasfr login: [ 2486.154598] vda: vda1
[ 2490.193178] Adding 4194756k swap on /dev/vda1. Priority:-1 extents:1 across:4194756k
[ 5393.517476] kjournald starting. Commit interval 5 seconds
[ 5393.517640] EXT3-fs (vda5): using internal journal
[ 5393.517642] EXT3-fs (vda5): mounted filesystem with ordered data mode
[ 5393.558822] kjournald starting. Commit interval 5 seconds
[ 5393.559139] EXT3-fs (sda1): using internal journal
[ 5393.559141] EXT3-fs (sda1): mounted filesystem with ordered data mode
[ 5393.764254] kjournald starting. Commit interval 5 seconds
[ 5393.798956] EXT3-fs (vda7): using internal journal
[ 5393.799444] EXT3-fs (vda7): mounted filesystem with ordered data mode
[ 5746.900045] end_request: I/O error, dev fd0, sector 0
[ 5768.871032] end_request: I/O error, dev fd0, sector 0
INIT: Switching to runlevel: 6
INIT: Sending processes the TERM signal
Stopping OpenBSD Secure Shell server: sshdstopped /usr/sbin/sshd (pid 2189)
.
Stopping Advanced Configuration and Power Interface daemon: no /usr/sbin/acpid found; none killed
stopping Busybox inetd: inetd... stopped inetd (pid 2197)
done.
Stopping ntpd: stopped process in pidfile '/var/run/ntp.pid' (pid 2308)
done
Stopping syslogd/klogd: done
Deconfiguring network interfaces... done.
Sending all processes the TERM signal...
Sending all processes the KILL signal...
Unmounting remote filesystems...
Deactivating swap...
Unmounting local filesystems...
umount2: Device or resource busy
umount: none busy - remounted read-only
Rebooting... [ 5812.852106] Unregister pv shared memory for cpu 0
[ 5812.852108] Unregister pv shared memory for cpu 2
[ 5812.852109] Unregister pv shared memory for cpu 1
[ 5812.852110] Unregister pv shared memory for cpu 3
[ 5812.852112] Unregister pv shared memory for cpu 5
[ 5812.854343] Unregister pv shared memory for cpu 4
[ 5812.855036] sd 0:0:0:0: [sda] Synchronizing SCSI cache
[ 5812.856165] Restarting system.
[ 5812.856451] reboot: machine restart

***
*** EVENT: The module is being automatically restarted.
*** TIME: 19:50:05 GMT/BST Dec 17 2020
***

ABLCPRFW01/pri/stby# show module sfr log console

Displaying Console Log Information for Module sfr:

***
*** EVENT: Creating the Disk Image...
*** TIME: 18:10:56 GMT/BST Dec 17 2020
***

***
*** EVENT: The module is being recovered.
*** TIME: 18:10:56 GMT/BST Dec 17 2020
***

***
*** EVENT: Disk Image created successfully.
*** TIME: 18:13:05 GMT/BST Dec 17 2020
***

***
*** EVENT: Start Parameters: Image: /mnt/disk0/vm/vm_3.img, ISO: -cdrom /mnt/disk0/asasfr-5500x-boot-6.6.1-2.img, Num CPUs: 6, RAM: 4987MB, Mgmt MAC: 2C:33:11:96:ED:08, CP MAC: 00:00:00:04:00:01, HDD: -drive file=/dev/md0,cache=none,if=virtio, Dev D

***
*** EVENT: Start Parameters Continued: RegEx Shared Mem: 32MB, Cmd Op: r, Shared Mem Key: 8061, Shared Mem Size: 64, Log Pipe: /dev/ttyS0_vm3, Sock: /dev/ttyS1_vm3, Mem-Path: -mem-path /hugepages
*** TIME: 18:13:06 GMT/BST Dec 17 2020
***

(process:1802): GLib-WARNING **: /local/jenkins_engci_sjc/workspace/team_SSP/fxplatform/Builds/release__2.6.1_fcs_hammersmith/build-smp-compile/fxos/linux/wrlinux/bitbake_build/tmp/work/corei7-64-wrs-linux/glib-2.0/1_2.54.3-r0/glib-2.54.3/glib/gmem.c:483: custom memory allocation vtable not supported
WARNING: Image format was not specified for '/mnt/disk0/vm/vm_3.img' and probing guessed raw.
Automatically detecting the format is dangerous for raw images, write operations on block 0 will be restricted.
Specify the 'raw' format explicitly to remove the restrictions.
WARNING: Image format was not specified for '/dev/md0' and probing guessed raw.
Automatically detecting the format is dangerous for raw images, write operations on block 0 will be restricted.
Specify the 'raw' format explicitly to remove the restrictions.
WARNING: Image format was not specified for '/mnt/disk0/.private/meta_vm_data' and probing guessed raw.
Automatically detecting the format is dangerous for raw images, write operations on block 0 will be restricted.
Specify the 'raw' format explicitly to remove the restrictions.
Status: Mapping host 0x7fca2c400000 to VM with size 67108864
Warning: vlan 0 is not connected to host network

ISOLINUX 3.73 2009-01-25 Copyright (C) 1994-2008 H. Peter Anvin

Cisco SFR-BOOT-IMAGE and CX-BOOT-IMAGE for SFR - 6.6.1

(WARNING: ALL DATA ON DISK 1 WILL BE LOST)

Loading bzImage.............................................................
Loading initramfs.gz..................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................ready.
[ 0.000000] Initializing cgroup subsys cpuset
[ 0.000000] Initializing cgroup subsys cpu
[ 0.000000] Initializing cgroup subsys cpuacct
[ 0.000000] Linux version 3.10.107sf.cisco-1 (build@1fd5cd658885) (gcc version 4.7.1 (GCC) ) #1 SMP PREEMPT Fri Nov 10 17:06:45 UTC 2017
[ 0.000000] Command line: initrd=initramfs.gz console=ttyS0,9600 BOOT_IMAGE=bzImage
[ 0.000000] e820: BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffdefff] usable
[ 0.000000] BIOS-e820: [mem 0x00000000bffdf000-0x00000000bfffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000177afffff] usable
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] SMBIOS 2.8 present.
[ 0.000000] Hypervisor detected: KVM
[ 0.000000] No AGP bridge found
[ 0.000000] e820: last_pfn = 0x177b00 max_arch_pfn = 0x400000000
[ 0.000000] PAT not supported by CPU.
[ 0.000000] e820: last_pfn = 0xbffdf max_arch_pfn = 0x400000000
[ 0.000000] found SMP MP-table at [mem 0x000f6430-0x000f643f] mapped at [ffff8800000f6430]
[ 0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff]
[ 0.000000] init_memory_mapping: [mem 0x177800000-0x1779fffff]
[ 0.000000] init_memory_mapping: [mem 0x174000000-0x1777fffff]
[ 0.000000] init_memory_mapping: [mem 0x100000000-0x173ffffff]
[ 0.000000] init_memory_mapping: [mem 0x00100000-0xbffdefff]
[ 0.000000] init_memory_mapping: [mem 0x177a00000-0x177afffff]
[ 0.000000] RAMDISK: [mem 0x7db0b000-0x7fffffff]
[ 0.000000] ACPI: RSDP 0x00000000000F63E0 00014 (v00 BOCHS )
[ 0.000000] ACPI: RSDT 0x00000000BFFE14F2 00034 (v01 BOCHS BXPCRSDT 00000001 BXPC 00000001)
[ 0.000000] ACPI: FACP 0x00000000BFFE089A 00074 (v01 BOCHS BXPCFACP 00000001 BXPC 00000001)
[ 0.000000] ACPI: DSDT 0x00000000BFFDFD00 00B9A (v01 BOCHS BXPCDSDT 00000001 BXPC 00000001)
[ 0.000000] ACPI: FACS 0x00000000BFFDFCC0 00040
[ 0.000000] ACPI: SSDT 0x00000000BFFE090E 00B0C (v01 BOCHS BXPCSSDT 00000001 BXPC 00000001)
[ 0.000000] ACPI: APIC 0x00000000BFFE141A 000A0 (v01 BOCHS BXPCAPIC 00000001 BXPC 00000001)
[ 0.000000] ACPI: HPET 0x00000000BFFE14BA 00038 (v01 BOCHS BXPCHPET 00000001 BXPC 00000001)
[ 0.000000] No NUMA configuration found
[ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000177afffff]
[ 0.000000] Initmem setup node 0 [mem 0x00000000-0x177afffff]
[ 0.000000] NODE_DATA [mem 0x177afc000-0x177afffff]
[ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[ 0.000000] kvm-clock: cpu 0, msr 1:77afb001, boot clock
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x00001000-0x00ffffff]
[ 0.000000] DMA32 [mem 0x01000000-0xffffffff]
[ 0.000000] Normal [mem 0x100000000-0x177afffff]
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x00001000-0x0009efff]
[ 0.000000] node 0: [mem 0x00100000-0xbffdefff]
[ 0.000000] node 0: [mem 0x100000000-0x177afffff]
[ 0.000000] ACPI: PM-Timer IO Port: 0x608
[ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] enabled)
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[ 0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[ 0.000000] smpboot: Allowing 6 CPUs, 0 hotplug CPUs
[ 0.000000] e820: [mem 0xc0000000-0xfeffbfff] available for PCI devices
[ 0.000000] Booting paravirtualized kernel on KVM
[ 0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:6 nr_node_ids:1
[ 0.000000] PERCPU: Embedded 24 pages/cpu @ffff880177600000 s68672 r8192 d21440 u262144
[ 0.000000] kvm-clock: cpu 0, msr 1:77afb001, primary cpu clock
[ 0.000000] KVM setup async PF for cpu 0
[ 0.000000] kvm-stealtime: cpu 0, msr 17760ba40
[ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 1259065
[ 0.000000] Policy zone: Normal
[ 0.000000] Kernel command line: initrd=initramfs.gz console=ttyS0,9600 BOOT_IMAGE=bzImage
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] Checking aperture...
[ 0.000000] No AGP bridge found
[ 0.000000] Memory: 4921068k/6155264k available (4805k kernel code, 1049100k absent, 185096k reserved, 2414k data, 896k init)
[ 0.000000] Preemptible hierarchical RCU implementation.
[ 0.000000] RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=6.
[ 0.000000] NR_IRQS:4352 nr_irqs:728 16
[ 0.000000] Console: colour VGA+ 80x25
[ 0.000000] console [ttyS0] enabled
[ 0.000000] allocated 20447232 bytes of page_cgroup
[ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[ 0.000000] tsc: Detected 2659.998 MHz processor
[ 0.002000] Calibrating delay loop (skipped) preset value.. 5319.99 BogoMIPS (lpj=2659998)
[ 0.002331] pid_max: default: 32768 minimum: 301
[ 0.002877] Security Framework initialized
[ 0.004031] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[ 0.008020] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes)
[ 0.009662] Mount-cache hash table entries: 256
[ 0.010487] Initializing cgroup subsys memory
[ 0.011104] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[ 0.011104] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0
[ 0.011104] tlb_flushall_shift: 6
[ 0.013020] Freeing SMP alternatives: 12k freed
[ 0.014275] ACPI: Core revision 20130328
[ 0.015794] ACPI: All ACPI Tables successfully acquired
[ 0.017515] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 0.018003] smpboot: CPU0: Intel QEMU Virtual CPU version 2.4.0 (fam: 06, model: 06, stepping: 03)
[ 0.020000] Performance Events: Broken PMU hardware detected, using software events only.
[ 0.020000] Failed to access perfctr msr (MSR c1 is 0)
[ 0.026083] smpboot: Booting Node 0, Processors #1[ 0.002000] kvm-clock: cpu 1, msr 1:77afb041, secondary cpu clock
[ 0.038024] KVM setup async PF for cpu 1
[ 0.038024] kvm-stealtime: cpu 1, msr 17764ba40
#2[ 0.002000] kvm-clock: cpu 2, msr 1:77afb081, secondary cpu clock
[ 0.052022] KVM setup async PF for cpu 2
[ 0.052022] kvm-stealtime: cpu 2, msr 17768ba40
#3[ 0.002000] kvm-clock: cpu 3, msr 1:77afb0c1, secondary cpu clock
[ 0.066027] KVM setup async PF for cpu 3
[ 0.066027] kvm-stealtime: cpu 3, msr 1776cba40
#4[ 0.002000] kvm-clock: cpu 4, msr 1:77afb101, secondary cpu clock
[ 0.080024] KVM setup async PF for cpu 4
[ 0.080024] kvm-stealtime: cpu 4, msr 17770ba40
#5 OK
[ 0.002000] kvm-clock: cpu 5, msr 1:77afb141, secondary cpu clock
[ 0.094043] Brought up 6 CPUs
[ 0.094022] KVM setup async PF for cpu 5
[ 0.094022] kvm-stealtime: cpu 5, msr 17774ba40
[ 0.095003] smpboot: Total of 6 processors activated (31919.97 BogoMIPS)
[ 0.097063] devtmpfs: initialized
[ 0.097957] NET: Registered protocol family 16
[ 0.099057] ACPI: bus type PCI registered
[ 0.099614] PCI: Using configuration type 1 for base access
[ 0.112481] bio: create slab <bio-0> at 0
[ 0.113552] ACPI: Added _OSI(Module Device)
[ 0.113939] ACPI: Added _OSI(Processor Device)
[ 0.114013] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 0.114463] ACPI: Added _OSI(Processor Aggregator Device)
[ 0.117112] ACPI: Interpreter enabled
[ 0.117474] ACPI: (supports S0 S5)
[ 0.117789] ACPI: Using IOAPIC for interrupt routing
[ 0.118080] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 0.119404] ACPI: No dock devices found.
[ 0.126694] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[ 0.127008] acpi PNP0A03:00: ACPI _OSC support notification failed, disabling PCIe ASPM
[ 0.128015] acpi PNP0A03:00: Unable to request _OSC control (_OSC support mask: 0x08)
[ 0.128765] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ 0.129074] PCI host bridge to bus 0000:00
[ 0.130015] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 0.130520] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7]
[ 0.131004] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff]
[ 0.131572] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
[ 0.132014] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff]
[ 0.140466] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI
[ 0.141013] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB
[ 0.202920] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
[ 0.203283] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[ 0.204263] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[ 0.205139] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
[ 0.205764] ACPI: PCI Interrupt Link [LNKS] (IRQs *9)
[ 0.206506] ACPI: Enabled 16 GPEs in block 00 to 0F
[ 0.207347] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[ 0.208004] vgaarb: loaded
[ 0.208261] vgaarb: bridge control possible 0000:00:02.0
[ 0.209311] SCSI subsystem initialized
[ 0.209668] ACPI: bus type ATA registered
[ 0.210421] ACPI: bus type USB registered
[ 0.210935] usbcore: registered new interface driver usbfs
[ 0.211084] usbcore: registered new interface driver hub
[ 0.212101] usbcore: registered new device driver usb
[ 0.212770] pps_core: LinuxPPS API ver. 1 registered
[ 0.213003] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[ 0.214057] PTP clock support registered
[ 0.214585] PCI: Using ACPI for IRQ routing
[ 0.215421] NetLabel: Initializing
[ 0.215737] NetLabel: domain hash size = 128
[ 0.216003] NetLabel: protocols = UNLABELED CIPSOv4
[ 0.216505] NetLabel: unlabeled traffic allowed by default
[ 0.217053] HPET: 3 timers in total, 0 timers will be used for per-cpu timer
[ 0.217698] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[ 0.218131] hpet0: 3 comparators, 64-bit 100.000000 MHz counter
[ 0.222497] amd_nb: Cannot enumerate AMD northbridges
[ 0.223004] Switching to clocksource kvm-clock
[ 0.223623] pnp: PnP ACPI init
[ 0.223921] ACPI: bus type PNP registered
[ 0.225242] pnp: PnP ACPI: found 11 devices
[ 0.225631] ACPI: bus type PNP unregistered
[ 0.237963] NET: Registered protocol family 2
[ 0.238788] TCP established hash table entries: 65536 (order: 8, 1048576 bytes)
[ 0.240158] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 0.241077] TCP: Hash tables configured (established 65536 bind 65536)
[ 0.241698] TCP: reno registered
[ 0.242031] UDP hash table entries: 4096 (order: 5, 131072 bytes)
[ 0.242648] UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes)
[ 0.243446] NET: Registered protocol family 1
[ 0.244330] RPC: Registered named UNIX socket transport module.
[ 0.244917] RPC: Registered udp transport module.
[ 0.245368] RPC: Registered tcp transport module.
[ 0.245796] RPC: Registered tcp NFSv4.1 backchannel transport module.
[ 0.246405] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[ 0.246951] pci 0000:00:01.0: PIIX3: Enabling Passive Release
[ 0.247511] pci 0000:00:01.0: Activating ISA DMA hang workarounds
[ 0.248208] Trying to unpack rootfs image as initramfs...
[ 0.952652] Freeing initrd memory: 37844k freed
[ 0.959548] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[ 0.960199] software IO TLB [mem 0xbbfdf000-0xbffdf000] (64MB) mapped at [ffff8800bbfdf000-ffff8800bffdefff]
[ 0.962770] microcode: CPU0 sig=0x663, pf=0x1, revision=0x1
[ 0.963345] microcode: CPU1 sig=0x663, pf=0x1, revision=0x1
[ 0.963876] microcode: CPU2 sig=0x663, pf=0x1, revision=0x1
[ 0.964430] microcode: CPU3 sig=0x663, pf=0x1, revision=0x1
[ 0.965121] microcode: CPU4 sig=0x663, pf=0x1, revision=0x1
[ 0.965646] microcode: CPU5 sig=0x663, pf=0x1, revision=0x1
[ 0.966279] microcode: Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[ 0.967988] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 0.968953] VFS: Disk quotas dquot_6.5.2
[ 0.969393] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 0.970551] NFS: Registering the id_resolver key type
[ 0.971062] Key type id_resolver registered
[ 0.971445] Key type id_legacy registered
[ 0.971923] msgmni has been set to 9685
[ 0.972917] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
[ 0.973630] io scheduler noop registered
[ 0.973991] io scheduler deadline registered
[ 0.974454] io scheduler cfq registered (default)
[ 0.975542] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[ 0.976242] ACPI: Power Button [PWRF]
[ 1.027482] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11
[ 1.077279] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10
[ 1.127110] ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 11
[ 1.128041] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[ 1.152503] 00:05: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[ 1.176867] 00:06: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[ 1.178332] Non-volatile memory driver v1.3
[ 1.178722] Linux agpgart interface v0.103
[ 1.179396] [drm] Initialized drm 1.1.0 20060810
[ 1.180203] Floppy drive(s): fd0 is 1.44M, fd1 is 1.44M
[ 1.184242] brd: module loaded
[ 1.186469] loop: module loaded
[ 1.188255] vda: vda1 vda2 vda3 < vda5 vda6 vda7 >
[ 1.189623] Loading iSCSI transport class v2.0-870.
[ 1.192275] FDC 0 is a S82078B
[ 1.192873] scsi0 : ata_piix
[ 1.193454] scsi1 : ata_piix
[ 1.193885] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc0c0 irq 14
[ 1.194534] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc0c8 irq 15
[ 1.195597] e100: Intel(R) PRO/100 Network Driver, 3.5.24-k2-NAPI
[ 1.196177] e100: Copyright(c) 1999-2006 Intel Corporation
[ 1.196763] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.0.3-k
[ 1.197423] igb: Copyright (c) 2007-2013 Intel Corporation.
[ 1.198044] Fusion MPT base driver 3.04.20
[ 1.198427] Copyright (c) 1999-2008 LSI Corporation
[ 1.198871] Fusion MPT SPI Host driver 3.04.20
[ 1.199414] Fusion MPT FC Host driver 3.04.20
[ 1.199914] Fusion MPT SAS Host driver 3.04.20
[ 1.200663] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 1.201304] ehci-pci: EHCI PCI platform driver
[ 1.201871] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[ 1.202560] uhci_hcd: USB Universal Host Controller Interface driver
[ 1.203400] usbcore: registered new interface driver usblp
[ 1.203992] usbcore: registered new interface driver usb-storage
[ 1.204777] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[ 1.206262] serio: i8042 KBD port at 0x60,0x64 irq 1
[ 1.206723] serio: i8042 AUX port at 0x60,0x64 irq 12
[ 1.207478] mousedev: PS/2 mouse device common for all mice
[ 1.208596] rtc_cmos 00:00: RTC can wake from S4
[ 1.209394] rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0
[ 1.209472] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
[ 1.210976] rtc_cmos 00:00: alarms up to one day, 114 bytes nvram, hpet irqs
[ 1.211971] i2c /dev entries driver
[ 1.212639] md: raid1 personality registered for level 1
[ 1.213557] device-mapper: ioctl: 4.24.0-ioctl (2013-01-15) initialised: dm-devel@redhat.com
[ 1.214423] cpuidle: using governor ladder
[ 1.214985] hidraw: raw HID events driver (C) Jiri Kosina
[ 1.218115] usbcore: registered new interface driver usbhid
[ 1.218630] usbhid: USB HID core driver
[ 1.219079] ipip: IPv4 over IPv4 tunneling driver
[ 1.219860] TCP: cubic registered
[ 1.220212] Initializing XFRM netlink socket
[ 1.220742] NET: Registered protocol family 10
[ 1.221495] NET: Registered protocol family 17
[ 1.221936] Key type dns_resolver registered
[ 1.222707] registered taskstats version 1
[ 1.223452] console [netcon0] enabled
[ 1.223799] netconsole: network logging started
[ 1.346948] ata1.00: ATA-7: QEMU HARDDISK, 2.4.0, max UDMA/100
[ 1.347525] ata1.00: 6291456 sectors, multi 16: LBA48
[ 1.348147] ata2.00: ATAPI: QEMU DVD-ROM, 2.4.0, max UDMA/100
[ 1.349188] ata1.00: configured for MWDMA2
[ 1.349620] ata2.00: configured for MWDMA2
[ 1.349703] scsi 0:0:0:0: Direct-Access ATA QEMU HARDDISK 2.4. PQ: 0 ANSI: 5
[ 1.350171] sd 0:0:0:0: [sda] 6291456 512-byte logical blocks: (3.22 GB/3.00 GiB)
[ 1.350250] sd 0:0:0:0: [sda] Write Protect is off
[ 1.350278] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 1.353181] sd 0:0:0:0: Attached scsi generic sg0 type 0
[ 1.353806] sda: unknown partition table
[ 1.354527] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.4. PQ: 0 ANSI: 5
[ 1.355478] sd 0:0:0:0: [sda] Attached SCSI disk
[ 1.355921] sr0: scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray
[ 1.355923] cdrom: Uniform CD-ROM driver Revision: 3.20
[ 1.356480] sr 1:0:0:0: Attached scsi generic sg1 type 5
[ 1.357643] Freeing unused kernel memory: 896k freed
INIT: version 2.86 booting
Please wait: booting...
mount: sysfs already mounted or /sys busy
mount: according to mtab, sysfs is already mounted on /sys
Starting udev [ 1.423487] udevd (800): /proc/800/oom_adj is deprecated, please use /proc/800/oom_score_adj instead.
[ 1.424452] udevd version 124 started
[ 1.553067] end_request: I/O error, dev fd0, sector 0
[ 1.818492] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input2
[ 1.963057] tsc: Refined TSC clocksource calibration: 2660.004 MHz
[ 1.993049] end_request: I/O error, dev fd0, sector 0
and populating dev cache
Root filesystem already rw, not remounting
Configuring network interfaces... done.
net.ipv4.conf.default.rp_filter = 1
net.ipv4.conf.all.rp_filter = 1
Configuring kvm-ivshmem
Configuring busybox-syslog
System startup links for /etc/init.d/sysklogd already exist.
Configuring openssh-sshd
Adding system startup for /etc/init.d/sshd.
Configuring sudo
Configuring ntpdate
adding crontab
Configuring update-modules
INIT: Entering runlevel: 5
Starting OpenBSD Secure Shell server: sshd
generating ssh RSA key...
generating ssh DSA key...
done.
Starting Advanced Configuration and Power Interface daemon: acpid.
acpid: starting up with proc fs

acpid: opendir(/etc/acpi/events): No such file or directory

starting Busybox inetd: inetd... done.
Starting ntpd: done
Starting syslogd/klogd: done
Cisco FirePOWER Services Boot Image 6.6.1

asasfr login: [ 2486.154598] vda: vda1
[ 2490.193178] Adding 4194756k swap on /dev/vda1. Priority:-1 extents:1 across:4194756k
[ 5393.517476] kjournald starting. Commit interval 5 seconds
[ 5393.517640] EXT3-fs (vda5): using internal journal
[ 5393.517642] EXT3-fs (vda5): mounted filesystem with ordered data mode
[ 5393.558822] kjournald starting. Commit interval 5 seconds
[ 5393.559139] EXT3-fs (sda1): using internal journal
[ 5393.559141] EXT3-fs (sda1): mounted filesystem with ordered data mode
[ 5393.764254] kjournald starting. Commit interval 5 seconds
[ 5393.798956] EXT3-fs (vda7): using internal journal
[ 5393.799444] EXT3-fs (vda7): mounted filesystem with ordered data mode
[ 5746.900045] end_request: I/O error, dev fd0, sector 0
[ 5768.871032] end_request: I/O error, dev fd0, sector 0
INIT: Switching to runlevel: 6
INIT: Sending processes the TERM signal
Stopping OpenBSD Secure Shell server: sshdstopped /usr/sbin/sshd (pid 2189)
.
Stopping Advanced Configuration and Power Interface daemon: no /usr/sbin/acpid found; none killed
stopping Busybox inetd: inetd... stopped inetd (pid 2197)
done.
Stopping ntpd: stopped process in pidfile '/var/run/ntp.pid' (pid 2308)
done
Stopping syslogd/klogd: done
Deconfiguring network interfaces... done.
Sending all processes the TERM signal...
Sending all processes the KILL signal...
Unmounting remote filesystems...
Deactivating swap...
Unmounting local filesystems...
umount2: Device or resource busy
umount: none busy - remounted read-only
Rebooting... [ 5812.852106] Unregister pv shared memory for cpu 0
[ 5812.852108] Unregister pv shared memory for cpu 2
[ 5812.852109] Unregister pv shared memory for cpu 1
[ 5812.852110] Unregister pv shared memory for cpu 3
[ 5812.852112] Unregister pv shared memory for cpu 5
[ 5812.854343] Unregister pv shared memory for cpu 4
[ 5812.855036] sd 0:0:0:0: [sda] Synchronizing SCSI cache
[ 5812.856165] Restarting system.
[ 5812.856451] reboot: machine restart

***
*** EVENT: The module is being automatically restarted.
*** TIME: 19:50:05 GMT/BST Dec 17 2020
***

[Marvin Rhoads · Accepted solution]

Twice in the log you shared the recover mode got to the prompt of "asasfr login:". We expect the module, as seen from the parent ASA, to still be in recover mode at that point.

What is required then is a session into the module to continue to setup by doing the "system install" procedure to load the pkg file. Only after the module restarts as part of that second phase installation will the ASA see it as no longer in recover mode.

[PacketSpartan · Accepted solution]

Hi Marvin, thank you for your input. after waiting between 24-36 hours and a TAC case, the SSDs were RMAd and the whole upgraded from uploading the img file and pkg took less 90 mins.

90 minutes for the whole upgrade.  (crazy considering how we waited over 12-16 hours in the previous attempts) 

My colleague suspected that we should have let the first round of upgrade run for 24 hours, and should not have interrupted it. We still have the secondary box to upgrade so it will be interesting how this pans out.