cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
4582
Views
0
Helpful
3
Replies

WAE-674 memory upgrade failed to recover from disk partitioning

tammyc
Level 1
Level 1

I am testing the memory upgrade from 4GB to 8GB on the WAE-674 version is 4.3.1.  The WAAS recognized the new memory.  I performed the final step in the documentation 'disk delete-data-partitions' and reloaded.  A few things: 1) i had to re-install the license 2) it lost the cms enable, so it would not rejoin the CM after coming back online and 3) the disks did not properly recover.  What is recommended course of action?  See below for stats:

1) license now active subsequent to adding again after reload

WAAS-674#sh lic

License Name   Status      Activation Date Activated By

-------------- ----------- --------------- --------------

Transport      not active

Enterprise     active      07/07/2011      admin

Video          not active

Virtual-Blade  not active

2) cms no longer running and currently unable to run

WAAS-674#sh cms info

spawnp: execve: : No such file or directory

Error spawning process '/sw/merlot/bin/spen': Illegal seek

%Error in piping process. Quitting

*** Error: getline(): not interactive, use stdio.

BTACC-WAAS-674#

WAAS-674(config)#cms enable

sh: /sw/merlot/bin/spen: No such file or directory

FAILED to enable management services

3) after first failure with the disk delete-data-partition, tried the command again today, resulting in same symptom/error

System Initialization Finished.

Disk based software not installed.

Some applications may not run correctly!

WAAS-674#sh disk details

RAID Physical disk information:

  disk00: Online                     3SJ0A7VA    286102 MB

  disk01: Online                     3SJ09XXZ    286102 MB

  disk02: Online                     3SJ0A9QH    286102 MB

RAID Logical drive information:

  Drive 1:      RAID-5  Okay

                Enabled   (read-cache) Enabled (write-back)

Mounted file systems:

MOUNT POINT      TYPE       DEVICE                SIZE     INUSE      FREE USE%

/sw              internal   /dev/sda1            991MB      16MB     975MB   1%

/swstore         internal   /dev/sda2            991MB      16MB     975MB   1%

/state           internal   /dev/sda3           7935MB     131MB    7804MB   1%

/local/local1    SYSFS      /dev/sda6          22318MB     129MB   22189MB   0%

.../local1/spool PRINTSPOOL /dev/data1/spool     991MB      32MB     959MB   3%

/obj1            CONTENT    /dev/data1/obj    121015MB     128MB  120887MB   0%

/dre1            CONTENT    /dev/data1/dre    317418MB     128MB  317290MB   0%

/ackq1           internal   /dev/data1/ackq     1189MB       0MB    1189MB   0%

/plz1            internal   /dev/data1/plz      3570MB       0MB    3570MB   0%

Disk encryption feature is disabled.

Disk object cache extend is disabled.

WAAS-674#sh disk tech-support

Controllers found: 1

----------------------------------------------------------------------

Controller information

----------------------------------------------------------------------

   Controller Status                   : Okay

   Channel description                 : SAS/SATA

   Controller Model                    : IBM ServeRAID 8k

   Controller Serial Number            : 4078D98

   Physical Slot                       : 0

   Installed memory                    : 256 MB

   Copyback                            : Disabled

   Data scrubbing                      : Disabled

   Defunct disk drive count            : 0

   Logical drives/Offline/Critical     : 1/0/0

   ---------------------------------------------------

   Controller Version Information

   ---------------------------------------------------

   BIOS                                : 5.2-0 (15427)

   Firmware                            : 5.2-0 (15427)

   Driver                              : 1.1-5 (24495)

   Boot Flash                          : 5.1-0 (15411)

   ---------------------------------------------------

   Controller Battery Information

   ---------------------------------------------------

   Status                              : Okay

   Over temperature                    : No

   Capacity remaining                  : 100 percent

   Time remaining (at current draw)    : 4 days, 22 hours, 40 minutes

   ---------------------------------------------------

   Controller Vital Product Data

   ---------------------------------------------------

   VPD Assigned#                       : 39R8875

   EC Version#                         : J85096

   Controller FRU#                     : 25R8076

   Battery FRU#                        : 25R8088

----------------------------------------------------------------------

Logical drive information

----------------------------------------------------------------------

Logical drive number 1

   Logical drive name                  : Drive 1

   RAID level                          : 5

   Status of logical drive             : Okay

   Size                                : 572000 MB

   Read-cache mode                     : Enabled

   Write-cache mode                    : Enabled (write-back)

   Write-cache setting                 : Enabled (write-back) when protected by battery

   Partitioned                         : Yes

   Number of chunks                    : 3

   Stripe-unit size                    : 256 KB

   Stripe order (Channel,Device)       : 0,0 0,1 0,2

   Bad stripes                         : No

----------------------------------------------------------------------

Physical Device information

----------------------------------------------------------------------

      Device #0

         Device is a Hard drive

         State                         : Online

         Supported                     : Yes

         Transfer Speed                : SAS 3.0 Gb/s

         Reported Channel,Device       : 0,0

         Vendor                        : IBM-ESXS

         Model                         : ST3300657SS

         Firmware                      : BA52

         Serial number                 : 3SJ0A7VA

         World-wide name               : 5000C5001CDEBAE4

         Size                          : 286102 MB

         Write Cache                   : Disabled (write-through)

         FRU                           : 42D0568

         PFA                           : No

      Device #1

         Device is a Hard drive

         State                         : Online

         Supported                     : Yes

         Transfer Speed                : SAS 3.0 Gb/s

         Reported Channel,Device       : 0,1

         Vendor                        : IBM-ESXS

         Model                         : ST3300657SS

         Firmware                      : BA52

         Serial number                 : 3SJ09XXZ

         World-wide name               : 5000C5001CDE98F4

         Size                          : 286102 MB

         Write Cache                   : Disabled (write-through)

         FRU                           : 42D0568

         PFA                           : No

      Device #2

         Device is a Hard drive

         State                         : Online

         Supported                     : Yes

         Transfer Speed                : SAS 3.0 Gb/s

         Reported Channel,Device       : 0,2

         Vendor                        : IBM-ESXS

         Model                         : ST3300657SS

         Firmware                      : BA52

         Serial number                 : 3SJ0A9QH

         World-wide name               : 5000C5001CDE1A8C

         Size                          : 286102 MB

         Write Cache                   : Disabled (write-through)

         FRU                           : 42D0568

         PFA                           : No

      Device #3

         Device is an Enclosure

            Reported Channel,Device    : 2,0

            Type                       : SES2

            Vendor                     : IBM-ESXS

            Model                      : VSC7160

            Firmware                   : 1.07

         Status of Enclosure

            Temperature status         : Normal

Command completed successfully.

WAAS-674#sh hard

Cisco Wide Area Application Services Software (WAAS)

Copyright (c) 1999-2010 by Cisco Systems, Inc.

Cisco Wide Area Application Services Software Release 4.3.1 (build b6 Nov 13 2010)

Version: oe674-4.3.1.6

Compiled 20:19:00 Nov 13 2010 by damaster

System was restarted on Fri Jul  8 13:46:37 2011.

The system has been up for 3 hours, 26 minutes, 38 seconds.

CPU 0 is GenuineIntel Intel(R) Xeon(R) CPU           E5335  @ 2.00GHz (rev 15) running at 1994MHz.

CPU 1 is GenuineIntel Intel(R) Xeon(R) CPU           E5335  @ 2.00GHz (rev 15) running at 1994MHz.

CPU 2 is GenuineIntel Intel(R) Xeon(R) CPU           E5335  @ 2.00GHz (rev 15) running at 1994MHz.

CPU 3 is GenuineIntel Intel(R) Xeon(R) CPU           E5335  @ 2.00GHz (rev 15) running at 1994MHz.

Total 4 CPUs.

8192 Mbytes of Physical memory.

128 MBytes of flash memory

1 CD ROM drive (Vendor MATSHITA Model UJDA782 DVD/CDRW)

2 GigabitEthernet interfaces

1 Console interface

Manufactured As: WAE-674-K9  [7979P5A]

BIOS Information:

Vendor         :IBM

Version        :-[GGEC34CUS-1.07]-

Rel. Date      :12/04/2007

Detailed Memory Device (DIMM) configuration

        Size  Locator

     2048 MB   DIMM 1

     2048 MB   DIMM 4

     2048 MB   DIMM 7

     2048 MB  DIMM 10

Thanks for your assistance.

T

3 Replies 3

Bhavin Yadav
Cisco Employee
Cisco Employee

Hi Tammy,

The only thing you need is - disk delete-data-partitions once the unit reboots after the memory upgrade. This command re-aligns the CIFS and DRE partition to match with 8GB memory. This command should retain the software and config on the device, only repartition the caching partitions. Not sure what may have went wrong but it seems like at this moment you may want to re-install image using copy ftp install command on WAE. Other than that, your disks look helthy.

Regards.

Hello All,

 

I'm getting the following message 

Error spawning process '/sw/merlot/bin/spen': Illegal seek
%Error in piping process. Quitting

 

008
ata1.00: cmd 60/20:00:00:00:00/00:00:00:00:00/40 tag 0 cdb 0x0 data 16384 in
res 41/40:20:01:00:00/5b:00:00:00:00/60 Emask 0x409 (media error) <F>
ata1.00: configured for UDMA/100
ata1: EH complete
sd 0:0:0:0: [sda] 976773168 512-byte hardware sectors (500108 MB)
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
ata1.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
ata1.00: irq_stat 0x40000008
ata1.00: cmd 60/20:00:00:00:00/00:00:00:00:00/40 tag 0 cdb 0x0 data 16384 in
res 41/40:20:01:00:00/5b:00:00:00:00/60 Emask 0x409 (media error) <F>
ata1.00: configured for UDMA/100
ata1: EH complete
sd 0:0:0:0: [sda] 976773168 512-byte hardware sectors (500108 MB)
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
ata1.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
ata1.00: irq_stat 0x40000008
ata1.00: cmd 60/20:00:00:00:00/00:00:00:00:00/40 tag 0 cdb 0x0 data 16384 in
res 41/40:20:01:00:00/5b:00:00:00:00/60 Emask 0x409 (media error) <F>
ata1.00: configured for UDMA/100
ata1: EH complete
sd 0:0:0:0: [sda] 976773168 512-byte hardware sectors (500108 MB)
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
ata1.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
ata1.00: irq_stat 0x40000008
ata1.00: cmd 60/20:00:00:00:00/00:00:00:00:00/40 tag 0 cdb 0x0 data 16384 in
res 41/40:20:01:00:00/5b:00:00:00:00/60 Emask 0x409 (media error) <F>
ata1.00: configured for UDMA/100
ata1: EH complete
sd 0:0:0:0: [sda] 976773168 512-byte hardware sectors (500108 MB)
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
ata1.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
ata1.00: irq_stat 0x40000008
ata1.00: cmd 60/20:00:00:00:00/00:00:00:00:00/40 tag 0 cdb 0x0 data 16384 in
res 41/40:20:01:00:00/5b:00:00:00:00/60 Emask 0x409 (media error) <F>
ata1.00: configured for UDMA/100
ata1: EH complete
sd 0:0:0:0: [sda] 976773168 512-byte hardware sectors (500108 MB)
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
ata1.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
ata1.00: irq_stat 0x40000008
ata1.00: cmd 60/20:00:00:00:00/00:00:00:00:00/40 tag 0 cdb 0x0 data 16384 in
res 41/40:20:01:00:00/5b:00:00:00:00/60 Emask 0x409 (media error) <F>
ata1.00: configured for UDMA/100
SCSI disk error : host 0 channel 0 id 0 lun 0 return code = 8000002
sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE,SUGGEST_OK
sd 0:0:0:0: [sda] Sense Key : Medium Error [current] [descriptor]
Descriptor sense data with sense descriptors (in hex):
72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
00 00 00 01
sd 0:0:0:0: [sda] Add. Sense: Unrecovered read error - auto reallocate failed
SCSI I/O error: POSSIBLE BAD DISK -- device 0x800, sector 1
end_request: I/O error, dev sda, sector 1
Buffer I/O error on device sda, logical block 0
Buffer I/O error on device sda, logical block 1
Buffer I/O error on device sda, logical block 2
Buffer I/O error on device sda, logical block 3
ata1: EH complete
sd 0:0:0:0: [sda] 976773168 512-byte hardware sectors (500108 MB)
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
ata1.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
ata1.00: irq_stat 0x40000008
ata1.00: cmd 60/08:00:00:00:00/00:00:00:00:00/40 tag 0 cdb 0x0 data 4096 in
res 41/40:08:01:00:00/5b:00:00:00:00/60 Emask 0x409 (media error) <F>
ata1.00: configured for UDMA/100
ata1: EH complete
sd 0:0:0:0: [sda] 976773168 512-byte hardware sectors (500108 MB)
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
ata1.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
ata1.00: irq_stat 0x40000008
ata1.00: cmd 60/08:00:00:00:00/00:00:00:00:00/40 tag 0 cdb 0x0 data 4096 in
res 41/40:08:01:00:00/5b:00:00:00:00/60 Emask 0x409 (media error) <F>
ata1.00: configured for UDMA/100
ata1: EH complete
sd 0:0:0:0: [sda] 976773168 512-byte hardware sectors (500108 MB)
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
ata1.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
ata1.00: irq_stat 0x40000008
ata1.00: cmd 60/08:00:00:00:00/00:00:00:00:00/40 tag 0 cdb 0x0 data 4096 in
res 41/40:08:01:00:00/5b:00:00:00:00/60 Emask 0x409 (media error) <F>
ata1.00: configured for UDMA/100
ata1: EH complete
sd 0:0:0:0: [sda] 976773168 512-byte hardware sectors (500108 MB)
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
ata1.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
ata1.00: irq_stat 0x40000008
ata1.00: cmd 60/08:00:00:00:00/00:00:00:00:00/40 tag 0 cdb 0x0 data 4096 in
res 41/40:08:01:00:00/5b:00:00:00:00/60 Emask 0x409 (media error) <F>
ata1.00: configured for UDMA/100
ata1: EH complete
sd 0:0:0:0: [sda] 976773168 512-byte hardware sectors (500108 MB)
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
ata1.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
ata1.00: irq_stat 0x40000008
ata1.00: cmd 60/08:00:00:00:00/00:00:00:00:00/40 tag 0 cdb 0x0 data 4096 in
res 41/40:08:01:00:00/5b:00:00:00:00/60 Emask 0x409 (media error) <F>
ata1.00: configured for UDMA/100
ata1: EH complete
sd 0:0:0:0: [sda] 976773168 512-byte hardware sectors (500108 MB)
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
ata1.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
ata1.00: irq_stat 0x40000008
ata1.00: cmd 60/08:00:00:00:00/00:00:00:00:00/40 tag 0 cdb 0x0 data 4096 in
res 41/40:08:01:00:00/5b:00:00:00:00/60 Emask 0x409 (media error) <F>
ata1.00: configured for UDMA/100
SCSI disk error : host 0 channel 0 id 0 lun 0 return code = 8000002
sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE,SUGGEST_OK
sd 0:0:0:0: [sda] Sense Key : Medium Error [current] [descriptor]
Descriptor sense data with sense descriptors (in hex):
72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
00 00 00 01
sd 0:0:0:0: [sda] Add. Sense: Unrecovered read error - auto reallocate failed
SCSI I/O error: POSSIBLE BAD DISK -- device 0x800, sector 1
end_request: I/O error, dev sda, sector 1
Buffer I/O error on device sda, logical block 0
ata1: EH complete
sd 0:0:0:0: [sda] 976773168 512-byte hardware sectors (500108 MB)
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
sd 0:0:0:0: [sda] Synchronizing SCSI cache
sd 0:0:0:0: [sda] Stopping disk
ata1.00: disabled
eth0 NIC Link is Up 100 Mbps Full Duplex, Flow Control: None
e1000e 0000:04:00.0: eth0: 10/100 speed: disabling TSO

------------------ Listening Servers -----------------
-Use 'sh stat netstat' to obtain full netstat listing-

Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name
tcp 0 0 0.0.0.0:23 0.0.0.0:* LISTEN 4458/inetd
udp 0 0 0.0.0.0:2048 0.0.0.0:* 4119/wccp
udp 0 0 0.0.0.0:514 0.0.0.0:* 2246/syslogd
udp 0 0 0.0.0.0:10000 0.0.0.0:* 4471/avahi-daemon:
udp 0 0 0.0.0.0:5787 0.0.0.0:* 4465/cmm
udp 0 0 0.0.0.0:5353 0.0.0.0:* 4471/avahi-daemon:
udp 0 0 127.0.0.1:123 0.0.0.0:* 4527/ntpd
udp 0 0 172.30.8.113:123 0.0.0.0:* 4527/ntpd
udp 0 0 0.0.0.0:123 0.0.0.0:* 4527/ntpd

-------- Disk health status (SMART) info ----------

=== disk00 ===
disk00: Not present or not responding
=== disk01 ===
disk01: Not present or not responding

------------ List of bad sectors on disk ----------


-------- Secure Store Status

Hi,

 

It looks as though your disks aren't working.

 

But what kind of WAE-/WAVE- device are we talking about here ?

And what type of harddisks are we talking about ?

 

When you cannot access the harddisk, the operating system (and WAAS) is not fully working.

You'll get all kind of strange errors when it cannot write to the disk.

 

Otherwise I would suggest a RMA of the entire device.

 

Best Regards

Finn

 

 

Getting Started

Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: