CUCM upgrade from 11.0.1 to 11.5.1 fails

stuartbedale · ‎03-20-2019

Trying to upgrade a 2 node cluster from

Existing 11.0.1.22900-14 - 11.0(1a)SU2
to
Upgrade 11.5.1.15900-18 = 11.5(1)SU5

Should be a one-step upgrade, no COP files are needed, replication is good, NTP is good, Utils diagnose test only complains about the number of Tomcat sessions, all the rest is good. Have recent reloads, so uptime should not be an issue.

Looks like they have tried twice

02/27/2019 12:31:32 | root: Upgrade 11.5.1.15900-18 Start
02/27/2019 14:51:09 | root: Upgrade 11.5.1.15900-18 Failure
..
03/01/2019 11:40:13 | root: Upgrade 11.5.1.15900-18 Start
03/01/2019 14:04:10 | root: Upgrade 11.5.1.15900-18 Failure

Hardware is
UCS-C – BE7K, so that is OK.

Looks like the issue is with the DB in the installlog (see attached)

03/01/2019 14:04:08 component_install|(CAPTURE) installdb Failure [-i] 1|<LVL::Debug>
03/01/2019 14:04:08 component_install|(CAPTURE) -----------------------------------|<LVL::Debug>
03/01/2019 14:04:08 component_install|(CAPTURE) installdb_l2.log.err file contents:|<LVL::Debug>
03/01/2019 14:04:08 component_install|(CAPTURE) 13:40:13.166 | enterprise_parameter::updateEnterpriseParameterUseSSOforRTMT *ERROR* Error -11031, Error fetching numeric attribute: [Informix][Informix ODBC Driver]Invalid cursor state.|<LVL::Debug>
03/01/2019 14:04:08 component_install|(CAPTURE) 13:56:15.509 | updateStatisticsAUS *ERROR* updateStatisticsAUS 1|<LVL::Debug>
03/01/2019 14:04:08 component_install|(CAPTURE) 13:56:15.509 | installFull *ERROR* Prior Cancel or Error Processing updateStatisticsAUS(DSN=<REMOVED>;Servername=<REMOVED>_ccm11_5_1_15900_18;RECVTIMEOUT=1800)|<LVL::Debug>
03/01/2019 14:04:08 component_install|(CAPTURE) |<LVL::Debug>
03/01/2019 14:04:08 component_install|(CAPTURE) |<LVL::Debug>

There seems to be plenty of disk space

03/01/2019 11:42:03 upgrade_manager.sh|(CAPTURE) Free space: 69033114959, Needed space: 23001195049|<LVL::Debug>

Any suggestions gratefully received?

Jaime Valencia · ‎03-20-2019

Try the pre-upgrade cop file for CUCM 12.5, it has a few checks for DB that might cause upgrades to fail.

HTH

java

if this helps, please rate

tgaur · ‎03-25-2019

hi,

yes run the pre upgrade cop file and also if dont find anything collect the install and upgrade logs from rtmt + install db logs from the cli follow commands :

activelog cm/trace/dbl/sdi/*

regards.

netthelle · ‎07-05-2019

Did you resolve you issue ?

I've the same problem for CUCM & CUC from version 10.5.2.12901-1 to 12.0.1.22900-11 :

07/03/2019 16:07:47 component_install|(CAPTURE) installdb Failure [-i] 1|<LVL::Debug>
07/03/2019 16:07:47 component_install|(CAPTURE) -----------------------------------|<LVL::Debug>
07/03/2019 16:07:47 component_install|(CAPTURE) installdb_l2.log.err file contents:|<LVL::Debug>
07/03/2019 16:07:47 component_install|(CAPTURE) 15:47:35.742 | enterprise_parameter::updateEnterpriseParameterUseSSOforRTMT *ERROR* Error -11031, Error fetching numeric attribute: [Informix][Informix ODBC Driver]Invalid cursor state.|<LVL::Debug>
07/03/2019 16:07:47 component_install|(CAPTURE) 16:02:30.199 | updateStatisticsAUS *ERROR* updateStatisticsAUS 1|<LVL::Debug>
07/03/2019 16:07:47 component_install|(CAPTURE) 16:02:30.199 | installFull *ERROR* Prior Cancel or Error Processing updateStatisticsAUS(DSN=ccm_super;Servername=hms_cmanager_ccm12_0_1_22900_11;RECVTIMEOUT=1800)|<LVL::Debug>
07/03/2019 16:07:47 component_install|(CAPTURE) 16:07:31.855 | updateStatisticsAUS *ERROR* updateStatisticsAUS 1|<LVL::Debug>
07/03/2019 16:07:47 component_install|(CAPTURE) 16:07:31.855 | installFull *ERROR* Prior Cancel or Error Processing updateStatisticsAUS(DSN=ccm_super;Servername=hms_cmanager_ccm12_0_1_22900_11;RECVTIMEOUT=1800)|<LVL::Debug>
07/03/2019 16:07:47 component_install|(CAPTURE) |<LVL::Debug>
07/03/2019 16:07:47 component_install|(CAPTURE) |<LVL::Debug>

regards,

bart-peters · ‎07-12-2019

This problem occurs if database changes are made during the upgrade job. Our upgrade (from 10.5 to 11.5) failed time and time again until we stopped a AXL SOAP sync that was update translation patterns in CUCM all the time. The first time we tried we only got the one error mentioned here but all other times we had an extra error what gave us the hint. See below for part of the upgrade log.

07/08/2019 15:30:49 component_install|(CAPTURE) installdb Failure [-i] 1|<LVL::Debug>
07/08/2019 15:30:49 component_install|(CAPTURE) -----------------------------------|<LVL::Debug>
07/08/2019 15:30:49 component_install|(CAPTURE) installdb_l2.log.err file contents:|<LVL::Debug>
07/08/2019 15:30:49 component_install|(CAPTURE) 15:06:34.932 | DBUtil::DoSQLCommand ### *ERROR* ###: SQL Exception detected while Enabling Target Table Constraints [Error executing "SET CONSTRAINTS FOR numplandynamic ENABLED": [Informix][Informix ODBC Driver][Informix]Integrity violations detected. sqlerrm(assign)]|<LVL::Debug>
07/08/2019 15:30:49 component_install|(CAPTURE) 15:06:34.932 | DBUtil::BlockCopyTable ### *ERROR* ###: SQL Exception Detected: ErrorCode=-971 , SQLState=HY000|<LVL::Debug>
07/08/2019 15:30:49 component_install|(CAPTURE) 15:06:34.932 | DBUtil::BlockCopyTable ### *ERROR* ###: (diagnosis): Bulk Data Migration for table numplandynamic failed due to data constraint issue, (-971).|<LVL::Debug>
07/08/2019 15:30:49 component_install|(CAPTURE) 15:06:35.210 | DBUtil::BlockCopyTable *ERROR* Violation of the REFERENTIAL constraint fk_numplandynamic_fknumplan on the numplandynamic table by the record with pkid = 205f64ba-9408-404d-a396-f7be281c04ec. Referenced numplan record must exist (fknumplan).|<LVL::Debug>
07/08/2019 15:30:49 component_install|(CAPTURE) 15:07:04.751 |*ERROR* Error fetching column information: [Informix][Informix ODBC Driver][Informix]Could not position within a table (informix.systables).|<LVL::Debug>

---

07/08/2019 15:30:49 component_install|(CAPTURE) 04.898 | DataConverter_5to6::CopyTables *ERROR* BlockCopyTable failed to process table (numplandynamic)|<LVL::Debug>
07/08/2019 15:30:49 component_install|(CAPTURE) 15:07:33.155 | enterprise_parameter::updateEnterpriseParameterUseSSOforRTMT *ERROR* Error -11031, Error fetching numeric attribute: [Informix][Informix ODBC Driver]Invalid cursor state.|<LVL::Debug>
07/08/2019 15:30:49 component_install|(CAPTURE) 15:07:33.169 | DataConverter_common::fixSRTPCipherSelection *ERROR* Error -11071, Error executing "": [Informix][Informix ODBC Driver]Invalid string or buffer length.|<LVL::Debug>
07/08/2019 15:30:49 component_install|(CAPTURE) 15:08:11.581 | installFull *ERROR* Prior Cancel or Error Processing convert5to6()|<LVL::Debug>
07/08/2019 15:30:49 component_install|(CAPTURE) 15:23:18.307 | updateStatisticsAUS *ERROR* updateStatisticsAUS 1|<LVL::Debug>
07/08/2019 15:30:49 component_install|(CAPTURE) 15:23:18.307 | installFull *ERROR* Prior Cancel or Error Processing updateStatisticsAUS(DSN=ccm_super;Servername=prdcucm001_ccm11_5_1_16089_2;RECVTIMEOUT=1800)|<LVL::Debug>