10-20-2010 01:35 PM - edited 03-19-2019 01:46 AM
Guys,
I am experiencing an issue on the CUCM 5.1.3. Cmoninit is reaching 90% of utilization alone.
We tried to kill the process and reload the box, but, in few minutes the cmoninit processes get on the top again.
Do you know how to solve this issue?
Luiz Bianchini
10-21-2010 07:49 AM
Hello Luiz
cmoninit is the database process in the CUCM.
Usually when the cmoninit process is taking so much CPU and resources is related to another process making use of the database.
(It could be something wrong in the DB as well, but usually is another service using the DB).
- The fact that after reboot is also happening i would say then means that it is either some task still pending to be processed (BAT task, Backup, ...)
After the reboot how long it takes till you see the high CPU? Is it inmediate?
- Do you have any external server that access the CUCM via AXL/SOAP interface?
- How many servers do you have in the cluster?
Do you know if the replication is good in the cluster?
-Take Database Layer Monitor and Informix logs, we have to identify first what the database is doing, and eventually which process asked the database to do that.
Thanks
Fernando
10-21-2010 04:04 PM
Hey Luiz,
This is Sriram - we talked on the phone today to resolve this issue.
Just to close this thread out, we found that this is a known defect :
the root cause is that CAR Scheduler goes into a loop trying to create a fragment with servers running the DST in South American time zone
Snippet of CAR Scheduler loop :
-------------------------------
2010-10-20 16:18:55,527 DEBUG [DailyCdrLoad] services.FragmentManager - createTblPartition(): -->
2010-10-20 16:18:55,528 DEBUG [DailyCdrLoad] services.FragmentManager - createTblPartition(): Creating BillingTable Partition
2010-10-20 16:18:55,537 DEBUG [DailyCdrLoad] services.FragmentManager - createTblPartition(): The Partition part_20101009 is already present
2010-10-20 16:18:55,538 DEBUG [DailyCdrLoad] services.FragmentManager - createTblPartition(): Run [UPDATE STATISTICS FOR PROCEDURE]
2010-10-20 16:18:55,977 DEBUG [DailyCdrLoad] services.FragmentManager - createTblPartition(): Creating ErrorTablePartition
2010-10-20 16:18:55,982 DEBUG [DailyCdrLoad] services.FragmentManager - createTblPartition(): The Partition part_20101009 is already present
2010-10-20 16:18:55,983 DEBUG [DailyCdrLoad] services.FragmentManager - createTblPartition(): Run [UPDATE STATISTICS FOR PROCEDURE]
2010-10-20 16:18:56,768 DEBUG [DailyCdrLoad] services.FragmentManager - createTblPartition(): <--
These constant fragment creation attempts on the database results in the database service (cmoninit) spike.
Stopping CAR Scheduler network service on the Pub will reduce the CPU spike.
upgrading to an 5.1.3 ES will fix the issue.
- Sriram
Can not view this . file attachment inline, please click on the following link to view the attachment.
http://cdetsweb-prd.cisco.com/apps/dumpcr_att?identifier=CSCsv47100&title=Diffs--cc_6_x_mainline&ext=&type=FILE
Can not view this . file attachment inline, please click on the following link to view the attachment.
http://
Can not view this . file attachment inline, please click on the following link to view the attachment.
http://cdetsweb-prd.cisco.com/apps/dumpcr_att?identifier=CSCsv47100&title=Diffs--cc_7_0_x_mainline&ext=&type=FILE
Can not view this . file attachment inline, please click on the following link to view the attachment.
http://
Can not view this . file attachment inline, please click on the following link to view the attachment.
http://cdetsweb-prd.cisco.com/apps/dumpcr_att?identifier=CSCsv47100&title=Diffs--cc_mainline&ext=&type=FILE
Can not view this . file attachment inline, please click on the following link to view the attachment.
http://
Can not view this . file attachment inline, please click on the following link to view the attachment.
http://cdetsweb-prd.cisco.com/apps/dumpcr_att?identifier=CSCsv47100&title=Diffs--cm_5_1_3&ext=&type=FILE
Can not view this . file attachment inline, please click on the following link to view the attachment.
http://
Can not view this . file attachment inline, please click on the following link to view the attachment.
http://cdetsweb-prd.cisco.com/apps/dumpcr_att?identifier=CSCsv47100&title=Diffs--cm_6_0_1&ext=&type=FILE
Can not view this . file attachment inline, please click on the following link to view the attachment.
http://
Can not view this . file attachment inline, please click on the following link to view the attachment.
http://cdetsweb-prd.cisco.com/apps/dumpcr_att?identifier=CSCsv47100&title=Diffs--cm_6_1_2&ext=&type=FILE
Can not view this . file attachment inline, please click on the following link to view the attachment.
http://
Can not view this . file attachment inline, please click on the following link to view the attachment.
http://cdetsweb-prd.cisco.com/apps/dumpcr_att?identifier=CSCsv47100&title=Diffs--cm_6_1_3&ext=&type=FILE
Can not view this . file attachment inline, please click on the following link to view the attachment.
http://
Can not view this .java file attachment inline, please click on the following link to view the attachment.
http://cdetsweb-prd.cisco.com/apps/dumpcr_att?identifier=CSCsv47100&title=PartCal2&ext=java&type=FILE
Can not view this .java file attachment inline, please click on the following link to view the attachment.
http://
Can not view this .out file attachment inline, please click on the following link to view the attachment.
http://cdetsweb-prd.cisco.com/apps/dumpcr_att?identifier=CSCsv47100&title=PartCal2_SR-609748743&ext=out&type=FILE
Can not view this .out file attachment inline, please click on the following link to view the attachment.
http://
Can not view this .out file attachment inline, please click on the following link to view the attachment.
http://cdetsweb-prd.cisco.com/apps/dumpcr_att?identifier=CSCsv47100&title=PartCal2_SR-609748743(afterpatch)&ext=out&type=FILE
Can not view this .out file attachment inline, please click on the following link to view the attachment.
http://
Can not view this .out file attachment inline, please click on the following link to view the attachment.
http://cdetsweb-prd.cisco.com/apps/dumpcr_att?identifier=CSCsv47100&title=PartCal2_SR-609787027&ext=out&type=FILE
Can not view this .out file attachment inline, please click on the following link to view the attachment.
http://
Can not view this .out file attachment inline, please click on the following link to view the attachment.
http://cdetsweb-prd.cisco.com/apps/dumpcr_att?identifier=CSCsv47100&title=PartCal2noset&ext=out&type=FILE
Can not view this .out file attachment inline, please click on the following link to view the attachment.
http://
Can not view this .out file attachment inline, please click on the following link to view the attachment.
http://cdetsweb-prd.cisco.com/apps/dumpcr_att?identifier=CSCsv47100&title=PartCal2set&ext=out&type=FILE
Can not view this .out file attachment inline, please click on the following link to view the attachment.
http://
Can not view this .txt file attachment inline, please click on the following link to view the attachment.
http://cdetsweb-prd.cisco.com/apps/dumpcr_att?identifier=CSCsv47100&title=RE SR 609748743 CAR 5.1.3.3000-5 error 10012 Database Error. Contact System Administrator&ext=txt&type=FILE
Can not view this .txt file attachment inline, please click on the following link to view the attachment.
http://
Can not view this .txt file attachment inline, please click on the following link to view the attachment.
http://cdetsweb-prd.cisco.com/apps/dumpcr_att?identifier=CSCsv47100&title=Re Java 1.4.2_15 (1.4.2_15-b02) issue on Calendar class&ext=txt&type=FILE
Can not view this .txt file attachment inline, please click on the following link to view the attachment.
http://
Can not view this .txt file attachment inline, please click on the following link to view the attachment.
http://cdetsweb-prd.cisco.com/apps/dumpcr_att?identifier=CSCsv47100&title=Re S1 609787027 - Bank Matone - CDR Failure - Can get CDRs records up to October 1 records after that get error 10021 There are no matching records&ext=txt&type=FILE
Can not view this .txt file attachment inline, please click on the following link to view the attachment.
http://
Can not view this . file attachment inline, please click on the following link to view the attachment.
http://cdetsweb-prd.cisco.com/apps/dumpcr_att?identifier=CSCsv47100&title=car-code-review&ext=&type=FILE
Can not view this . file attachment inline, please click on the following link to view the attachment.
http://
Can not view this . file attachment inline, please click on the following link to view the attachment.
http://cdetsweb-prd.cisco.com/apps/dumpcr_att?identifier=CSCsv47100&title=unit-test-cm_5_1_3&ext=&type=FILE
Can not view this . file attachment inline, please click on the following link to view the attachment.
http://
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide