Buy or Renew
Buy or Renew
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
cancel
Start a conversation
1257
Views
0
Helpful
6
Replies

CDR records backlogged

Sascha Monteiro
Level 6
Level 6

‎09-07-2011 07:06 PM - edited ‎03-16-2019 06:53 AM

Hi,

A client's cucm is backlogging the sftp of the  CDR files to the configured billing server, first a day, and now it's 7  days behind!

We see it sftp'ing 1 file every minute, no  matter what backlog there is, there are 2 subs pushing cdr and cmr  files and the backlog gets bigger and bigger!

We see the files being send from sub to pub every minute, so that is all good

We have restarted the cdr agents on the subs and cdr repository manager on the pub, no luck

has anyone seen this odd behaviour?

Our app need the cdr files within 10 min, so we are really stuck here!

Labels:
0 Helpful
6 Replies 6

Jing Hua
Cisco Employee
Cisco Employee

‎09-11-2011 08:06 PM

Hi,

Would you mind to clarify the information below for me?

1. Where is the 'backlog' located?

2. Are you using separate SFTP server or your Billing server is also SFTP server?

3. Appliation name and Version of your SFTP server?

0 Helpful

Sascha Monteiro
Level 6
Level 6
In response to Jing Hua

‎09-11-2011 09:23 PM

Hi,

I am not sure where the backlog is, I think the files are in the processed folder, but I don't have access to the cucm

Our server hosts the sftp and billing software

The server is Linux CentOS so sftp is just going through the embedded ssh daemon

0 Helpful

Jing Hua
Cisco Employee
Cisco Employee
In response to Sascha Monteiro

‎09-11-2011 11:51 PM

where do you see the backlog getting bigger and bigger?

0 Helpful

Sascha Monteiro
Level 6
Level 6
In response to Jing Hua

‎09-11-2011 11:58 PM

the file that is sent is is now about 7 days old, 10 days ago the files that were sent were about a day old.

it looks like the cdr repository mgr only sends one file at a time, then sleeps till the next send

can cdrondemand be used as replacement for a configured billing server?

I have written an app that can retrieve the files via cdrondemand soap api

0 Helpful

Tapan Dutt
Cisco Employee
Cisco Employee

‎09-12-2011 12:15 AM

Hi

Can you get the debug level traces of CDR Repository Manager, catching the file delivery failure.

HTH

Tapan

0 Helpful

Sascha Monteiro
Level 6
Level 6
In response to Tapan Dutt

‎09-12-2011 12:38 AM

there are no errors, it's just sending files that are "old"

2011-09-08 11:22:16,430 DEBUG [Thread-7] sftpapi.ftpClient (ftpClient.java:577) - sessionLine = spawn sftp -o Port=22 -b /var/log/active/cm/trace/cdrrep/log4j/batchCmdscom.cisco.ccm.cdrdlv.sftpapi.ftpClient@120bf2c cdr@

.x.x.x

2011-09-08 11:22:16,430 DEBUG [Thread-7] sftpapi.ftpClient (ftpClient.java:577) - sessionLine = Connecting to 10

.x.x.x...

2011-09-08 11:22:16,430 DEBUG [Thread-7] sftpapi.ftpClient (ftpClient.java:577) - sessionLine = cdr@10.x.x.x's password:

2011-09-08 11:22:16,430 DEBUG [Thread-7] sftpapi.ftpClient (ftpClient.java:577) - sessionLine = sftp> put /common/log/cdr_repository/preserve/20110830/cmr_TGHOSCCM1-Cluster_02_201108301412_918659 /home/cdr/cdr_in/cmr_TGHOSCCM1-Cluster_02_201108301412_918659

2011-09-08 11:22:16,430 DEBUG [Thread-7] sftpapi.ftpClient (ftpClient.java:577) - sessionLine = Uploading /common/log/cdr_repository/preserve/20110830/cmr_TGHOSCCM1-Cluster_02_201108301412_918659 to /home/cdr/cdr_in/cmr_TGHOSCCM1-Cluster_02_201108301412_918659

2011-09-08 11:22:16,430 DEBUG [Thread-7] sftpapi.ftpClient (ftpClient.java:577) - sessionLine = sftp> chmod 666 /home/cdr/cdr_in/cmr_TGHOSCCM1-Cluster_02_201108301412_918659

2011-09-08 11:22:16,430 DEBUG [Thread-7] sftpapi.ftpClient (ftpClient.java:577) - sessionLine = Changing mode on /home/cdr/cdr_in/cmr_TGHOSCCM1-Cluster_02_201108301412_918659

2011-09-08 11:22:16,430 DEBUG [Thread-7] sftpapi.ftpClient (ftpClient.java:577) - sessionLine = sftp> quitscript result:

2011-09-08 11:22:16,431 DEBUG [Thread-7] sftpapi.ftpClient (ftpClient.java:577) - sessionLine = 0

2011-09-08 11:22:16,431 INFO  [Thread-7] cdrrep.FtpManager (FtpManager.java:116) - sent cmr_TGHOSCCM1-Cluster_02_201108301412_918659 to 10.5.1.11 successfully

2011-09-08 11:22:16,431 DEBUG [Thread-7] sftpapi.ftpClient (ftpClient.java:670) - removeSftpControlFiles(): <-->

2011-09-08 11:22:16,431 DEBUG [Thread-7] sftpapi.ftpClient (ftpClient.java:674) - removeSftpControlFiles(): -->, where suffix=null

2011-09-08 11:22:16,431 DEBUG [Thread-7] sftpapi.ftpClient (ftpClient.java:687) - removeSftpControlFiles(): suffix=null

2011-09-08 11:22:16,431 DEBUG [Thread-7] sftpapi.ftpClient (ftpClient.java:692) - batch file deleted: /var/log/active/cm/trace/cdrrep/log4j/batchCmdscom.cisco.ccm.cdrdlv.sftpapi.ftpClient@120bf2c

2011-09-08 11:22:16,432 DEBUG [Thread-7] sftpapi.ftpClient (ftpClient.java:699) - log file deleted: /var/log/active/cm/trace/cdrrep/log4j/sessionLogcom.cisco.ccm.cdrdlv.sftpapi.ftpClient@120bf2c

2011-09-08 11:22:16,432 INFO  [Thread-7] cdrrep.FtpManager (FtpManager.java:153) - FTP success: cmr_TGHOSCCM1-Cluster_02_201108301412_918659 to 10.x.x.x

2011-09-08 11:22:16,432 DEBUG [Thread-7] cdrrep.FtpManager (FtpManager.java:157) - sendFile(): isLastSendingSuccess=true

2011-09-08 11:22:16,432 DEBUG [Thread-7] cdrrep.FtpManager (FtpManager.java:158) - sendFile(): <--

2011-09-08 11:22:16,432 DEBUG [Thread-7] cdrrep.CDRSender (CDRSender.java:328) - cdr file sent OKAY

2011-09-08 11:22:16,432 DEBUG [Thread-7] cdrrep.Util (Util.java:102) - checkJVMFreeMemory(): -->

2011-09-08 11:22:16,433 DEBUG [Thread-7] cdrrep.Util (Util.java:158) - checkJVMFreeMemory(): <--

2011-09-08 11:22:16,433 INFO  [Thread-7] cdrrep.CDRSender (CDRSender.java:331) - CDRREP after sending the file: JVM status: [Max = 246.56MB, Total = 6.19MB, Free = 1.92MB (30.97%), Used = 4.27MB (69.03%)]

2011-09-08 11:22:16,433 DEBUG [Thread-7] cdrrep.CDRSender (CDRSender.java:382) - /common/log/cdr_repository/preserve/20110830/cmr_TGHOSCCM1-Cluster_02_201108301412_918659 has been sent out

2011-09-08 11:22:16,433 DEBUG [Thread-7] cdrrep.CDRSender (CDRSender.java:384) - removing link: /var/log/active/cm/cdr_repository/destination1/20110830/cmr_TGHOSCCM1-Cluster_02_201108301412_918659

2011-09-08 11:22:16,434 DEBUG [Thread-7] cdrrep.LinkCareTaker (LinkCareTaker.java:143) - file under preserve is /common/log/cdr_repository/preserve/20110830/cmr_TGHOSCCM1-Cluster_02_201108301412_918659

2011-09-08 11:22:16,434 DEBUG [Thread-7] cdrrep.LinkCareTaker (LinkCareTaker.java:180) - got lock

2011-09-08 11:22:16,434 DEBUG [Thread-7] cdrrep.LinkCareTaker (LinkCareTaker.java:188) - after locking...

2011-09-08 11:22:16,434 DEBUG [Thread-7] cdrrep.LinkCareTaker (LinkCareTaker.java:194) - removing link: /var/log/active/cm/cdr_repository/destination1/20110830/cmr_TGHOSCCM1-Cluster_02_201108301412_918659

2011-09-08 11:22:16,435 DEBUG [Thread-7] cdrrep.LinkCareTaker (LinkCareTaker.java:202) - deleted link /var/log/active/cm/cdr_repository/destination1/20110830/cmr_TGHOSCCM1-Cluster_02_201108301412_918659

2011-09-08 11:22:16,435 DEBUG [Thread-7] cdrrep.LinkCareTaker (LinkCareTaker.java:209) - link removed: /var/log/active/cm/cdr_repository/destination1/20110830/cmr_TGHOSCCM1-Cluster_02_201108301412_918659

2011-09-08 11:22:16,435 DEBUG [Thread-7] cdrrep.LinkCareTaker (LinkCareTaker.java:217) - parent folder of the link is 20110830

2011-09-08 11:22:16,435 DEBUG [Thread-7] cdrrep.LinkCareTaker (LinkCareTaker.java:243) - checking link /var/log/active/cm/cdr_repository/destination1/20110830/cmr_TGHOSCCM1-Cluster_02_201108301412_918659

2011-09-08 11:22:16,435 DEBUG [Thread-7] cdrrep.LinkCareTaker (LinkCareTaker.java:251) - no link /var/log/active/cm/cdr_repository/destination1/20110830/cmr_TGHOSCCM1-Cluster_02_201108301412_918659

2011-09-08 11:22:16,435 DEBUG [Thread-7] cdrrep.LinkCareTaker (LinkCareTaker.java:243) - checking link /var/log/active/cm/cdr_repository/destination2/20110830/cmr_TGHOSCCM1-Cluster_02_201108301412_918659

2011-09-08 11:22:16,435 DEBUG [Thread-7] cdrrep.LinkCareTaker (LinkCareTaker.java:251) - no link /var/log/active/cm/cdr_repository/destination2/20110830/cmr_TGHOSCCM1-Cluster_02_201108301412_918659

2011-09-08 11:22:16,435 DEBUG [Thread-7] cdrrep.LinkCareTaker (LinkCareTaker.java:243) - checking link /var/log/active/cm/cdr_repository/destination3/20110830/cmr_TGHOSCCM1-Cluster_02_201108301412_918659

2011-09-08 11:22:16,436 DEBUG [Thread-7] cdrrep.LinkCareTaker (LinkCareTaker.java:251) - no link /var/log/active/cm/cdr_repository/destination3/20110830/cmr_TGHOSCCM1-Cluster_02_201108301412_918659

2011-09-08 11:22:16,436 DEBUG [Thread-7] cdrrep.LinkCareTaker (LinkCareTaker.java:243) - checking link /var/log/active/cm/cdr_repository/car/20110830/cmr_TGHOSCCM1-Cluster_02_201108301412_918659

2011-09-08 11:22:16,436 DEBUG [Thread-7] cdrrep.LinkCareTaker (LinkCareTaker.java:251) - no link /var/log/active/cm/cdr_repository/car/20110830/cmr_TGHOSCCM1-Cluster_02_201108301412_918659

2011-09-08 11:22:16,437 DEBUG [Thread-7] cdrrep.LinkCareTaker (LinkCareTaker.java:286) - moved file /common/log/cdr_repository/preserve/20110830/cmr_TGHOSCCM1-Cluster_02_201108301412_918659 to /var/log/active/cm/cdr_repository/processed/20110830/cmr_TGHOSCCM1-Cluster_02_201108301412_918659

0 Helpful
Customers Also Viewed These Support Documents