Re: CDR data export to Billing Server issue

jessakhanian · ‎08-02-2010

Hello,

We are having issues exporting the CDR files to a Billing Application server from the Publisher call manager (version 7.1.5) with four servers in the cluster. We have configured the CDR Management Billing Application Server Parameters properly. We confirmed network/SFTP connectivity by backing up the CCM database (using DRF) to that Billing server and the same credentials, so we know the servers can talk to each other. However, we do not see any CDR files being copied over the SFTP root directory. All servers in the clustomer are set to "Enable CDR = Yes", and all services that should be running are active. The CDR load interval is set at 5 minutes.

Any ideas as to what we may have missed?

Thanks.

J

htluo · ‎08-02-2010

Could you upload "CDR Repository Manager" logs here?

Thanks!

Michael

http://htluo.blogspot.com

jessakhanian · ‎08-02-2010

Hello Michael,

I increased the CDR Repository Manager Trace level to "Debug" and collected the log file from the Publisher. It's attached to this post. I read through the log file and couldn't see anything descriptive, but hopefully it will make more sense to you.

Also, we program the CDR Management only on the Publisher, correct? AFAIK, all CDR data is copied over from all the nodes to the publisher, so there is no need to configure each node individually. Please let me know if that sounds right.

Thanks.

Joseph

Message was edited by: jessakhanian Didn't see the attachment.

htluo · ‎08-02-2010

Could you get the screen output of the following commands from CUCM publisher?

file list activelog cm/cdr_repository/destination1

file list activelog cm/cdr_repository/destination1/20100802

file list activelog cm/cdr_repository/destination1/20100801

Thanks!

Michael

jessakhanian · ‎08-02-2010

Here it is. It doesn't look like there is anything in the subdirectories:

admin:file list activelog cm/cdr_repository/destination1

   20100703
   20100704
   20100705
   20100706
   20100707
   20100708
   20100709
   20100710
   20100711
   20100712
   20100713
   20100714
   20100715
   20100716
   20100717
   20100718
   20100719
   20100720
   20100721
   20100722
   20100723
   20100724
   20100725
   20100726
   20100727
   20100728
   20100729
   20100730
   20100731
   20100801
   20100802
   20100803
dir count = 32, file count = 0
admin:
admin:
admin:
admin:
admin:file list activelog cm/cdr_repository/destination1/20100801
dir count = 0, file count = 0
admin:
admin:
admin:file list activelog cm/cdr_repository/destination1/20100802
dir count = 0, file count = 0
admin:
admin:
admin:file list activelog cm/cdr_repository/destination1/20100803
dir count = 0, file count = 0
admin:
admin:file list activelog cm/cdr_repository/destination1/20100804
dir count = 0, file count = 0
admin:
admin:

htluo · ‎08-02-2010

It looks like you don't have any CDR files on the detination1 folder. That's why you don't have any files transferred to billing server.

Run the commands below to see if you have any CDR files generated at all:

file list activelog cm/cdr_repository/preserve/20100803

file list activelog cm/cdr_repository/preserve/20100802

file list activelog cm/cdr_repository/preserve/20100801

Michael

http://htluo.blogspot.com

jessakhanian · ‎08-03-2010

Yes, I see files in the 20100803 folder, but nothing previous to that. We have been collecting CDR from when the servers were installed (in Early July), although we just went into production last weekend. I still don't see anything copied over to the Billing Server, however. Here is a snapshot of the commands you asked for. Thanks for all your help.

admin:
admin:
admin:file list activelog cm/cdr_repository/preserve/20100801
dir count = 0, file count = 0
admin:
admin:
admin:file list activelog cm/cdr_repository/preserve/20100802
dir count = 0, file count = 0
admin:
admin:
admin:
admin:file list activelog cm/cdr_repository/preserve/20100803
cdr_CCM01-Cluster_01_201008031456_3     cdr_CCM01-Cluster_01_201008031500_4
cdr_CCM01-Cluster_02_201008030540_10    cdr_CCM01-Cluster_02_201008030544_11
cdr_CCM01-Cluster_02_201008030646_12    cdr_CCM01-Cluster_02_201008030820_13
cdr_CCM01-Cluster_02_201008030852_14    cdr_CCM01-Cluster_02_201008030900_15
cdr_CCM01-Cluster_02_201008030902_16    cdr_CCM01-Cluster_02_201008030904_17
cdr_CCM01-Cluster_02_201008030910_18    cdr_CCM01-Cluster_02_201008030912_19
cdr_CCM01-Cluster_02_201008030914_20    cdr_CCM01-Cluster_02_201008030918_21

....... Ommited .................

cdr_CCM01-Cluster_04_201008031531_60    cdr_CCM01-Cluster_04_201008031533_61
cdr_CCM01-Cluster_04_201008031535_62    cdr_CCM01-Cluster_04_201008031537_63
cdr_CCM01-Cluster_04_201008031539_64    cdr_CCM01-Cluster_04_201008031543_65
cdr_CCM01-Cluster_04_201008031545_66    cdr_CCM01-Cluster_04_201008031547_67
cdr_CCM01-Cluster_04_201008031549_68    cdr_CCM01-Cluster_04_201008031553_69
cdr_CCM01-Cluster_04_201008031555_70    cdr_CCM01-Cluster_04_201008031557_71
cdr_CCM01-Cluster_04_201008031603_72
dir count = 0, file count = 295
admin:
admin:
admin:
admin:

htluo · ‎08-03-2010

If you have CDR files on 20100803, please restart CDR Repository Manager and get logs from the time of restart.

Thanks!

Michael

jessakhanian · ‎08-03-2010

After I posted my previous message, I logged on to the Billing server and restarted the SFTP application, and boom, all the files in that folder were copied over to the root directory. We have over 300 since the time interval was set to 2. I just increased it to 60 for testing, and it will be changed to 720 later on so that we get the file twice a day.

Looks like once the files are copied over, they are deleted from the call manager. Is this normal/default behaviour? Can we change it so that those files stay on the server (at least for a while) just in case? I realize there could be HDD space implications, so that may be why. Also, we have no idea where the files for the previous day's folder have gone as we just added the Billing server yesterday. I don't think this will be too big of an issue for our customer since they just went live yesterday, so worse case scenario, we only lose 1 day's worth of data.

Thanks.

Joseph

htluo · ‎08-03-2010

It depends where you looked at.

The original place for CDR file was in the "preserve" folder. Once they are processed by CDR Loader (loaded into database), those files will be moved to "processed" folder.

For external billing servers, CDR files were copied from "preserve" folder to "destination" folder. Then moved from "destination" folder to SFTP server.

Michael

http://htluo.blogspot.com

jessakhanian · ‎08-03-2010

Perfect. I still see the older CDR files in the "processed" folder. I'm certain these are overwritten on the backend (the oldest) once a certain threshold is reached. Can we copy the older files that we didn't get (I see quite a few files for the previous days in the "processed/" folder) from the processsed sub-folders into the Billing server? I think the way to do it would be to copy them from their current folder to the "Destination1/" subfolder and have it SFTP'd over, but if there is a better way around it, please let me know.

Thanks.

Joseph

htluo · ‎08-03-2010

You may use command:

file get activelog cm/cdr_repository/processed/20100803/*

Repeat that for each folder you like to copy.

Or if you like to copy everything in "processed" folder, use command:

file get activelog cm/cdr_repository/processed/* recurs

Michael

http://htluo.blogspot.com

jessakhanian · ‎08-03-2010

Thanks Mike for all your help. It's appreciated. 5 stars for you.