Re: Job status changed to 512

mwezesa01 · ‎12-12-2013

I am trying to diagnose a failed SFTP upload that occured in a recent job, in looking at the tidal job log on the client that the file upload was originating from I see the following:

_20131206 01:10:06 <inf.TIDAL_AGENT_1.ES_TIDALDB01_1> Received Service request, 541541

_20131206 01:10:06 <inf.wul05 COPY_SALESROSTER_OUTBOUND_FILE_TO_INTRAMED.541541.System Command.TIDAL_AGENT_1.ES_TIDALDB01_1> Job 541541, processid 4196

_20131206 01:10:07 <inf.wul05 COPY_SALESROSTER_OUTBOUND_FILE_TO_INTRAMED.541541.System Command.TIDAL_AGENT_1.ES_TIDALDB01_1> Posting Status Update; status 2

_20131206 01:10:09 <inf.wul05 COPY_SALESROSTER_OUTBOUND_FILE_TO_INTRAMED.541541.System Command.TIDAL_AGENT_1.ES_TIDALDB01_1> Item 541541 status changed to 2

_20131206 01:10:09 <inf.wul05 COPY_SALESROSTER_OUTBOUND_FILE_TO_INTRAMED.541541.System Command.TIDAL_AGENT_1.ES_TIDALDB01_1> Job item 541541 activated

_20131206 01:10:18 <inf.wul05 COPY_SALESROSTER_OUTBOUND_FILE_TO_INTRAMED.541541.System Command.TIDAL_AGENT_1.ES_TIDALDB01_1> Posting Status Update; status 4

_20131206 01:10:19 <inf.wul05 COPY_SALESROSTER_OUTBOUND_FILE_TO_INTRAMED.541541.System Command.TIDAL_AGENT_1.ES_TIDALDB01_1> Item 541541 status changed to 512

The log then moves on to the next Job request. About an hour or so later the same job ID 541541 pops up and completes successfully:

_20131206 02:26:51 <inf.TIDAL_AGENT_1.ES_TIDALDB01_1> Received Service request, 541541

_20131206 02:26:51 <inf.wul05 COPY_SALESROSTER_OUTBOUND_FILE_TO_INTRAMED.541541.System Command.TIDAL_AGENT_1.ES_TIDALDB01_1> Job 541541, processid 2540

_20131206 02:26:51 <inf.wul05 COPY_SALESROSTER_OUTBOUND_FILE_TO_INTRAMED.541541.System Command.TIDAL_AGENT_1.ES_TIDALDB01_1> Posting Status Update; status 2

_20131206 02:26:53 <inf.wul05 COPY_SALESROSTER_OUTBOUND_FILE_TO_INTRAMED.541541.System Command.TIDAL_AGENT_1.ES_TIDALDB01_1> Item 541541 status changed to 2

_20131206 02:26:53 <inf.wul05 COPY_SALESROSTER_OUTBOUND_FILE_TO_INTRAMED.541541.System Command.TIDAL_AGENT_1.ES_TIDALDB01_1> Job item 541541 activated

_20131206 02:26:54 <inf.wul05 COPY_SALESROSTER_OUTBOUND_FILE_TO_INTRAMED.541541.System Command.TIDAL_AGENT_1.ES_TIDALDB01_1> Posting Status Update; status 4

_20131206 02:26:55 <inf.wul05 COPY_SALESROSTER_OUTBOUND_FILE_TO_INTRAMED.541541.System Command.TIDAL_AGENT_1.ES_TIDALDB01_1> Item 541541 status changed to 4

_20131206 02:26:55 <inf.wul05 COPY_SALESROSTER_OUTBOUND_FILE_TO_INTRAMED.541541.System Command.TIDAL_AGENT_1.ES_TIDALDB01_1> Job item 541541 complete

I cannot find any reference to what status 512 means, can anyone shed some light on this status code?

Maximilian Gallagher · ‎12-12-2013

The 512 message means the job completed abnormally, and tidal has assigned it internal status of 512. Specifically that it ran and completed on its own, but it returned a status or exit code that was not 0. If the exact same job ID ran again, I would assume that it is scheduled to run multiple times a day using the same instance (instead of a new instance), or the job was rerun.

mwezesa01 · ‎12-13-2013

Thanks for the reply, so is there a way to determine why the job completed abnormally? The application team that runs the production jobs has put in a request to see if we can determine why the initial SFTP job did not complete. Is there another set of logs that I can look at that would provide more information to support the abnormal completion?

Maximilian Gallagher · ‎12-13-2013

Well, we know the job completed abnormally because it had a non-zero exit code. What exit code that was can be found in the FTP logs if the agent is in high-debug. It'll be called "ftp.log"

To put an agent in high debug:

============================================================
Windows Agent:
1. Open the TIDAL Service Manager on the agent machine
2. Select the agent in the dropdown
3. Click on the dots [...]
4. In the Service tab, change the path to include the DEBUG option to read "DEBUG=HIGH"
5. Click OK to save changes
6. Restart the agent
=============================================================
*nix Agent:
1. Go to the agent machine and go to the directory the agent is installed in
2. go to "Bin/" and edit "tagent.ini"
3. Under "[config]" put "ovb=tidaldebug"
4. Restart the agent
============================================================

S Kolli · ‎10-10-2017

Thanks for your suggestion. We see similar error if multiple jobs are trying to execute the shell script. In agent logs it shows exit code of process 112 and status changed to 512. Do we know how can we identify what causes it to be failed?

Thank you.