I have following requirements:
- JobB depends on JobA
- JobC depends on JobA and JobB (if in schedule)
- Always execute JobA
- If exit code of JobA=1 execute JobB
- Always execute JobC when JobA and JobB (if in schedule) are done
During Tidal conversion we called this requirement “branching”. It was recommended by Tidal Professional services to accomplish branching via events/actions that would react to the exit code (event) and insert JobB (corresponding job action). The missing piece now is how to maintain proper dependencies downstream from the “branched” job, i.e. how to make sure JobC does not execute until JobB completes.
The way we implemented this is by adding an event to JobA that is triggered by exit code 1 and - if/when triggered - called action for JobB to be inserted.
JobB itself does not have a schedule and can only be inserted by a job action
JobC depends on both JobA and JobB (JobB dependency marked as "ignore if not in schedule").
The issue is that sometimes dependency on JobB is ignored even though it has been inserted and hence JobC starts prematurely.
I have been told that this will not work as the schedule is compiled ahead of time and the ad hoc job (JobB which does not have a calendar) will not be in schedule and hence will always be ignored.
Indeed in activity view for the future dates the dependency is not visible.
However, for many such sequences the activity view for the past dates will show the dependency just fine - but not always.
This to me is a kind of undeterministic behavior.
My thinking is that perhaps Tidal may not have enough time to consider the dependency before the JobC is triggered (as if consequences of JobB insertion were processed in parallel - on a parallel thread - to the main thread that inserts JobC). But I'm hesitant to be introducing arbitrary timers or additional variables and variable events/dependencies.
Any ideas appreciated.
Thanks
Dan
