Running Data360 Data Flows from cron jobs

Follow

ElHassan Boussif

• March 11, 2022 22:12

Hi Everyone,

We are migrating from Lavastorm 6.1.4 to Data360 Analyze Data360 Analyze v3.8.4.

Along the year we have automated the process of running and monitoring the automated job through a tableau dashboard.

We would like to keep the same process in place at least for the medium term, as it allow us to easily check the status of the jobs without logging into the UI or open the application.

The scripts we have in our crontab, call this command with the properties of the run.

here is an example:

laeController -u $username -p $PASSWORD ${ls_graph_path}/${ls_graph_name} -brdlog ${ls_brain_run_log} || ls_brainController_py_errored=1

Do you know how to do the same in Data360?

Thank you 

attached is a screenshot of the dashboard that we have built and which we would love to continue using. 

 

 

1

• 

  Adrian Williams

  • March 31, 2022 14:46

  This request is covered by a support ticket

  #299063

   

  0

  Comment actions Permalink
• 

  Adrian Williams

  • March 31, 2022 14:49

  Note that as from Data360 Analyze v.3.8.1 you can use a custom CRON expression to define a schedule interval. 

  See the v.3.8.1 release announcement for details.

  https://support.infogix.com/hc/en-us/articles/4406908363155-Data360-Analyze-3-8-1-is-Now-Available-LTS-Release

   

  0

  Comment actions Permalink
• 

  Lyle Ashbaugh

  • March 31, 2022 16:02

  Based on the code example you provided, I think you may be able to use AnalyzeCLI. I contains a Unix shell script that accepts similar parameters.

  0

  Comment actions Permalink

Please sign in to leave a comment.