We recommend switching to the latest versions of Edge, Firefox, Chrome or Safari. Using Internet Explorer will result in a loss of website functionality.

Scheduling

Comments

6 comments

  • Avatar
    Adrian Williams

    Hi Michael,

     

    The scheduling functionality's 'Weekly' interval option allows you to specify the days of the week that the data flow should be run, together with the time the run should be started:

    A data flow can also have multiple schedules. The screenshot below shows the three active schedules for the data flow named 'Timestamp' that have different start times (and a disabled schedule) :

     

    In addition, Dataverse release 3.1.0 introduces the Automation Server edition and the Enterprise Server edition which expose the Dataverse REST API.

    The 'Simple Scheduled Task' is used to create a scheduled task. The 'triggerProperties' attribute utilizes a cron expression element to specify the date/time for the scheduled task.

    Regards,

    Adrian

     

    0
    Comment actions Permalink
  • Avatar
    Michael Lowe

    Thanks Adrian,

     

    Ok, but then you need to enter the parameters each time rather than just define one schedule with one set of parameters. Each schedule is also separately represented/grouped so that when inspecting results you need to investigate each schedule. Doesn't seem like a lot of effort for 1 or 2 but maybe more challenging for multiple data flows with multiple schedules each, then what if the parameters change? A lot of extra maintenance just because you have to create a different schedule to satisfy a more complex scheduling requirement.

    0
    Comment actions Permalink
  • Avatar
    Adrian Williams

    Hi Michael,

    I will raise your request for the ability to use a custom cron expression with Engineering as a candidate future enhancement. 

    The current method achieve this would be to leverage the REST API to create a task to schedule the execution of a data flow.

    Regards,

    Adrian

    0
    Comment actions Permalink
  • Avatar
    Mark Waters

    Michael, Adrian,

    A small point on using the REST API to create schedules with more complex cron settings:

    Note that the UI cannot be used to edit schedules created using the REST API. The REST API must be used for all updates to the scheduled definition. The schedule status (enabled/disabled) and runs associated with the REST API schedules can be viewed in the UI.

    Mark

    0
    Comment actions Permalink
  • Avatar
    Don Graham

    I do not see any enhancements to the scheduling and wanted to check. We have the requirement to run every 2 hours between 8 am and 5 pm M-F. I am currently setting up 5 scheduled jobs. Fortunately I have parameter sets so I can read in the parameters and don't have to enter them manually anymore.

    0
    Comment actions Permalink
  • Avatar
    Adrian Williams

    The scheduling has not been enhanced to support additional options such as the use of a CRON expression. However, you could leveage the Execute Data Flow node that is available in v.3.6.2 in a 'driver' data flow to execute a 'main' data flow only when the required date + time conditions are correct. The driver data flow could then be scheduled to run hourly.

    An example of the driver data flow is attached (requires v.3.6.2). 

     

    Attached files

    Run DF at Date and Time Data - 22 May 2020.lna

     

    0
    Comment actions Permalink

Please sign in to leave a comment.