We recommend switching to the latest versions of Edge, Firefox, Chrome or Safari. Using Internet Explorer will result in a loss of website functionality.

Data flow parameters



  • Avatar
    Adrian Williams

    Hi Mick,

    the approach is using the Transform node is pretty similar to what you would have previously done.

    First click on the canvas (which will display the Run properties in the panel). Then Click on the Define tab in the Properties panel. Click on the 'Create property group' button and give the 'New Group 1' property group a suitable name if required (= "General" in my example). Then create some data flow properties in the group ("From_Date" and "To_Date" in the example).

    Switch back to the Configure tab and you should see the newly created Data Flow level properties. Populate the properties with some values.

    Then, within the Transform node you can use textual substitution to get the value of the properties. As they are constants you can include any required code in the ConfigureFields Script as this is processed once when the node starts to run, and before any records are processed.

    In the above script the date format string is defined and the 'start_date' and 'end_date' properties are generated from the data flow property values. The name of the field to be tested is also specified in the script (just to centralize the value here rather than specify it multiple times in the ProcessRecords script).

    The ProcessRecords script then defines the conditions when the record will be output.


    In the case of a Filter node, you cannot specify the use of Data Flow property values in the simple grid - you have to use the Advanced functionality - but you can still use the grid to help with the configuration. The first step is to add the Filter node to the canvas, connect it up and then create two filter criteria in the grid with dummy date values.

    Switch to the Advanced tab and replace the dummy dates with the property references:

    There is no option to configure 'Mandatory' validation on the Data Flow property values to check they have been set but you can, if required, include some validation code in Transform node's ConfigureFields script or in the Advanced tab of the Filter node (e.g. within an   if node.firstExec:  statement block).

    Attached is an example data flow corresponding to the above (requires v.3.5.1).


    Attached files

    Filter by Date Range - 28 Nov 2019.lna


    Comment actions Permalink
  • Avatar
    Adrian Williams

    If you use the Search functionality on the forum with the text set to one of :

    - datetime

    - strptime

    - property references

    you should find some other relevant posts and knowledgebase articles.

    Comment actions Permalink

Please sign in to leave a comment.