We recommend switching to the latest versions of Edge, Firefox, Chrome or Safari. Using Internet Explorer will result in a loss of website functionality.

How to AUtomatically purge large temporary files created by workflow

Comments

2 comments

  • Avatar
    Adrian Williams

    Data360 Analyze has built-in tools to help manage the purging of temporary data generated by the application. In the case of temp data generated by the ad hoc execution of data flows the following setting should be configured as required:

     

    When scheduling is used, the corresponding settings for the purging of scheduled run data are here:

    0
    Comment actions Permalink
  • Avatar
    Adrian Williams

    You can manually delete other temp data that may be generated by your data flows using a Directory List node  that is configured to recurse and to select the files matching the required pattern: (all files in this case)

     

    A Transform node can then be configured to identify files where the modified data is older than a threshold date:

    Finally, another Transform node can be used to delete the selected files:

     

    Where the Scheduling feature is enabled in your application license the data flow can be scheduled to run daily to automate the purging the files. Note that the data flow does not delete any directories.

    Caution should be exercised to ensure that the data flow is configured to only delete the required files.

    An example data flow is attached below. Data360 Analyze release 3.6.0 or higher is required to import the attached example data flow.

     

    Attached files

    Purge_Aged_Files--share - 15 Dec 2020.lna

     

    0
    Comment actions Permalink

Please sign in to leave a comment.