Data360® Analyze enhancements in this Feature release include:
The node now provides support for multi-character field delimiters. It node now uses the ‘HeaderMode’ property to specify the expected header information in the file. The node also provides improved handling of unescaped quote characters.
Output CSV/Delimited Node
The Output CSV/Delimited node is a new node that is intended to replace the (now superseded) Output Delimited node. It provides a range of additional capabilities similar to those available for the CSV/Delimited Input node. The output Filename can now be derived from an input field - enabling a single node to be used write records to multiple files. You can now specify which of the input fields to be output, and the order in which the fields will be written in the output file(s). The file character set and file format can now also be specified. There is now greater control of how headers are written and the format in which Date, Time and Datetime fields values are written. Additional capabilities are provided to specify how Null values are handled. The Exception behavior now prevents existing files from being overritten by default.
The S3 Get, S3 List, S3 Put and S3 Delete nodes now allow the connection to Amazon S3 to be routed via a proxy server.
Fixed Format File Node
The Fixed Format File node now continues the process of importing data when it encounters an empty line within the data.
Database Metadata Node
The Database Metadata node was previously Experimental - it is now a fully supported node.
The DeepSQL node was previously Experimental - it is now a fully supported node. The node now also allows input fields to be passed through to its output.
You can now annotate your data flows using text boxes on the canvas. Text boxes can be created and maintained. Formatting options are provided for the content of the text boxes. Boxes can be stacked over other boxes.
The Properties panel now comprises three separate tabs displaying node properties, data flow properties and Run properties. Keyboard shortcuts are also provided to enable you to switch between the tabs.
Run Property Sets
Run Property Sets are reusable objects that can be referenced by different data flows within the Analyze instance. New Run properties can be created and added to a Run Property Set, imported from a data flow or inherited from properties in another Run Properties Set. Multiple data flows can be configured to use a run property set (e.g. containing credentials information for external systems). Run Property Sets can be created from a legacy Lavastorm run property (brp) file.
You can now pop-out a Data Viewer tab so that it can be viewed as an independent window - allowing you to view multiple data sets side-by-side or view the output of a node before and after a change was made to its configuration.
Conditional Execution of Scheduled Data Flow
When scheduling a data flow, you can now configure a second data flow to be run on successful completion of the first scheduled data flow. You can optionally configure the action to be taken if the scheduled data flow fails to complete successfully - this can be to either run a specified data flow or send a failure notification email.
You can now align selected nodes either horizontally or vertically.
The audit log now contains information about which system processes are used to run nodes.
The Simple Scheduled Tasks Ad-hoc Run API to return the execution-plan-state locator when the request is posted.
System Backup Settings
For Data360 Analyze Desktop editions, the default time the system backup is taken is now 12 noon
The default time for the system backup for Server editions is unchanged (2 a.m.). A new system property has been introduced to specify the number of errors that can occur before the system backup operation is aborted.
Compatibility with Legacy Data Flows
The Lavastorm Analytic Engine (LAE) product allowed the use of deprecated operators (‘Expert’ functions). Analyze previously did not allow the use of these deprecated operators. To improve compatibility with legacy data flows, Analyze now allows the use of the deprecated operators. The node reports a warning when a deprecated operator is recognized.
Data360 Analyze Desktop
Windows 7 is no longer a supported platform for Data360 Analyze Desktop editions.
Data360 Analyze Server
Windows Server 2019 is now a supported platform for Data360 Analyze Server edition.
Internet Explorer 11 is no longer a supported browser. Microsoft Edge (Chromium-based) is supported.
The Output Delimited node now has a status of 'Superseded' and the node's name has been modified to reflect its status.
The following issues are resolved in this release:
LAE-21430, LAE-21783, LAE-22003, LAE-22464, LAE-22886
LAE-22939, LAE-22942, LAE-22948, LAE-22995, LAE-23023
LAE-23034, LAE-23059, LAE-23135, LAE-23144, LAE-23193
LAE-23198, LAE-23200, LAE-23201, LAE-23238, LAE-23239
See the release notes for details of the resolved issues: