Data360® Analyze 3.8.0 is Now Available - LTS Release

 

 

ATTENTION: In order to continue receiving product update notices, please Sign In and select “Follow” on  the Data360 Analyze announcements page here.

 

Data360 Analyze 3.8.0 release is now available.

Product downloads are available within our Data360 Analyze Download section. 

 

What’s New?

This Generally Available Long Term Support (LTS) release provides the following enhancements that are now available for the first time in any Data360 Analyze release:

The user interface now delivers improved design-time performance

Integration with data stored in Azure Data Lake Gen.2 

Improved support for generating a HTTP multi-party body

Increased flexibility when acquiring data from comma-separated value (csv) files

Improved support for metadata from in Azure blob and AWS S3 data sources

A number of nodes have been updated to not rely on Superseded nodes

Additional tools to allow administrative users to unlock locked documents

Command line interface (CLI) tool to enable remote/scripted access to common tasks in Data360 Analyze

Changes to supported platforms.

 

Note: this overview includes functional changes that were delivered in the (unreleased) v.3.7.x releases.

 

Node Enhancements

Full details on the Analyze 3.8.0 "node enhancements" may be found within the following article :

Analyze 3.8.0 Node Enhancements

 

Application Enhancements

Design-time Performance Improvements
A range of changes have been made to improve the user experience when designing and building data flows:

• The performance of the application been significantly enhanced when navigating within, and making changes to, large data flows (i.e. data flows with over 3000 nodes)
• Previously, when two Composite nodes had run dependencies, and each Composite contained many nodes, this could lead to latency in the user interface when the user opened the data flow or navigated within it. This issue has now been resolved
• Previously, when connection bundles were connected to a series of other connection bundles this could lead to an out of memory event. This issue has now been resolved and it is now faster to navigate within this type of data flow
• The application is now more responsive when changing of graph and composite level properties
• When a data flow has resolution errors, navigation within the data flow is now faster
• The performance of the Apply Auto-Fixes functionality has been improved
• Save operations are now faster, together with the first edit operation on a saved data flow
• The resolution of permissions information is now faster
• The process of importing a legacy data flow (.brg file) is now faster.

 

Locked Documents

When a user starts to edit a document, it is locked for other users, so that two people cannot concurrently work on it. However, documents can remain locked if, for example, the user exits their browser for whatever reason, without first closing the document they are working on. Users with the administrative role can now view and unlock documents.

To view locked documents, click the ‘ALL FOLDERS’ tab and then select the ‘Locked Documents’ item in the navigation panel

To unlock a document, select the document to be unlocked in the list and click the ‘Unlock’ button

The Unlock Document dialog will be displayed to confirm your decision. The period in which the unsaved changes were made is shown. Note: Any unsaved changes that were made by the user will be lost. You have the option to save a copy of the document with unsaved changes.

When a document is locked for edit, the ‘Save As’ button is now disabled.

 

Property References

You can now insert a text substitution property reference to any run property defined on the parent run property set. 

 

Running Node Duration

When a node is running you can now see how long it has been running in the node’s properties panel.

 

Tomcat Version

The version of Tomcat that is used by the application has been upgraded to 9.0.44

 

Third-party Library Updates

A number of third-party libraries have been updated to benefit from the latest security updates

 

Python Version

The version of Python that is used by the application has been upgraded to 2.7.18

 

OpenSSL Version

The OpenSSL library has been updated to 1.1.1k

 

Audit Logs

Additional logging has been introduced to the audit log, which shows the progress of a system back up. The new audit codes are:

• backupWaiting
• backupStarted
• backupFinished

When a node is executed, the node type is now included in the event information in the audit log.

 

Third-Party License Information

Third-party license information is now available in the About Data360 Analyze dialog.

 

Postgres Database

The version of Postgres used by Analyze has been updated to version 13.3.

Note: Due to this change, upgrades to this release will require more disk space than normal. The additional space required is 1.5 times that of the current Postgres database size.

 

AnalyzeCli Tool

The Data360 Analyze command line interface (AnalyzeCli) tool is now available. 

The CLI is an independent Java application that can be used, for example, to retrieve information about your system, run commands, execute scripts and perform other operational and administrative tasks on a Data360 Analyze Analyze installation. See the ‘Data360 Analyze CLI’ topic in the Help documentation for further details.

 

Changes to Supported Platforms

Windows Server Core 2019 is now a supported platform

Windows Server 2012 R2 64-bit is no longer a supported platform

Red Hat Enterprise Linux 8 is now a supported platform

Red Hat Enterprise Linux 6 is no longer a supported platform

SUSE Linux Enterprise Server 12 is no longer a supported platform.

 

System Requirements

For Windows Server installations you must now also install Visual C++ Redistributable Packages for Visual Studio 2019.

 

Installer Check for Required .dll Files

The Windows version of the Data360 Analyze installer now checks for the required .dll files. If a required .dll file is not found, the Visual C++ Redistributable Packages for Visual Studio 2019 should be installed.

 

Superseded Nodes

Fixed Format File Node

The Fixed Format File node has been replaced by a new node with the same name.

The original Fixed Format File node is now named Fixed Format File (Superseded).

 

URL Query Builder Node
The URL Query Builder node has been replaced by a new node with the same name.
The original URL Query Builder node is now named URL Query Builder (Superseded).

 

Output Fixed Node
The Output Fixed node has been replaced by a new node with the same name.
The original Output Fixed node is now named Output Fixed (Superseded).

 

Data flows that contain the superseded nodes continue to operate as normal.  Superseded nodes are hidden by default in the node library but can be made visible by checking the ‘Show Superseded Nodes’ in the node library’s context menu. We recommend you use the new versions of the nodes in current projects and implement a plan to progressively replacing superseded nodes in existing data flows.

 

Deprecated Nodes

QVD File Node

The node is still available in the node library but is hidden by default. Deprecated nodes can be made visible by checking the ‘Show Deprecated Nodes’ option in the node library’s context menu.

 

Removed Functionality

Spark Nodes

The following Spark nodes are no longer supported and have been removed from the product:

Spark Agg, Spark Data Viewer, Spark Download, Spark End Session, Spark Filter, Spark Java Submit, Spark Join, Spark Sample, Spark Sort, Spark SQL Query, Spark Start Session, Spark Upload

It is possible to import a legacy data flow (BRG file) into Analyze that contains one or more of the above nodes. However, when the Data Flow is executed, an error message will be displayed

 

XMLpy Node

The XMLpy Node is no longer supported and has been removed from the product.

 

SharePoint 2010 Nodes

The following deprecated nodes are no longer supported and have been removed from the product:

Download for Sharepoint 2010, Folder List for Sharepoint 2010, Upload for Sharepoint 2010.

 

 

Resolved Issues

The following issues have been resolved in this release:

LAE-8880, LAE-9613, LAE-9851, LAE-9988, LAE-10423,
LAE-10846, LAE-22936, LAE-24352, LAE-23575, LAE-23865
LAE-23882, LAE-24521, LAE-24646, LAE-24692, LAE-24911
LAE-24956, LAE-24964, LAE-24989, LAE-25185, LAE-25277
LAE-25280, LAE-25468, LAE-25538, LAE-25550, LAE-25635
LAE-25678, LAE-25815, LAE-25816, LAE-25863, LAE-25902
LAE-25909, LAE-25911, LAE-25932, LAE-26026, LAE-26055
LAE-26240, LAE-26246, LAE-26287, LAE-26311, LAE-26382
LAE-26404, LAE-26430. 

 

See the release notes for details of the resolved issues.