Data3Sixty® DQ+ 3.1 - May 2019

Data3Sixty® DQ+ enhancements in this release include:

Usability Improvements

Search for stage in tree picker
With this release, the ability to search for a Data Stage by name has been added to multiple places where a Data Stage selection can be made with the tree picker UI component. This has been added to remove the need for manually traversing the tree to look for a Data Stage when the user knows the Data Stage by name.

Preserve Memory Settings on Import and Promote
With this release, options have been added to the Import and Promote dialogs that allow the user to preserve execution settings in target Analyses and Data Views.

Analysis Improvements

Prevent retention from deleting files that are in use by running analysis
This enhancement prevents an analysis from reading any data that is past its retention period.

Prevent analysis from reading data that is past retention period
When a data store is configured with a load range of All, New since last execution with no previous execution, New since last execution on a rebuild, or By Date with start time of null, the system will now check any data being read to make sure that it is within the data store's retention period at the time the analysis starts execution.

Delete data during retention only after a delay
The system retention process will now delete data that is past the retention period only after at least 24 hours have passed since the data was eligible for retention.

Add support for paging REST APIs in REST node in analysis
Previously, the REST API node did not handle APIs that support paging. This enhancement adds support for the most common paging variations.

Data Store and Data View Improvements

Basic Profiling of Data Store
With this release, a number of changes have been introduced to Data Store profiling. This includes:

•Profiling at the Data Store level, without needing to create an Analysis.

•Profiling changes to support data store profiling.

•Changes to profiling node UI in Analyses. The changes mentioned above now take the form of an entirely new Profile Data node, available within an Analysis.

Ability to query file based (S3 and HDFS) data views and data stores using SQL
This enhancement adds support for data views that are based on Amazon Athena. Data Views based on Athena/Hive/Impala are suitable for use with large amounts of data where using RedShift/Vertica could be cost prohibitive.

Big Data storage type in Data View UI
A new storage type called Big Data has been added to the data view UI.

Allow no sort criteria to be specified in query criteria
To support the use of window functions on a data view that is performing its query using Amazon Athena, custom sort criteria may now be set in a dashlet’s query criteria without requiring sort fields to be selected.

Support Hive for HDFS based data stores in the enterprise edition
With this release, the product now supports Hive for HDFS based data stores in the enterprise edition of the product.

Reusable Rules, a.k.a. the “Rule Library”

Reusable JavaScript Library Node
This enhancement encompasses multiple changes to the product that support the use of reusable JavaScript code blocks wherever scripting can be performed.

Visualization Improvements

Tooltips to Display Multiple Values

This enhancement provides the ability to add configurable tooltips to all chart types where tooltips are supported. This new ability includes the following features:

• The ability to create a custom tooltip layout for each measure in a chart, using HTML.
• The ability to show a dimension in a tooltip and hide that dimension in the x-axis of the chart.
• The ability to show a measure in a tooltip and hide that measure in the y-axis of the chart.
• The ability to show a series (bottom dimension) in a tooltip and hide that series in the x-axis of the chart.

Single or Multiple Select Enforcement for Filter Values
This enhancement adds the ability to restrict selection to a single item within a list-based filter dashlet.

Dimension Swap in Dashboard
This enhancement introduces new ‘Card Dashlet’ functionality. A Card Dashlet may contain multiple Chart/Table dashlets.

Allow pre-defined values as filter values
In support of the Dimension Swap functionality, users may now create Static filter dashlets that use a static field name and static field values.

Dimension List for Static Filter
Also in support of the Dimension Swap functionality, users may now create Static filter dashlets that use dimension names from the dashboard’s data source as the contents of the filter.

Autofit Table Width to Entire Dashlet Frame
Each dimension, measure, and series field in a data grid dashlet now contains a new menu item called “Flex Width”. When the data grid takes up less space than the dashlet, any columns marked “Flex Width” will now be expanded to fill the empty space.

Ability to Sub Total within a Pivot Table
This enhancement adds the ability to create Custom measures for Pivot Grids.

Ability to Export True XLSX files from dashlets
With this release, users may now use the MS Excel option within the More->Export menu of a dashlet to export the dashlet’s data in an .xlsx file.

Configure Font Size, Color and Style in Dashboards

• With this release, the ability to customize the font settings of dashboard components has been added. Users may now set a global Font Family for an entire dashboard. They may also customize fonts at the dashlet level, controlling font family, weight, color, style, and size.

Left/Right Targeting of Dashboards

• Changes have been made to the user experience of filtering in dashboards. By default, selecting components within a chart will now trigger a filtering event that is applied to all other chart/table dashlets in the dashboard. Once the selection has been made, a new overlay will appear above the chart/table where the selection was made, which allows the user to further control how the filter is applied.

• In addition, the concept of targeting has been introduced. With targeting, the user may override the global application of a filter created by a chart/table selection so that the filter is only applied to specific dashlets within the dashboard.

Default Value for Export Number of Fields Filled In
With this release, the system will now default to exporting 10,000 rows of data when exporting .CSV data or Data for Excel from a dashlet. Previously, no default number of rows was provided.

Scripting Improvements

Add Javascript function to convert Input object in Script node to a JS object
This enhancement adds a function called convertInputToJSObject to the Analysis Script node and the Transform script editor for Data Stores.

Security/Auditing Improvements

Improve identification of begin/end session in Audit Trail
With this release, improvements to the Audit Trail have been made to more accurately detect when a user session begins and ends.

On-premises Installation and Infrastructure Improvements

Add Support for Hortonworks 3 and Cloudera 6
With this release, Hortonworks 3 and Cloudera 6 are now supported on enterprise deployments of the product.

New Hortonworks 3.1x Cluster with Edge Nodes
As part of the newly added support for Hortonworks 3, the enterprise version of the product may be installed and use a Hortonworks 3 cluster.

New Cloudera 6 Cluster with Edge Nodes
As part of the newly added support for Cloudera 6, the enterprise version of the product may be installed and use a Cloudera 6 cluster.

Upgrade Tomcat to latest 9.0.x
With this release, Tomcat was upgraded from 9.0.4 to 9.0.14.

Support multiple versions of Hadoop distributions in deployment process
With this release, a new deployment property, HADOOP_VENDOR_VERSION, has been added to the enterprise version of the product. This property allows the system to distinguish between Hortonworks and Cloudera.

See the attached Release Notes for additional details and information on Bug Fixes.