How the Modify Fields node works in Data360 Analyze

The Modify Fields node is new to 3.4.0 and can be found in the Aggregation and Transformation section of the Node panel. It allows you to modify the field metadata by including, excluding, renaming and changing the types of input fields.

You can opt to select each field individually and change the field name and the field type:

Or you can easily rename all the output fields by using Rename by Pattern. To do this, use an asterisks (*) to reference the current field name, for example " *_Type.

Auto type detection:

You can now use the Auto type conversion option to detect the input field type on String and Unicode fields, and automatically convert the corresponding output field to an appropriate type, for example long or int. The output is based on the content of the input field.

To use automatic type conversion, tick the Auto check box. When it is ticked, fields where both the input and output types are string or unicode will have their output type set to Auto.

Note: If you have modified the value of Type for an output field, you first need to revert to the properties of the input field, otherwise the automatic field type conversion will not work. Simply click the undo icon in the corresponding row of the OutputFields table to revert the changes.

AmbiguousDateResolutionMode:

From time to time, the date format can be uncertain. For example, '01/01/2010' and '01/11/2010' could be in day first or month first format. To overcome this, we recommend you use the AmbiguousDateResolutionMode under the Optional heading, to determine the format that should be assumed. You can choose from "day first", "month first" or "Auto" - which is based on the information provided by you in the  Locale property. The screenshot below demonstrates how to set it to English;

ConvertLeadingZeroes option:

Using the ConvertLeadingZeroes option you can specify whether or not
string and unicode fields that contain leading zeros are automatically
converted to long or int output fields when the "Auto" type detection and
conversion option is selected. The default value is "False".