We recommend switching to the latest versions of Edge, Firefox, Chrome or Safari. Using Internet Explorer will result in a loss of website functionality.

Group Node

Comments

11 comments

  • Avatar
    Adrian Williams

    When you refer to "Group Node" I assume you mean the Composite node. If so then no, there is no restriction on running nodes within a Composite node when using the Data360 Analyze Desktop (free) edition. 

    All Standard Data360 Analyze nodes are available for use with the Data360 Analyze Desktop (free) edition. The primary functional restriction with this edition is that you are limited to processing a maximum of 2 million records through a node.

    A node will not run if it has unsatisfied input dependencies - for example it has been configured with an optional input pin but no node is connected to the input.

    A node also cannot be run using the Run button if it has already been run. You need to use the Re-Run button (or Clear the run state and use the Run button or Re-Run button)

     

    0
    Comment actions Permalink
  • Avatar
    William Pang

    In the example below, the 3 nodes within the yellow box "Duplicate Server Name" will be able to execute as you see below.  The same exact nodes are also replicated into the composite node 'Duplicate Server Name' but it would not run / re-run.  I bundled the 3 nodes using the 'Group Node' button.  Any idea why it wouldn't run in the composite node?

    Also happy to share the Data Flow but can't locate the file.  Can you point me where I can find it so I can share it to you if required?

    0
    Comment actions Permalink
  • Avatar
    John Taylor

    Hi William,

    Have you "drilled into" (double clicked) the composite node and tried to turn the aggregate,split and join from inside there? this is likely going to be the best way to debug why the composite node is running or at least, is not completing.

    It's hard to see from the screenshot above but you seem to be joining aggregated data back to an original attribute from the same output. It's easy to see that the Yellow box version is getting 2 inputs, however the composite only looks like getting a single input because it's coming from that same output leg.

    It would be interesting to see what's going on inside the composite node and if its getting confused by the fact that a single output is being used to feed the aggregate node and the join node.

    Thanks

    John

    0
    Comment actions Permalink
  • Avatar
    Adrian Williams

    As John said, it would be useful to understand what is inside the Composite node and what happens when you try to run it.

    When I created a test data flow to look at the operation of the Group Nodes functionality, the resultant Composite node had two inputs.

    The Composite node then ran successfully.

    You can export a data flow by selecting the required data flow in the directory and clicking the 'Export..' button in the properties panel menu.

    Then follow the wizard to save the resultant .lna file on your machine.

    0
    Comment actions Permalink
  • Avatar
    William Pang

    Thanks for the prompt reply.

    I tried 'drilled into' the composite node and run the nodes.  There's no error nor comment.

    As Adrian mentioned, the resultant of Composite node did have two inputs.  Since they are both from the same output, I'd manually removed one and join to the other.

     

    Nonetheless I tried it again and this time I left both 2 inputs.  Still the nodes didn't run.

    The aggregate node is group count, Split node output those > 1 and Join node looks up the duplicate records.

    I'd attached the Data Flow for your reference.

    0
    Comment actions Permalink
  • Avatar
    William Pang

    Any idea why my Group Node couldn't run?

    0
    Comment actions Permalink
  • Avatar
    Adrian Williams

    Unfortunately, no. The system operates correctly in my tests.

    In your initial post you said:

    Also happy to share the Data Flow but can't locate the file.  Can you point me where I can find it so I can share it to you if required?

    In a previous reply I indicated how you can export the dataflow as a .lna file:

    You can export a data flow by selecting the required data flow in the directory and clicking the 'Export..' button in the properties panel menu... Then follow the wizard to save the resultant .lna file on your machine.

    If you are still happy to share, can you please send the data flow to us. If you follow the above steps you can then click the 'Choose file' button in the reply area of this page to select the saved .lna file then click the 'Attach File' button to upload the file, and finally click the 'Submit' button

    0
    Comment actions Permalink
  • Avatar
    William Pang

    Hi Adrian,

    I thought I'd attached the .lna file.  Here's the file again.

    0
    Comment actions Permalink
  • Avatar
    William Pang

    Looks like I'm having trouble attaching the file.  

     

    Attached files

    ALM - 1 Oct 2021.lna

     

    0
    Comment actions Permalink
  • Avatar
    Adrian Williams

    Hi William,

    Well it is all rather strange. When I added a Create Data node with some dummy data (to replace the output of your 'Active' Split node) and connected it to the three nodes in the yellow box and the composite nodes they all ran successfully!

    Are any warnings being shown in the Errors panel?

    Can you try running the nodes once again and then download the server logs. You can get the logs by: clicking on the information ('i') button on the main menu

    select the 'About Data360 Analyze' item then clicking on the 'Download Server Logs' button in the pop up dialog and saving the zip file.

    Then upload the logs to the forum. 

    Another thing you could try is to use the 'Apply Auto-Fixes' tool in the 'Errors' panel. Then re-run the entire data flow.

    You could also then try exporting the data flow and re-importing it into a different folder in the Analyze directory. This will create a new document for the imported data flow and may correct any compilation errors.

    0
    Comment actions Permalink
  • Avatar
    William Pang

    Hi Adrian,

    Found a rather interesting discovery.  I 'Clear Status' on ALL nodes to try again and run the Group Node.  As usual nothing happens and neither did any other node run.  So I tried your method and create a Dummy Data node and it worked !!  I reconnected the Group Node to the original input and it's now working again.  Somehow by using the Dummy Data node, it must have done something that it's now working.  I tried the same with the other Group Node (with 2 inputs) and it only work after I hook it up to the Dummy Data node but not before. There's no error/warning so not sure what happen that made it work but at least it's working again.  Thanks for helping out. 

    0
    Comment actions Permalink

Please sign in to leave a comment.