Java heap space issue for lookup transformation -- Urgent -- Data3Sixty Analyze
Hi Team,
We are facing below error at lookup transform in two of our Jobs, We have tried checking below things before reaching out to you guys,
1) Updated the JavaMaxHeadSize property with values like 4g, 5g, 4096M, 8192M and try running the job but we still face the same error and the job is not getting completed because of the same. (this is in reference to post https://support.infogix.com/hc/en-us/articles/360024709093-OutOfMemory-Error-in-Data3Sixty-Anlayze)
2) We tried restarting the server on which Data3Sixty is hosted but still, the problem persists.
Can you please check why is this happening and provide us a workaround to get over this issue? Request you to consider this as an urgent request because we have scheduled jobs running and we might lose some precious source data if we cannot fix it as soon as possible.
Unexpected error occurred during processAll while running the node: java.lang.OutOfMemoryError: Java heap space.
Error code: brain.unexpectedNodeErrorDuring
Raised on: Dec 25, 2019 at 11:52:23 AM
Detail: com.lavastorm.brain.execution.java.node.NodeWrapper.nodeProcess
(NodeWrapper.java:586)
Attached files
-
If you don't have any duplicates in your join criteria, can you try replacing the Lookup with a Join? Set it to Left Inner and it should perform the same. I attached 2 screenshots that have a Lookup erroring out similar to your's, whereas the Join did not. I changed my Lookup JvmMaxHeapSize to 4G to give it enough memory to operate without erroring out, but note that I did not have to change the default value on the Join node.
Attached files
Please sign in to leave a comment.
Comments
1 comment