I have noticed that one of our workflow is getting errored on the same time almost everyday.
Note that, I am using Shopify node and we have currently 13 scheduled workflow running with the same nodes and flows, but no error execution on those workflows not even one.
The error was due to run-out memory , but when we rerun the workflow on the same parameter and it got only less than 20 items, which is not making sense and how it got run-out of memory.
Any idea what causes this? or how can we check this and find out how it got run-our of memory.
Below screenshots :
Hey @yves.jauculan , perhaps at that time you have many more items to process. Have you compared the executions that failed against the exeutions that ran successfully. Here are the questions you might consider answring.
Do they process the same/similar amount of items.
Does the workflow has the same branches engaged during the executions.
Do you have any other workflows running at the same time that might be consuming the instance resources depriving your troubled workflow.
In short, try to spot any differences between the executions and check if any other workflows are runing at that time.
Yes, we did compare the number of items got process from failed vs successful ones, and the number of items are less e.g. < 30
We do rerun the failed workflows exactly the time range it got errored out, that’s why we had noticed this. (we do pull data every past 1 hr across)
Below is my response on your query.
Do they process the same/similar amount of items.
-No, the workflow i had reported is processing < 90 items. on average 50 items per workflow run.
Does the workflow has the same branches engaged during the executions.
-No, it is one at time.
Do you have any other workflows running at the same time that might be consuming the instance resources depriving your troubled workflow.
-We have 13 workflows using scheduled trigger node that will run every beginning of the hour. Odd thing is that only this workflow fails others are stable, other workflow might failed also by chance
“the workflow i had reported is processing < 90 items. on average 50 items per workflow run.” - That is more data processed
Odd thing is that only this workflow fails others are stable, other workflow might failed also by chance. - Thus, other workflows running at that time are also affected.
You might need optimizing the workflow or run it more often during the “troublesome” time to reduce the number of items processed.