I created a workflow for splitting the data from oracle into multiple batches and made actions(for example insert data into Strapi) batch by batch. There are two customized nodes in the workflow:
Run query in Oracle DB
Output the offset values using
Count per page
The expected behaviour for the workflow should be:
- Get the total count from
- Put the total count to the
- Using the
Split in Batchnode, we split the items from the
Paginationnode one by one, and perform a query in Oracle using the
However, the workflow cannot be executed properly with an error saying
Workflow execution process did crash for an unknown reason.
I found some issues related to this error message, saying that it could be a memory issue. However, only 50 rows are fetched in this example, I am sure that it cannot be a memory issue.
This workflow works fine in an environment having only the main process. The issue happens only in the environment with two workers and two webhook workers.
16 Core CPU
Thanks a lot!