Sorry to hear that you have problems. To however be able to answer your question properly, and not waste unnecessary time, did we create a default template that gets filled in automatically every time an issue gets created. Sadly did you delete it instead of answering the questions. That kind of defeats the purpose and does not allow us to do that. So could you please answer the following questions so that we can help you as well and fast as possible? Thanks!
Database you’re using (default: SQLite):
Running n8n with the execution process [own(default), main]:
Running n8n via [Docker, npm, n8n.cloud, desktop app]:
In this case I expect it is the way the executions run, and that you have it set to the default value own (it not set, it will also use that).
Can you please check if you have in your docker-compose file an environment entry for EXECUTIONS_PROCESS. If not, or if it is not set to main add one and set it to main.
So should then look like this:
This will make sure that it does not start a new process for each workflow execution and that will not just make the executions much faster, it will also reduce the required memory by a lot and so 10 and many more executions in parallel should then be no problem anymore.
You should see the result very fast by for example executing a workflow manually. You will see that instead of having to wait at least 1 second for the workflow to start (and potentially directly finish) will it change to almost instantly.
It depends what the limiting factor is. To probably more than 98% is it the memory, not the CPU. Also is the worst thing that happens when the CPU becomes the limit, that things are a little bit slower, compared to crashing when the memory runs out. On top does spawning a new process take not just a lot of memory, it also requires quite some time (1 second). So “main” will be the best setting for you. Just give it a try, n8n will be able to process at least 10-20x more in parallel.
We will release some benchmarks soon that will make the performance increase clear.
I did a couple of things.
Changed the setting to main and also increased the RAM - because that seemed to be the limiting factor.
Will see when the next burst comes in and update this thread.
Thanks for your help