I want to ask about n8n queue option

Questions
1

I ran some workflows, but it call too much sub-workflow at the same time. This makes CPU overload.

Do you have any experience? Could I force n8n load only 10 executions at the same time?
Should I run n8n with queue to solve this?

2

There are a number of options that you can do here:

  1. Use the Split In Batches node to only run a few executions at a time and use a Wait node before looping back for the next batch
  2. You could use a messaging queue and only pull in a few items each iteration
  3. You could go down the scaling route and add more power to the system

Hopefully those ideas will help.

3

I don’t know if this helps you with sub workflows, but this happened to our CPU load when we switched our installation to using one worker instance.

cpu

2 Likes
4

How could I make a queue with webhook in option 2?