Describe the problem/error/question
I’m trying to figure out how to check the number of active and or queued workers in my n8n cloud instance. I keep running into issues where my workflows get out of control when too many workers pile up in the queue.
What I really want to do is:
- Check how many workers are currently running concurrently across workflows
- Check how many are sitting in the queue
- Use this info to only start new workers when I’m below the 50-worker limit
What is the error message (if any)?
When trying to scale my workload by pushing the concurrency & queue volume, my n8n instance crashed(?) (n8n total uncontrollable & making tons of not requested webhook calls, it’s still a bit vague what rally happened)
Please share your workflow
Right now my workflow looks like this:
I'm using webhooks to trigger batch processing, but I have no way to check
how many workers are already running before starting new ones.
Ideally, I want to:
1. Check current worker count before starting new ones
2. Only proceed if we're under 50 total workers
3. Otherwise wait 10 seconds and check again
Information on your n8n setup
- n8n version: 1.76.3
- Database: SQLite
- n8n EXECUTIONS_PROCESS setting: own
- Running n8n via: n8n cloud
- Operating system: macOS
Some background on my situation: I’m processing a lot of data through my workflows, and I need to be careful about API rate limits. I know my cloud instance can handle 50 concurrent executions, but I have no way to see how many are actually running at any given time.
Has anyone figured out a way to monitor this? Or maybe you have a different approach to managing high-volume workflows without overwhelming the queue? Any help would be super appreciated!
Thanks in advance!