I’m working on running N8N in Kubernetes, with 1 main container and 3 queue worker containers.
While I struggle with getting everything in K8s configured (I’m still pretty new to it), I was wondering if anyone had a good workflow (or idea for workflow) to test performance across the distributed workers. That is, I’d like to fire off “Workflow 1” with 3 queue workers, get a processing time, and then scale it up to 4 or 5 workers and see a shorter time.
Right now, I’m using a function node to create 1000 simple items, break those into batches, and send them off to a sub-Workflow which just adds a new field to each item. I use the Respond to Webhook node after the batching is done to get an overall time benchmark.
Does that seem reasonable? Are there better ways to construct workflows to take advantage of parallel processing across the workers? Any advice for constructing a solid test workflow would be gratefully received.