I’m building an n8n workflow to scrape a site with subsitemaps β†’ categories β†’ products and want to ensure all URLs at each level are fully processed before moving to the next level, without overlapping execution

<!-- Hey! The fastest way to find solutions is by using the πŸ”Ž search function at the upper right.
If your question hasn't been asked before, please follow the template below. Skip the questions that are not relevant to you. -->

Describe the problem/error/question

What is the error message (if any)?

Please share your workflow

(Select the nodes on your canvas and use the keyboard shortcuts CMD+C/CTRL+C and CMD+V/CTRL+V to copy and paste the workflow.)

Share the output returned by the last node

Information on your n8n setup

  • n8n version:
  • Database (default: SQLite):
  • n8n EXECUTIONS_PROCESS setting (default: own, main):
  • Running n8n via (Docker, npm, n8n cloud, desktop app):
  • Operating system:

To ensure sequential processing without overlapping execution, you can use the β€œWait” node in combination with the β€œFunction” node. First, collect all URLs from the subsitemap, then use a β€œFunction” node to iterate through each category URL sequentially. After processing each category, add a β€œWait” node to pause the workflow until all products in that category are processed before moving to the next category. This approach ensures each level completes fully before proceeding to the next.