I’m trying to build a crawler that would crawl an e-commerce store and tell me how many product pages there are. So far I have been using this template </Autonomous AI crawler | n8n workflow template> , but I’m getting inconsistent results and several executions per trigger that I can’t understand that they are.
Had anyone built a similar crawler (obviously mine is very nuanced) and can share a template and some tips?
Thanks.
Describe the problem/error/question
What is the error message (if any)?
Please share your workflow
(Select the nodes on your canvas and use the keyboard shortcuts CMD+C/CTRL+C and CMD+V/CTRL+V to copy and paste the workflow.)
Share the output returned by the last node
Information on your n8n setup
- n8n version:
- Database (default: SQLite):
- n8n EXECUTIONS_PROCESS setting (default: own, main):
- Running n8n via (Docker, npm, n8n cloud, desktop app):
- Operating system: