If I could ask for a basic example of a loop showing where the counter value is being stored and output, I believe I could complete the process.
Sure, I have placed notes in the workflow explaining what is happening. Note that count
is controlled in Set nodes themselves!!! I also made a slight rearrangement to ensure when the workflow completes you have the stats available in “Done” node.
Finally, when the crawling is completed successfully I do not set count
to 10. There is not need for that, and this approach also provides a more accurate information how the source was crawled (how many times).
You didn’t answer about the error question. Depending on that answer you need to make sure that your HTTP Request node (the crawler) is configured accordingly. For example, I set it to always output data assuming that by the error you mean the node failes to crawl/reach destination and returns no JSON containing response
.