I’m using Firecrawl to scrape a real estate website every week. There are 9 suburbs in total, and my workflow scrapes them one by one, adding the data to the relevant Google Sheet.
The issue I’m running into is that sometimes the workflow gets stuck in the “checking status + wait” loop. This happens because, even though the request was sent, Firecrawl never actually receives it — so the status never updates and the loop runs indefinitely.
My current idea is to only let the loop run a maximum of four times. If the status still hasn’t updated after that, I want the workflow to re-send the extract request to Firecrawl.
How would I set this up? Or is there a better approach to handle this situation that I should consider?
