Describe the problem/error/question
Hey everyone,
I built a lead gen pipeline with two parallel AI branches per lead and I’m stuck at ~60% success rate. I’d love to get to 80%+ but can’t figure out where exactly things break.
Branch 1 — CEO Extraction:
AI Agent (GPT-4o-mini) uses Firecrawl map + scrape tools to find the managing director from German company imprint pages. Problems:
Agent sometimes outputs NOT_FOUND even when the imprint data is right there
Random timeouts on scrape calls (sites load fine in browser)
Can’t distinguish “genuinely no imprint” from “something broke silently”
Branch 2 — Screenshot Scoring:
Firecrawl HTTP takes full-page screenshots, Gemini Vision scores how badly the site needs a redesign. Problems:
Screenshots come back empty/null randomly on reachable sites
Some screenshots capture cookie banners or loading states instead of actual content (despite waitFor: 10000)
Both branches use continueRegularOutput on error, so failed items pass through silently with empty data — making debugging a nightmare.
What I need help with:
Better error visibility (why did it fail, not just that it failed)
Architecture tips to push reliability up
Anyone solved similar Firecrawl screenshot inconsistencies?
Stripped-down workflow JSON attached (just the two AI branches + merge logic). Sticky note has context.
Thanks
What is the error message (if any)?
Please share your workflow
Share the output returned by the last node
Information on your n8n setup
- n8n version: 2.12.2
- Database (default: SQLite):
- n8n EXECUTIONS_PROCESS setting (default: own, main): default
- Running n8n via (Docker, npm, n8n cloud, desktop app): Docker
- Operating system: Ubuntu 24 (Hostinger VPS)