HTTPS Get Method randomly throws 404 errors

Hi all,

I’m running two https nodes with Crawl4AI in a loop with batch size 1 item. The first https is a POST, and the second one is a GET to get the task_id when it is completed. The wait time in between is 5 seconds. It works perfectly fine in a loop until it randomly throws a 404 error.

The resource you are requesting could not be found
Task not found

Screenshot 2025-01-30 at 13.57.25


Screenshot 2025-01-30 at 13.58.00

But when I go onto Postman I can see the result at the same time. It has to do with n8n.

Information on your n8n setup

  • n8n version: 1.75.2 (Self Hosted)
  • Database (default: SQLite): Default
  • Running n8n via (Docker, npm, n8n cloud, desktop app): Docker

Hi @richard1

Thanks for posting here and welcome to the community! :partying_face:

What kind of “task” is the API returning in the GET request? Is it something dynamic that might not be ready when the request is sent?