HTTPS Get Method randomly throws 404 errors

[richard1]

Hi all,

I’m running two https nodes with Crawl4AI in a loop with batch size 1 item. The first https is a POST, and the second one is a GET to get the task_id when it is completed. The wait time in between is 5 seconds. It works perfectly fine in a loop until it randomly throws a 404 error.

The resource you are requesting could not be found
Task not found

But when I go onto Postman I can see the result at the same time. It has to do with n8n.

Information on your n8n setup

• n8n version: 1.75.2 (Self Hosted)
• Database (default: SQLite): Default
• Running n8n via (Docker, npm, n8n cloud, desktop app): Docker

[ria]

Hi @richard1

Thanks for posting here and welcome to the community!

What kind of “task” is the API returning in the GET request? Is it something dynamic that might not be ready when the request is sent?

[Amir_HK]

I’m having this same issue. Was any solution identified?

[richard1]

it was a timeout due to improper server settings

[Amir_HK]

I see, thanks. Were you able to solve it somehow in n8n?

[22savagexxx]

What was wrong on the server?

[Diego_Menchaca]

@richard1 I’m having the same issue.

What server are you using and what precisely did you tweak?

I’m using Digital Ocean and it seems I can’t set a custom time out.

If anyone else has solved the “404 Task not found” your advice would be much appreciate

Thanks!