HTTP Request fails sometimes? Even though URL works on browser?

I am pinging a URL using HTTP Request node, and the return I get is a 500 error. However, when I ping the URL myself using browser it works? And yes I’m able to reproduce the error many times for same URL

What is the error message (if any)?

See error message on right side. Further scroll down you see 500:

And this is my HTTP Request node. I added the user agent to try to overcome this issue:

I think the website Im pinging, has some bot protection, so it doesn’t return anything, but on manual pinging using browser it works. How do I overcome this?

Information on your n8n setup

  • n8n version: whatever latest is on the cloud
  • n8n EXECUTIONS_PROCESS setting (default: own, main):
  • Running n8n via (Docker, npm, n8n cloud, desktop app): on cloud, rahuldeshpandehero

Hello @rahuldeshpandehero - The HTTP code 500 means you have reached the website without connection error. As you can see the error advises you need to check the parameters you are sending to the server. I’m not sure which website you’re contacting but you need to review the parameters. feel free to share the canvas so I can replicate and test on my side for you.