How to bypass Cloudflare security with HTTP Request

Questions
1

Describe the problem/error/question

I am trying to use HTTP Request node but the GET call failed due to Cloudflare protection.
How can I bypass this protection?

What is the error message (if any)?

Please share your workflow

(Select the nodes on your canvas and use the keyboard shortcuts CMD+C/CTRL+C and CMD+V/CTRL+V to copy and paste the workflow.)

Share the output returned by the last node

Information on your n8n setup

  • n8n version:
  • Database (default: SQLite):
  • n8n EXECUTIONS_PROCESS setting (default: own, main):
  • Running n8n via (Docker, npm, n8n cloud, desktop app):
  • Operating system:
2

Hey @zohar_Lerman , hope all is well.

You do realize that this is exactly why service owners use cloudflare in the first place, right? :grinning_face_with_smiling_eyes: If they require human verification, they do not wish their services to be exposed to automated systems / crawlers.

3

I know, but I am sure the smart people here know how to bypass it :slight_smile:

4

It’s called a bot detection and if we using Request node to crawl some website. It’s bot then.

That’s why there are some service exists.
They provide the service to bypass the bot detection and charge some fee.

So I think if you want to crawl the page with bot detection. Considering some other service like firecrawl or Crawl4AI.