When creating an HTTP Request for this site, I get a Forbidden error. The site is accessible without credentials/cookies. I have set up other services to monitor this page before, and I’m surprised that I’m having an issue. I have set up like 10 other workflows today without issue.
What is the error message (if any)?
“Forbidden - perhaps check your credentials?”
Please share your workflow
This should be pretty easy for any human to replicate
I’m not really sure what Postman is. I did a quick google search, and I’m not seeing a good reason to sign up for a 3rd party service for testing this.
I tested changing the user agent to avoid the 403, and didn’t really have any luck.
After doing some tests it worked on postman since it handles better js challenges and goes through cloudflare bot protection as it is trusted.
As for n8n i’m not sure it’s trusted yet by cloudflare
As an alternative i was able to make it work on n8n by using scraperbee
Go to scraperbee and create an account you’ll get an api key straight away
Then create an http node
Hmm. I’d rather not use scrapingbee, as it is not free to use. I can only get a trial, which won’t work long term. Their pricing is well-beyond what I’d like to pay,
Again, I have pipes.digital and visualping.io both currently scraping this site to create alerts. My goal with n8n was to migrate all of my alerts into a single platform, so I’d like to remove my reliance on random 3rd party services. If I were to keep a 3rd party service running, it would be visualping.io. I’m not going to pick some other random 3rd party service to rely on in order to migrate this alert.
