Describe the issue/error/question
Hello,
I would like to extract everyday jobs on Indeed.
I’m using n8n on my desk and I have error code : 1020.
Do you know why?
Thank you for your help!
Hey @jjjjj,
Welcome to the community 
It looks like the error is coming back from Indeed so it could be something they are doing as part of a rate limiting process or maybe they are using Cloudflare and that is blocking you as that has a 1020 error code (https://support.cloudflare.com/hc/en-us/articles/360029779472-Troubleshooting-Cloudflare-1XXX-errors#error1020).
You could try setting a user agent header in the node to see if that helps.
It has to be blocking - fairly simple to block on the serverside as the user-agent for n8n comes across as axios and thats on most block lists
I did it Treyr, but now I have an other problem.
Do you have a solution? Thank you!
Trust me - you could spend all your time trying to get past this Cloudflare block and the next and the next - it wont work all the time.
It doesnt have anything to do with n8n.
Best to give this up or your IP will be blocked by Cloufflare and that will be very disruptive. Google it
You could do the scraping through a service like scraperapi which helps to bypass something like Cloudflare.
1 Like
When I tried them a while back, the experience was pretty bad so @jjjjj let us know how it works out.
1 Like
This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.