I made n8n-nodes-crawl-and-scrape community node :) Try it

Just released my new n8n node: n8n-nodes-crawl-and-scrape!

Easily add web crawling & scraping to your n8n workflows. Check it out! #n8n #nocode #automation #webscraping

npmjs: n8n-nodes-crawl-and-scrape - npm
GitHub: GitHub - swimmingkiim/n8n-nodes-crawl-and-scrape: n8n custom node to crawl and scrape website with crawlee

1 Like

I got an error trying to install this:

Error installing new package

Error loading package “n8n-nodes-crawl-and-scrape” :The specified package could not be loaded Cause: Cannot find module ‘/home/node/.n8n/nodes/node_modules/tough-cookie/lib/cookie’. Please verify that the package.json has a valid “main” entry

I’m getting this issue from people. If you using n8n via self-hosted docker, maybe method introduced in below link will help you with that.