Get content (websites) best approach?

Questions
1
  • n8n version: latest docker pull image
  • Database (default: SQLite): Postgressql
  • n8n EXECUTIONS_PROCESS setting (default: own, main): no idea
  • Running n8n via (Docker, npm, n8n cloud, desktop app): Docker
  • Operating system: Docker on Synology NAS

Hi

Quick question: what is best approach for getting content from site(s)? I have a python script which did that in my automations and within AutoGen or Crewai you have agents which do that for you but with the one of n8n I am out of luck.

Suggestions highly appreciated!
J

2

Hey @JanHoedt

It all depends on the site, the http request node can do it for some sites. I typically start with the http request node and if that doesn’t work start looking into other options like browserless or an AI service.

3

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.