I have a list of over 300 URL stored in a Google Sheet and I want to use this workflow to scrape data from listed pages on a scheduled time.
The problem I encountered is that the Loop Over Items node only processes the first 11 items and the loop completes without error. I think this is because the data received from the Google Sheet is paginated.
When I used the Aggregate node to make it a single list without pagination, it became an array and I cannot use the Loop Over Items node because it only processed the first item (0 index in array).
What can I do to make the Loop Over Items node include next pages or to convert it into a single list without converting it into an array?
Information on your n8n setup
- n8n version: 1.76.1
- Database (default: SQLite):
- n8n EXECUTIONS_PROCESS setting (default: own, main)
- Running n8n via Docker
- Operating system: