Describe the problem I’m aggregating data from an http query to hubspot in a postgresql table. Read data → store in table → check if more pages → read data starting where it left off → etc. It slows down significantly after each subsequent run, and slows basically to a halt after the 4th run. It’…

Solution Found a solution! For those in the future: In the end, I was right about the memory bloating. Thanks to OP of this thread . The solution was to loop via webhooks. see below

If your hosting it locally, I would guess it’s because of your machine not being able to handle the data. Do you need to send the set node output back to the IF node? If not, maybe you could just put a blank value in the set node, and that might stop the data cumulating together.

Hey, thanks for your reply. I know for sure that it isn’t my machine because I can get up to 600 records when I do batches of 200, but it only goes to 60 records when I do batches of 10. The issue is definitely n8n aggregating all data from previous loops. I do need to loop the set node back to t…

It’s likely doing this because when it sends it back, when it goes through the node outputs the entire database, which would cause it to get slower. (The postgres node might not actually be doing that, but if it is, that might be the problem.

Prevent data from aggregating between loops

Questions

snapops 7. Januar 2026 um 02:30 5

Solution

Found a solution! For those in the future:

In the end, I was right about the memory bloating. Thanks to OP of this thread.
The solution was to loop via webhooks. see below

Thema		Antworten	Aufrufe
Looping Creates to many artefacts Questions looping , out-of-memory	2	934	6. März 2023
Sending all data at once after Loop Over Items Questions core , data-transformation	3	234	12. April 2025
Waiting until a loop is finished before sending data to the Aggregate Questions node , workflow-building	8	875	15. Mai 2025
Aggregate Node not aggregating Questions	3	388	11. Juli 2025
Loop stops execution after first element Questions	4	1002	21. Oktober 2021

Prevent data from aggregating between loops

Solution

Verwandte Themen