Http request node is crashing workspace when handling pagination

[Kalvin_Mizzi]

Describe the problem/error/question

Running this workflow is causing both my self-hosted and cloud workspace to crash unexpectedly. It always crashes between the 2nd and 3rd page. The 3rd page request never outputs in console. I also tried running a simplified example without issue.

What this workflow does is performs an http get request and loops through for each page.

What is the error message (if any)?

No error message, it just hangs

Please share your workflow

^ The above is the workflow that hangs

Share the output returned by the last node

N/A

Information on your n8n setup

• n8n version: 1.77.3
• Database (default: SQLite): SQLite
• n8n EXECUTIONS_PROCESS setting (default: own, main): own
• Running n8n via (Docker, npm, n8n cloud, desktop app): Docker, but tried with n8n cloud too
• Operating system: Debian 12 for self-hosted

[Kalvin_Mizzi]

I still haven’t been able to solve this

[barn4k]

hello @Kalvin_Mizzi

better to move the looping part into sub workflow to reduce the executions memory size.
So the logic would be like: Get the first page >> process it in sub workflow >> get next page >> process in the sub workflow >> etc

[Kalvin_Mizzi]

Thanks @barn4k

This is incredibly useful conceptually to understand so thank you for that.

I’m wondering if there a super advanced youtube series on n8n? The advanced series from n8n was still more on the basic side and nuances like this would be helfpul to learn.