What’s the maximum time of execution of a workflow?
Here is some context.
My workflow starts by reading a huge Google Sheets file, let’s say it has 50.000 rows.
After that, for each row I’m going to execute an HTTP request using the data gathererd from the sheet.
My HTTP request is limited by a 1 request for 1000 ms. So that, to execute 50.000 requests the workflow will need 50.000 seconds (833 minutes = 14 hours)
Is it possible for n8n to manage this kind of execution time?
What you still have to have an eye out is memory consumption as you apparently process a lot of data. So you have to build your workflow in a certain way (parent-workflow that mainly orchestrates and sub-workflow that process the data). If not, n8n will at some point run out of memory and then crash.
Nice to know this self hosted approach. Thanks, I’ll give it redad. Also, my API provider just released a batch request that will help me to manage this large amounts by grouping them.