Connection lost - increasing the limit

[Ajay_Rohera]

Version: 1.105.0 (latest beta) and 1.104.2 (latest stable), on cloud, starter plan

Whenever there are multiple (in hundreds) api requests via http node (when we have to fetch heavy files), it shows ‘connection lost’. Is there a way to increase the no. of requests or something which can allow to fetch heavy data?

In my case am trying to access heavy files from zerodha, may be there is a limit on zerodha but wanted to be clear if it’s n8n issue or zerodha’s.

Thanks,

[Md_Altamash]

The culprit is both n8n as well as Zerodha.
Probable bottle necks:

1. Connection Timeout from n8n
2. Rate Limiting in Zerodha.
   I would like to know more about the problem to Give an answer. However One thing you could do is use batch processing. run Api requests in smaller chunks because I think when there are too many request and if zerodha rate limit is not reached probable culprit is n8n starter plan.

[Ajay_Rohera]

Thanks for your reply. sometimes it happens so soon and that too on fewer requests that it seems like n8n issue. Is there any solution for that?

[Md_Altamash]

with your current update it seems that this is neither timeout nor rate limiting error, have you referred to the failed logs?? if yes what was the error shown there?? of-course we can solve this. I think this has to do something with memory or edge case of the workflow. please check once.

[Ajay_Rohera]

will do and get back. thanks a lot.

[Md_Altamash]

no worries you are welcome